Mold allergies driving me crazy!?

Get a dehumidifier. Even if you are in the woods, the mold is going to be most concentrated indoors. Outside it will be much less concentrated in the air because it settles or if the wind takes it it spreads it out very thin. You may also consider having your house checked for mold. There is much info on the net about how to get rid of mold in your home. Chances are, since your home is in the woods, it has gotten into your home somehow. Just my guess, I'm no doctor, but I have mold allergies as well. You have my sympathies.