Many small farmers have farming practices that are safe and healthy, but have not gone through the expense to be certified organic. We have a farmer that we buy beef, pork and poultry products from, and they pasture raise all their animals, with a small amount of grain supplementation. The animals spend most of their time on grass pasture that is not sprayed or treated in any way--but the meat is not certified organic. However, I feel it is very healthy, and I love getting eggs and meat from them. To contrast, organic poultry can spend over 95% of its life indoors, in crowded conditions, never eating grass or veggies, and still be labeled organic. So, don't be afraid to investigate and look at options that aren't labeled organic--if you can talk to the farmer and get satisfactory answers on how things are raised. Also, if you are going to do only ONE thing organic, do butter. Most of the pesticides and toxins an animal is exposed to are concentrated in the fat of the animal. Thus, conventional butter (which is 100% fat) can contain up to 80 times the toxins and pesticides that are found in organic butter. So, butter is a biggie.
You can PM me for the email address of the ranchers I buy meat from, if you are interested.
I use door to door organics in the winter, and am planning to use Grant Family Farms CSA for the summer and fall months. You can also get organic eggs, meat, and fruit from them during the CSA period (June-December).
Anyway, there are lots of options out there, and farmers markets are a great place to get stuff in the summer. I have gotten boxes of things like over ripe tomatoes really cheap, which I then take home and make sauce from, which I freeze for later use. Or you can dice and freeze to add to soup or stew, or dry and use as sun dried tomatoes. If you do any food preserving, and have a schedule that can accommodate that unexpectedly, then you are all set! You might also look into co-ops. There are a lot of groups out there that buy from co-ops together, and that is a great way to get natural and organic non-perishables like canned foods or cereals.