Although my recommendation is definitely in the rainy season, we are down in Florida. I first looked at our property in the April-May timeframe. There were caterpillars EVERYWHERE. All over the doors, home, rappelling from the trees, you name it. A few weeks later when I took my wife to it, there were BUTTERFLIES everywhere. A few weeks can be the difference between an "ominous omen of garden destruction" or "a pure symbol of paradise". Rose colored lenses need to be left at home.
We have looked at property in 13 states physically. With some of them being as far north as you can get in the lower 48 (across the street was Canada, literally), to here in Florida. My suggestion is that you can look at it in any season as long as you remain objective. You must also WALK THE PROPERTY. Not just down paths and driveways. Get out into the woods and fields. We looked at a 40 acre property in Oregon. The previous owner had an awesome shop that he used to build and repair trailers. My red flags went up. Trailers? So what did he do with the tires and other hazardous waste? It was only after walking some of the 40 acres that we found the gulch. There must have been 300-400 tires as well as two scrapped cars in there.
We've dealt with many agents and our opinion is that if you are willing to put up tens or hundreds of thousands of dollars for a property, the only person to trust is yourself. YOU need to crawl under the house and into the attic. YOU need to find out about the ticks attached to your leg after you walk the property. Don't take anyone's word for anything. Check it out yourself. Pay for the well tests, sewage pumping, survey map, and anything else that "is out of pocket" before you close. It's cheap insurance to know that you "need a new septic" before you close.
We wish you the best of luck in your property search. As SouthernLiving mentioned, don't rush into a property purchase. Especially if your rationalization is for spring planting. We missed out on many planting seasons (about 3 years worth) to make sure we purchased the right HOME. Getting the right place can save you much more $$$ that you could put into a massive greenhouse if you're that worried about missing the season. Conversely, rushing into a purchase can be a serious money pit that could cost you everything (including your garden).
Hope this helps!