Any time you can
Well, my main criteria, is anytime I can, have the money and vacation time. We usually do October or April/May. Last year on a whim, we went in July...thought it would be terribly crowded and were pleasantly surprised.
But back to your dates ('cause it's not all about me... :lol: ), by far the quietest time and lowest room rates would be in January. In the spring, rates go down after 4-16, so May to early June should be fine...after spring break and Easter, but before most schools let out. It is also the second lowest rate period. Crowds will be moderate and spotty (one area may get a bit busy, but others will remain empty)
While I like smaller crowds, I've been in early Dec. when it looks as if the parks aren't really open, never lines and easy walk in dining, but you know, I miss a little bit of traffic. I feel I've missed something as I go through themed queue areas without enough time to look around...those walkways seem much longer if you are walking the whole time without periodic stops. You also have your most limited presentations of parades and fireworks during this time.
Not positive of exact times for '05, but Flower and Garden is held at Epcot starting in April, through May and usually one week in June...in case you might be interested in that.