Late April is pretty nice too. Went 3rd week of April this year, after the spring break/Easter crowds had all died down, and it was pleasant.
From working a full year in MK, the best times of the year to visit are:
Mid January-Late February
Late April-Mid May
Late August-Early November
Thanksgiving Week (shockingly)