I think you're going to find better prices and discounts in late August. While I know many in northern parts of the US don't have kids go back to school until after US Labor Day, a good chunk of the southern US is back in school at some point in August. My kids will be back in school on the 20th this year, our old district is going back on Aug 15th, and I have friends in GA and AL whose kids are going back even earlier.
Early November crowds aren't awful, but you may still feel a bit of a boost from people there for Halloween, some people feel Jersey week has an impact, and Epcot will see higher crowds due to F&W. If you're heat sensitive, you'd probably like the weather better in November.