That is definitely a valid fear (the bday cake ugh) but from a distance the castle lights aren't that noticeable to me anyway. November weather tends to be a little cooler than October but it can still be hot. I've seen temps close to 100 and as low as mid 80's so it's a toss up. As others have said, slow times are rare but in my experience crowds after Halloween and until school is out for Thanksgiving are tolerable. The Christmas parties have changed that dynamic somewhat but I still go often. In November and enjoy it.
Sounds fine to me. Those crowds are manageable. I can deal with that. The thing is, we'd be driving back home the Thanksgiving weekend anyway if we went then, probably driving back starting Saturday. So more or less avoiding Thanksgiving at the parks. I figure November is still hot enough for shorts and swimming in the pools in the day - and night. In March it was always hit or miss at night if it was warm enough to swim at night, but always good in the day. It doesn't matter to my wife, if she was sitting on the Equator she'd be in a hot tub still.