from what i have seen (so anecdotal) i would say earlier in the week. Tuesday probably being lightest crowds. If you look through some of the other threads there is a good website that actually has the average attendance for each day of the week. It also depends when you are looking to go. Between labor day and and thanksgiving it is a ghost town.