dreamfinder
Well-Known Member
How are "ratings" done and normalized? I am actually very curious to know. I know they do some guest surveys, but they seem minimal.
Depends on the ratings in question. Pretty sure @lentesta and his crew compile tons of rating for Touring Plans and the unofficial guide. But yes, WDW also does their own internal surveys. As far as "minimal" goes, a well designed survey can infer alot from a small sample size. Refer to a recent poll conducted by Quinnipiac University about Trump
They infer the feelings of the nation (millions of people) from a sample size of thousands. So WDW can gather data with a similar margin of error with a smaller sample size. As PP's have pointed out, there are inherent biases and flaws with surveys and polls, but a well designed survey can be fairly accurate. Or as the case with many WDW surveys, can convey what they want it to if designed for that intention.From September 21 - 26, Quinnipiac University surveyed 1,412 voters nationwide with a margin of error of +/- 3.1 percentage points, including the design effect. Live interviewers call landlines and cell phones.