That is a brilliant point and describes what I've been unable to articulate. It's not a great simulator (weak graphics, little real movement, no thrill, lame story (Pick up a canister, really? In Star Tours we blew up the freakin' Death Star!) and 2/3 of the riders really can't see the screen well), while at the same time the interaction for 2/3 is just as bad if not worse than Mission:Space. Heck, with MS, I get a joystick.
Midway Mania, which I'm not a huge fan of but others really enjoy it, is truly interactive and your involvement is clear and directly affects the outcome of your personal experience.
SR truly does neither well.
But being in the cockpit of the Falcon is awesome, which is why I think the reviews get progressively worse the more you ride it as that thrill dissipates.