It all depends on the personalities involved. We've gone with the same group of friends/family several times with very few problems, but the one year that we went with a certain group of know-it-alls I still have nightmares about. One instance comes to mind involving me wanting to watch Spectro while they were doing Space Mountain (I don't do SM anymore because of back issues, and as an adult fully capable of making my own decisions I feel that is not unreasonable). They were screaming at me about why I HAD to do this with them or "else".
I chose "else" and watched Spectro.