As someone who has worked at parks, and who does youtube videos and occasionally films on select rides...
yes, it annoys the snot out of me!
First, I almost never film on roller coasters or thrill rides (with 4 exceptions- all with park permission/ supervision and all with strapped on go-pros). To dangerous, and far to many times I've seen cell phones go flying, and I've seen the results of people getting hit with flying cell phones. I'm happy to see some parks starting to enforce no filming on rides like that, but not enough.
And dark rides there are ways to film where it doesn't disturb everyone and their brother! I'll film on some of the dark rides (key word, some), and if I am, I strive to do it in a way that distracts as few as possible. It's amazing to me how many don't have a clue that they can turn down their screen's brightness. I'll run mine so the screen is practically off on rides, and even then keep the phone down where it isn't in the way of others. And never with the flash/ light on a ride. And also using a setup that stabilizes the phone/ camera, keeps it in a firm grip so it can't slip or be lost, but also puts it in a place where it isn't in the way of others.
I've actually asked people after the ride if my recording bothered them, and had people express surprise that I was videoing because they didn't see the light or other things. It can be done in a way that doesn't disturb, bother, or ruin the ride experience for others, but very few will bother to learn how to do it that way.
It actually wouldn't bother me if Disney and other parks just put a blanket ban on video taping on rides, regardless of ride type. Those who do it for youtube or commerical purposes can work around it just fine, or work with the park's PR departments if they really need on ride footage. The rest don't need it.