Well, I'm not a complete and total sucker for "Disney magic," though I'm not immune to it either. I'm more of a sucker for theme parks, and WDW is just one of the most, if not THE most, efficient organizations for theme parks there is.
Plus, while I'm sure it's obvious to us, there's plenty to do at WDW besides the parks. Lots of people who gripe about going to Orlando consider a vacation someplace where they can sun themselves all day poolside or on the beach. You can pretty much do that at WDW and you're close enough to "real" beaches to make it a 2-destination vacation (half at the beach, half at WDW). You like camping? Fort Wilderness is amongst the highest-rated campgrounds in the nation. You like shopping on your vacation? Oh, right, I forgot, there are no shops at Disney.
Golf nuts have tons of options, and you have nightlife options, a few shows that are silly but comparable to what you'd find on a cruise ship. Watersports, tennis, and plenty for kids to do everywhere. Plus, many excellent restaurants (for the naysayers who assume WDW is all about frozen pizza and burgers). People can stay at a WDW hotel and have a ridiculous amount to do without ever even setting foot in one of the 4 main parks. Not to mention close proximity to 1000 other vacation spots that Disney and Universal are slowly choking the life out of, but they're there...
That's essentially what I tell anyone when asked why single people with no kids would want to spend time at a kid's place. And I'm a pretty presuasive talker, so they usually shut up.
As for my GF and I, we opted to get APs last year, with the intent of going 3 times within the year (last August, this Easter break and this August 10 days earlier than last time). Get a nice big fix. Then go other places (England, Ireland, a fall foliage cruise up the Atlantic Ocean, and maybe check out theme parks across USA). But when we're ready to go back to Disney, it'll probably be with an Annual Pass again, 3 times in a year, like this time, to get the most bang for the buck. . And who knows? Maybe after some more traveling, we'll decide we like WDW best.