It's not about wanting to take the baby to WDW per se. It's about wanting to go to WDW when you happen to have a baby. I've made the same argument with people who claimed they wanted to go to WDW "for the baby." My argument is "If YOU want to go, and you understand the work it involves, then go and have fun. But if you're going for the benefit of your baby, then wait until the child is old enough that he/she will get some memories out of it."
Slappette & I brought li'l Slapperina to WDW last December. She turned 5 months old during the trip. We went because it will probably be the only time we can go in December (without going during the crazy holiday break) until we both retire. Slappette is a NJ teacher, and she's off on a break for a while raising Slapperina; once she goes back to work, she's not the sort who will take time off beyond the time teachers get just to go on a trip. So this was our chance to see the holiday decorations, do the MVMCP, all of that.
I won't lie to you, it was hard. Much like daliseurat, we were worried about her being exposed to airplace germs, but we were also worried about trying to drive like we usually did before Slapperina. The idea of driving during nap times and stopping whenever she got upset to soothe her would result in a 3 day drive each way. So we took the Amtrak Auto Train from Virginia to Sanford, FL. I won't lie, a lot of the trip was difficult. Slappaerina didn't like the train, and would only sleep if I held her (which I did, sitting up alllll night long). She was out of sorts during much of the trip. All meals were wolfed down, as she found the uncanny timing necessary to wake up just as we were usually within minutes of getting our entrees. She cried a lot, sually feeling more at peace in our room, around familiar toys and music. And she suddenly developed a case of the jumpies; any sudden motion would bring her to tears. If I said "HI!" too quick or too loud, it scared her. And the one "adult" night we had (my sister, her family & our mom went at the same time, and one night mom agreed to watch her grandkids), we had to run back home for a crying jag nothing but the presence of mom and dad could cure. One of my most UN-P.C. moments came when we had to leave the Candlelight Processional when she woke up in the middle of it and started crying. I told my wife "Well at least she didn't throw the celebrity narrator." Oh, it was un-P.C because the narrator was Marlee Matlin.
Now having said all that, I do think it was a pretty special bonding experience for all of us. She got in the swing of things...eventually. And there were some genuinely "ooooooh"-ish moments from the wee one. Like when she woke up in the middle of Finding Nemo: The Musical. We were completely ready for a "WHAT THE F*@! IS ALL OF THIS INSANITY" kind of baby cry, but instead, she soaked it all in, eyes wide, mouth agape, and it was truly magical for us. Likewise, she seemed to dig Buzz Lightyear, Toy Story Mania, and Haunted Mansion. The afternoons I spent playing with Slapperina in our SSR suits whilst Slappette lounged poolside are moments I would not have had were I working during those two weeks. Slappette was also kind enough to occasionally let me run off and play when they were ready for naps but I wasn't. And we did get a few pics of Slapperina with characters (usually when she was asleep, but hey, you can't win 'em all...)
My feeling would be the same as it was years ago, before I had a bambino: you need to really REALLY lower expectations as to the level of "fun" and "magic" you will experience taking an infant to WDW, and what you expect to see and do. But if you really want to go, and you know what those limitations would be, go for it. Don't go because you want the baby to meet Mickey. Go because you want to go, and you understand those limitations. If you decide to go, have a blast. (And try to go when it's cooler, so heat rash is one less thing to worry about).
EDIT: I remembered one other kinda cool moment. While waiting for the parade during MVMCP, Slapperina started to get a little grumbly. I had a repertoire of songs I usually sing and still do) to help her chill out, starting with Doo Wah Diddy Diddy, followed by Joe Jackson's Is She Really Going Out With Him, Marhsall Crenshaw's Someday, Someway & Billy Joel's She's Got A Way. I was singing these songs to Slapperina as quietly as I could, but naturaly, it had to be loud enough to be heard over the din. So my family started singing along, and quite a few people tried to join in, though they got in the spirit of things and sang (shhhh) quietly, to keep the baby from being overhwlemed. And Slapperina fell asleep, big ol' smile on her face, and everyone silently cheered: Yayyyyyyy...