Oh, this is such a highly opinionated topic....
I read all the posts so far and I think it's very telling that the first two used the word "dragged" when referring to very young children on their first trip.
And about half the other posts indicated their kids don't (or probably don't) remember anything when going that young. From what I've read and what I would expect, "dragging" and "not remembering" are very typical of the experience of taking a pre-schooler or an infant.
On the other hand, those folks who waited until 5 or so are unanimous that not only they, but THEIR KIDS remember it and had a magical, special trip.
As you probably guessed, I fall into the latter group, waiting until my daughter was 5 and it was SO worthwhile to do that.
Taking a child under 3 or so makes it virtually impossible for him/her to remember anything. It's still okay to take them if you like, just don't give yourself the illusion that the trip is for them--it's for you. And that's fine, if that's what you want.
(note that I do understand and sympathize however with those parents who have older children, but also littler ones. In that instance, I can understand it)
Register on WDWMAGIC. This sidebar will go away, and you'll see fewer ads.