I have stayed at most of the resorts and I agree with your husband. I love Wilderness Lodge. You can boat to Magic Kingdom and to the Contemporary. You can catch the Monorail at the Contemporary and go to EPCOT or even to Magic Kingdom. You can bus to MGM and Animal Kingdom. The only thing I would check out is - I know that the snack bar at the Wilderness Lodge is going to be out of commission sometime in February - that makes getting a fast breakfast or quick snack a little harder.
One of the other things we like about the Wilderness Lodge is the walking trails all around. The Poly and Contempary are okay, but the Wilderness Lodge just seems more quite, private and out of the way, but close enough to get to most places very quickly. The pool is great and this whole resort is a favorite for my Grandsons. The Wispering Canyon Cafe is great fun - be sure to have someone ask for a large glass of water and ketchup.