I've stayed at POFQ and CSR, and we liked POFQ a lot better. It's all personal preference obviously, but we liked the higher quality theming at POFQ. From the central hub exterior buildings, CSR looks cheaply themed by Disney standards. The colors and overall look just don't really do it for me. I love the lake and pool area though. POFQ on the other hand is outright beautiful. Walking the grounds you feel almost like you are in a walkable historic district with all the flowers, fountains, and parks. Another neat touch at POFQ is taking the boat to Downtown Disney. This is a fun little diversion all by itself and nice to see the resorts from a different perspective. Top it off with the prettiest lobby of the moderates.
Moving on to the rooms, while we preferred the theming in the rooms at POFQ over CSR, one thing that I can't disagree on is the beds. These double beds in Moderate resorts across WDW have to go. They should ALL be upgraded to queens like CSR. However, it sounds like you just have 1 very small child. Why not go with the king bed room and bring a crib? Or perhaps the sofa folds out?
On the food we also found CSR to be lacking by comparison. The pepper market was very disappointing taste-wise and it is more expensive than any other moderate cafeteria! $15 per person? Forget that...the food is just not worth that price. POFQ on the other hand, while not setting the world on fire with taste was just better quality. Breakfast was actually quite good!
Last but not least, the bus situation. POFQ is the first stop on the Port Orleans loop, so if you head to the bus stop in front of the main lobby, you are almost guaranteed to be sitting down on your trip to every park.