Just called and spoke with a DCL agent who called guest services. He confirmed that the Southern will be sailing from the Pan Am Pier. The confusion is that the Fantasy sails out of Pier 4 in Old San Juan because it's too large to fit in Pan Am Pier.
Register on WDWMAGIC. This sidebar will go away, and you'll see fewer ads.