When we stayed at the Poly, we were in the Hawaii building, which is all club level rooms. The club room (food area) was on the 3rd floor of that building, with a beautiful view over the lagoon. There was also a connecting lounge area upstairs on the fourth floor. The concierge CMs were on the first floor as you walk into the building.
I don't know if there are other club rooms in other buildings, though.