Captain's Grille at Yacht Club is pretty good, I had a nice lunch there in March. It wasn't very busy so it might be an easy walk up TS. I had dinner there a long time ago, in 2009, and it was a nice dinner but I don't know how walk up it would be for dinner. I have heard the Crew's Cup lounge at the Yacht Club is really good too. We didn't get to try it but I guess it shares a kitchen with Captain's Grille or Yachtsman (I can't remember.).
Also, there is ESPN along the Boardwalk. I haven't eaten there in years either, last time I was there I got nachos and they were good. But it was pretty dead during the day. It might be different if there was a big sporting event though.