Anytime someone approached me and spoke French I would say, "I'm visiting your Country I don't speak French, sorry," and 9 times out of 10 they would engage me in English and if they didn't speak it they would grab someone who did.
They're a very warm, friendly people in my experience the trick...