I try to refrain from doing that, but I usually can't resist it: whenever a British/American tourist (or not a tourist) asks me for directions in strugging, slow French (with an accent that gives their origin away), I reply in English. At first they seem very slightly offended, which I can understand and that's why I try to refrain from doing it, but eventually they're glad that I can explain without them having to struggle with their dictionary.
But good point. I actually just sort of stand there, flexing my muscles, grinning with vanity ... maybe I could ask "so where y'all from?"