DEAR MISS MANNERS: My friends and I (all male) are old-school when it comes to being seen in public.
We might meet for a happy hour, go to the horse races or meet for afternoon tea. We always dress for the occasion. Sport coats and ties in correct weights and colors are the standard attire, unless something else is required -- along with correct hats, when warranted.
We inevitably get asked if we "just came from a funeral" or if we are "going to a wedding," but our attire is incorrect for either of those events. Or we are simply asked, "Why are you dressed up?"
Replying that we like to put our best foot forward or that we like to make a good first impression puts the inquisitor on the defense when they remember that they are wearing shower shoes, an undershirt and cargo shorts in a nice public place.
We don't want to insult anyone, so what is a nice reply that won't make them feel uncomfortable?
GENTLE READER: That is kind of you, because they were trying to make you and your friends uncomfortable for outshining them. Bullying people for doing the right thing is an unfortunately common defensive ploy.
You could reply, "These are our everyday clothes. You should see us when we are dressed up."
Miss Manners leaves it up to you whether you want to add, "Is that your best look?"