I’m not offended. You have to make exceptions for people who make stupid remarks like that. They lack perspective, sensitivity, and intelligence. You can make a facetious remark in return, but they won’t get it. You could say, “How nice of you to notice,” and leave off the “you idiot,” but why bother.