I would just explain the situation to them. People like to put their nose where it doesn't belong, and sometimes you need to be stern in telling them to just mind their own business. Honestly, they probably won't, but at least you'll have made your stand. What they do is on them and you can't worry about other people.