Good for you for sticking it to them! Whatever you are eating is right just look at your weight history. Unfortunately that's why I usually don't tell people when I'm dieting. Though I know they probably look at what I eat since I am overweight, I think they'd be more critical if they knew I was trying to lose some.
Stay strong and keep doing what you're doing! Don't let their negativity get to you.