Why do people hate on vegetarians?

i'm a vegetarian for over two years now. i only do it because i don't want to ingest growth hormones that they feed animals. everyone picks on vegetarians i want to know are we that different because we care about our bodies? like wth