If vegetarians stopped calling themselves vegetarians and instead said "I'm not a meatarian" thus placing the "label" on everyone else, perhaps they wouldn't be thought of as the odd people.

I personally would continue to eat meat and wear my meatarian label with pride... but I'm sure others would succumb to the societal expectation placed on them.