I was veg for 5 years. I am now semi-veg - in that I drink milk, eat eggs, fish and fowl..
It will not harm you as a bb at all if you choose lacto-ovo (milk and eggs) or semi-vegetarian (as above, like me) vegetarianism...
Think about it.. all the protein in milk, eggs, whey protein, fish, fowl....
..and in reality, hom many people get much of their protein from red meat?
Try it..