I think unless you approach an exceptionally high level of muscularity, and, as such partake in all of the associated practices neccessary to attain such a level - for example steroids, an exceptionally harsh diet, an exceptionally gruelling training routine etc. Your health will not be negatively affected.
Once you start approaching levels such as those who currently compete, you may have problems with steroids, you may have problems with your heart, but you probably won't.
Its based on extremes, if you act like an idiot, then yes your health will be negatively affected by stuff outside of resistence training, diet and light drug use... a certain Mr Valentino springs to mind.