I think it would be the advice of any good doctor to be cautious with androgens if you are at a particularly high risk for, or suffering with, prostate problems, as androgens are tied to this.
That said, I will say also that both androgens and estrogens are believed to be necessary for a condition like BPH. Without one, the other should be unable to trigger the disorder. It has been theorized that DHT may be a better androgen replacement that Test for someone at risk for such a condition for this reason. 1-Test, not aromatizing, should, again in theory, also be a better option.