An AI will help if elevated estrogen is the cause. (and it most likely is)
However, I understand what you've read, as an AI will cause the test to have a more adverse effects on the lipid profile.
So if you want to control estro sides with nolva, and rather tolerate a low sex drive (& sometimes depression), continue without AI.
The propecia may also cause the low sex drive sides, as it inhibits 5-AR, which in turn reduce DHT.
DHT may be hard on the hair line, but it is also very necessary for sexual function.
So it all comes down to what is your priority: low sex drive vs more unfavorable lipid profile (with AI),
or dropping propecia and perhaps lose more hair. (depends on your Genetics)