There is a reason why evolution has made aromatization to happen to 0.3% of testosterone: to balance and enhance it with the effects of estradiol. Anything that gets in the way of that is not good, in my opinion.
Role of estradiol: Video
I have never taken aromatase inhibitors.
Remember: All studies on estradiol in men were done in men with testosterone under 400 ng/dL as an average. Those men are not us!