One thing that quickly occurs to me is that splitting your testosterone dose, 50mg every 3.5 days, would likely provide you with stable levels and help bring your estradiol down, possibly to the point that you could cut back (or eliminate) your AI. Was SHBG determined? And a PSA obtained for reference purposes?
Did your doctor explain that testosterone replacement therapy is a commitment, a commitment that is typically for life? Remind me if you discussed your fertility with him/her.