You feel worse because your nivel of prolactin are sorting the higer end; When a man has a high nivel of prolactine, he will feel very bad, testosterona will no have effect; maybe you need antiprolactin med, like, carbegolin, or bromocriptine. Another thing, prolactin is antagonist of dopamine, dopamine is a neurotransmiser of the brain, when somebody has depression, or anxiety, maybe the guilty is low nivels of dopamine. Medications pro-dopamine, like bupropion, maybe can heelp; another thing, prolactine blocks testosterone. I thik, maybe this is the problem