It's a little late in the process to be speeding things up, but if you really want to try something then a SERM would be your best bet. Clomid would be ok. Enclomiphene would be better if you can get it. Gonadorelin use might end up being counterproductive. While it has the potential to add to endogenous GnRH to increase pituitary stimulation, this could also result in more negative feedback at the hypothalamus. In contrast, a SERM reduces negative feedback at the hypothalamus and pituitary, effectively stimulating both.
Gonadorelin has the potential to be more useful when one is still on TRT; if used with a SERM it can keep the pituitary and testicles active.
In your shoes, with a relatively short stint of TRT and already 5 weeks off, I would just try to ride it out. You should see continuing improvement over the next few weeks.