It seems like no lab work has been performed, which is a grave mistake. You'll need to do that before any further hormonal experiments.
However, if clomid improved your libido, that's a strong signal that the low libido has a hypogonadal cause. So, you're going to be disappointed to learn that...