Libido is influenced by so many physical and psychological factors it's very hard to point to one thing; but we can eliminate some somethings.
You need to stabilize E2.
Also, have you gotten Prolactin checked?
What do your all of your Thyroid labs look like?