Most feel well in the beginning but soon tapers off and you start feeling unwell, for some it is the driving force for depression episodes and emotional problems for some who have never had these problems before, some have to quit. It is this reason why experienced doctor have you do 12.5-25mg EOD, anything more it just creates too many problems for men.
If it were me in your shoes and I was borderline suicidal on Clomid, I would talk to my doctor about stopping. It isn't worth it if you end up hurting yourself.