Hey Liftr,
Did you get any other bloodwork done apart from tests levels?
Your LH levels will give good info about where the problem is:
If LH is normal-high (while off clomid and test levels 200s) then you have primary hypogonadism ie your balls aren't working
If LH levels are low (while off the clomid) then you have secondary hypogondism. This can be caused by relatively high estrogen giving the negative feedback to your test production, and can be fixed with AIs. If not caused estrogen, the diagnosis is more difficult, and HRT may be the option.
Really, since your dealing with something that is going to affect the rest of your life, you want a good endo who will take full panel of blood tests and take action.
Test, free test, LH, FSH, estrogen, prolactin especially