I know this is not giving you the answer you are looking for, but I am hung up on the doc not giving you your info. So this info is legally yours as is your whole medical record/history. You may have to fill out some release type paperwork, but this is your info and they have to give it to you.
Call med records at your medical facility and request it be released to you.
Also, get a physical and request your test levels. Tell the doc you are not getting full erections and you feel a little lethargic and you feel as though you are not recovery from your fun activities ie: basketball, lifting, etc. *Be careful not to give symptoms of depression. for example say: you feel lethargic, but you still love to do your favorite activities you just feel crushed physically after and it takes longer than normal to fully recover. Your not getting full erections, but you are still hot for your girl, etc
This should do the trick. Be sure to take control and sound well educated on the matter. Ask for a full test panel as if you don't they are likely to only give you total serum.
Age may play a factor in how he is reacting to you. How old are you?