If it was a stroke he would notice it all of the time. That was my first thought, too.
As for seeing the penis doctor...Only if Mr. One-Eye is afflicted.
Seriously, though, it's probably stress. If looking like Popeye bothers you so bad, stop getting tired, stressed, drunk, and high. M'kay?