I can tell you exactly what's wrong. Your not working them out hard enough! For years I heard people bitch about how thier calves just WON'T get bigger, then they blame it on bad genetics, and just figure it will never happen. I gained an inch on my calves this last year. Haven't even started working my soleus (makes up 60% of calf) with the sit down machine, so it was an inch in the gastrocnemius. There are type 1, and type 2 muscle fibers in there, and you need to work each one accordingly. I do MWF workouts, I superset them with whatever upper body part I'm doing that day. 15 sets of 16 reps. Donkey calf raise machine has worked the best, but it's hard to find nowadays. Started out at around 280lbs for all the sets, and now I'm up to 400lbs. THEY WILL GROW, but you have to put the work in, and have the same intensity that you do when you work out a bodypart that you love. I don't care who you are. Arnold said he had to work his calves to total exhaustion to get them to grow. You just got to think about what they do all day....carry you around. They have to be pushed extremely hard to be overloaded enough to start growing. There are some good articles out there on calf training. The one listed below is good for the basics.
http://www.realsolutionsmag.com/ezine/26/issue26b.asp