Genetics dictate how your body responds to diet and excercise. Doesn't matter if you're a freak or poster boy. For some people, all the workouts in the world won't get them in some nut sack magazine. Others look outstanding with not a lot of work.
Gotta do the best you can with what you have.