muscle is tough to hold on too.. its not like its that easy to grow muscle and hold it. the bigger you get, the harder it becomes to keep that much muscle. your body is fighting you the whole way.
as long as you stay committed to this sport there is never enough muscle, its a very unique sport in that you can keep building muscle as you get older.. unlike speed sports where you start losing your speed in your mid to late 20's and then have to become more of an endurance athlete.