this is just a generalization, but a few guys ive known and trained with said the exact same thing as an excuse not to work legs, and their legs really werent big at all. You might just have naturally built legs while you had to work hard to build your upper body, so your brain just sort of sees your legs as too big and you upper body as not big enough
if you can, post some pics of your wheels and we'll be the judge