It's important to all guys! Intellectually we know there are more important things than penis size, but this is an emotional thing -- not an intellectual one.
There is such as thing as "too small" and "too large", but the vast, vast majority of guys aren't in either of those categories. Given that you are somewhere in the middle, there is a widespread belief that it's better to be on the upper end of the "midsize" range.