actually, it's higher then you think. At least the pain, in most cases. But, usually, kidney pain is so bad, that you would be seeing doctor by now, if you have one.
Try to stretch and move that area, if you feel more pain, it has to be muscle or tendon, or nerve.