I think it is definitely a compliment to you. In essence they are saying, "damn this girl is hot! and I can't believe that I am talking to her." Also, I think that many people have a stigma that says fine ass woman (you)= a snobby ass bi@tch (not you). So people may have a hard time believing that you are that good looking. Still a compliment if you look at it.
You go girl'! (in my best rupaul/diva voice)