I don't think that "waste" is the right word at all. Does it use additional gas? Yes. Is it a "waste" of gas? Hell no.
My air conditioner keeps me comfortable. When I put on cologne, I still smell like cologne when I get out of the car. My back does not stick to the leather seats. My hair stays combed. I don't breathe exhaust fumes. Passengers in my car are comfortable. It is worth every penny of "wasted" gas.
When I drive with my windows down, I smell like shit when I get out. My hair is blown all over my head. It's still hot as shit, after all I'm just circulating hot air through my car. My back sticks to the leather. I choke on exhaust fumes and roast when at a stoplight. On the plus side, I get another 1.5 miles per gallon. I'll stick with my AC.