I've read a lot of arguments going both ways, and I still eat soy. It mixes well with other foods, sops up liquids which makes it perfect for some cooking applications, and doesn't taste like ass. It's the perfect protein powder in a couple of ways.
I'm quite a sceptic when it comes to a lot of stuff that's spouted off about anything, be it good or bad. I've had about a quarter cup of soy a day for a while now, and I don't have gyno.. nor do I have any positive side effects that I've noticed, other than an added 15 grams of protein a day in my diet.
Just never forget to consider the source, and look at the raw numbers for yourself.
By the way Alcatraz20, do you have links to any of the studies you mentioned?