I am sitting at 230lbs 5'11'', waist is 33. Shorts are not so bad, but always tight in the quads. I usually have to go up a side to get a little room in the leg.
Pants are even worse. I always have to go a size or 2 up to fit my legs. At the proper waist size loose/baggy/bootcut are skin tight.
You could always get past the leg size issue if you just embrace the speedo.