Theres nothing bad about milk in the nutritional sense of the word - so go ahead and use it.
However the down point about milk is the lactose, and the inevitable "bloat" that alot of people, myself including get from it for a day. Its usually gone when i wake up in the morning, but when i...