your lose conditioning within 2-3 weeks bigtime.
but taking time off is something that you shouldn't be scared of doing.. shit happens in life and also sometimes a break is good. pro athletes have offseasons right? they don't play year round for a reason