You should modify your regimen. It doesn't mean you should take it easy or do any less, but you may need to do different exercises.
Doctors telling people to simply stop doing something doesn't work so well. It can be drugs, potato chips, lifting, MMA, cigarettes, etc. etc... but simply saying "don't do that" doesn't work.
You need to find something you like as much or better that doesn't load your lower back in a dangerous way. A good doctor will explore your new options instead of telling you what you can't do anymore.