That's a common misconception. Most of our debt is very short term. Inflation would drive interest rates higher and our overall debt wouldn't fall that much.
The other problem is our entitlements. Most of those (i.e. social security) are indexed to the cost of living. So when that skyrockets, so does our entitlement cost (as if it hasn't skyrocketed enough already).