The Biden administration has claimed progress reducing the annual budget deficit, but total U.S. debt continues to climb to record highs.