hi sourkraut, welcome to 101.
who is "we" in your question? in an anarchist situation, the governmental (or corporate) bodies that accepted the deal (that includes the debt) would no longer exist.
your question definitely points to one (of many) reasons why an anarchist society would have a hard time in this world--every institution that benefits from the current system would be unhappy with the new non system.