Harry Truman actually said...
I don't see any sense in increasing the Federal national debt when we have got a prosperous country such as we have now, and we ought to pay as we go.
Context
The President's News Conference on the Budget
01/12/1951