Calvin Coolidge actually said...
We should not depart from the wise policy established, and thus far rigidly followed, of keeping our expenditures within our receipts.
Context
Address at the Fourteenth Regular Meeting of the Business Organization of the Government, Washington, D.C.
01/29/1928