Lyndon Johnson actually said...
I pledged that Government expenditures would be administered with the utmost thrift and frugality.
Context
Letter to the Chairman, Civil Service Commission, on Coordination of Federal Activities in the Field.
01/12/1964