Lyndon Johnson actually said...
While we must have a Government that is strong, we need not have a Government that is wasteful.
Context
Remarks to Members of the Budget Bureau Staff at the Signing of the 1965 Budget
01/19/1964