Ronald Reagan actually said...
Finally, I am directing that Members of the Cabinet and other appointees set an example by avoiding unnecessary expenditures in setting up their personal offices.
Context
Memorandum Directing Reductions in Federal Spending
01/21/1981