Herbert Hoover actually said...
The amount of saving in public funds to be effected by a thoroughgoing reorganization, while difficult to estimate accurately, will be material, amounting to many millions of dollars annually.
Context
Special Message to the Congress on the Reorganization of the Executive Branch.
02/16/1932