Benjamin Harrison actually said...
The law creates two new officers, whose aggregate compensation may be $12,000 per annum, without, it seems to me, a justifying necessity.
Context
Message to the House of Representatives Returning Without Approval \An Act to Prescribe the Number of District...\
02/26/1893