Benjamin Harrison actually said...
The law should at least have contained a provision for the continued discharge of their duties by the incumbents until the new officers were appointed and qualified.
Context
Message to the House of Representatives Returning Without Approval \An Act to Prescribe the Number of District...\
02/26/1893