James Buchanan actually said...
The lawfulness of the practice rests upon the exigencies of the public service; which require that the movements of the Government shall not be arrested by an accidental vacancy in one of the Departments; upon an act of Congress expressly and plainly giving and regulating the power, and upon long and uninterrupted usage of the Executive, which has never been challenged as illegal by Congress.
01/14/1861