James Buchanan actually said...
Under any form of government extravagance in expenditure must be the natural consequence when those who authorize the expenditure feel no responsibility in providing the means of payment.
Context
Message to Congress on the Conditions of the Treasury
06/11/1858