James Buchanan actually said...
If this were not the case, then by the purchase of a new territory from a foreign government out of the public Treasury Congress could enlarge their own powers.
Context
Veto Message
06/21/1860