James Buchanan actually said...
The principle has been recognized in some form or other by an almost unanimous vote of both Houses of Congress that a Territory has a right to come into the Union either as a free or a slave State, according to the will of a majority of its people.
12/06/1858