Millard Fillmore actually said...
And therefore I exhort all good citizens, as they regard our national reputation, as they respect their own laws and the laws of nations, as they value the blessings of peace and the welfare of their country, to discountenance and by all lawful means prevent any such enterprise;
04/24/1851