Millard Fillmore actually said...
This request has been taken into the most respectful consideration, but the conclusion at which I have arrived is that the public interest would not be promoted, but, on the contrary, might under circumstances of possible occurrence, be seriously endangered if it were now to be complied with.
06/25/1852