Millard Fillmore actually said...
It is quite certain that neither by law, nor by treaty, nor by any other official proceeding is it competent for the Government of the United States to establish any distinction between its citizens founded on differences in religious beliefs.
02/12/1851