Millard Fillmore actually said...
It appears to me that the protection of the public records and papers requires that such acts should be made penal and a suitable punishment inflicted upon the offender
Context
Special Message
03/25/1852