Benjamin Harrison actually said...
Lynchings are a reproach to any community; they impeach the adequacy of our institutions for the punishment of crime.
Context
Letter to the Virginia State Baptist Convention on Lawlessness in the Southern States
05/20/1892