Benjamin Harrison actually said...
I have felt the reproach which lawlessness has brought upon some of our communities.
Context
Letter to the Virginia State Baptist Convention on Lawlessness in the Southern States
05/20/1892