Benjamin Harrison actually said...
Let us not forget that as good citizens and good patriots it is our duty always to obey the law, and to give it our loyal support, and insist that everyone else shall do so.
Context
Remarks During Decoration Day Ceremonies at Laurel Hill Cemetery in Philadelphia
05/29/1891