Theodore Roosevelt actually said...
Where wrong has been done by anyone the wrong-doer shall be punished; but we shall not halt in our great work because some man has happened to do wrong.
Context
Remarks at the Banquet of the Society of the Sons of the American Revolution
05/01/1902