William McKinley actually said...
If there have been wrongs committed, the wrong doers must not escape conviction and punishment.
Context
Remarks to the Commission Appointed to Investigate the Administration of the War Department in the Spanish-American War
09/25/1898