Benjamin Harrison actually said...
I have felt as a citizen and as President a mortification which every American must feel who examines into the standing of the United States in the merchant marine of the world.
Context
Remarks Hoisting the Flag on the Steamship New York
02/21/1893