Theodore Roosevelt actually said...
We are bound in honor to try to remedy injustice; but if we are wise we will seek to remedy it in practical ways.
Context
Remarks at Columbia Gardens in Butte, Montana
05/26/1903