Theodore Roosevelt actually said...
If you have to choose between being noxious and merely harmless, of course, choose to be harmless.
Context
Remarks on Receiving the Degree of Doctor of Human Letters From Williams College in Williamstown, Massachusetts
06/21/1905