Theodore Roosevelt actually said...
All officials of the Government, civil, military, and naval, are hereby directed not only to observe the President's proclamation of neutrality in the pending war between Russia and Japan, but also to abstain from either action or speech which can legitimately cause irritation to either of the combatants.
Context
Executive Order
03/09/1904