William McKinley actually said...
We should not permit our great prosperity to lead us to reckless ventures in business or profligacy in public expenditures.
Context
Inaugural Address
03/03/1901
Inaugural Address
03/03/1901