Theodore Roosevelt actually said...
The cost of doing Government business should be regulated with the same rigid scrutiny as the cost of doing a private business.
Context
Fourth Annual Message
12/05/1904
Fourth Annual Message
12/05/1904