Grover Cleveland actually said...
The simple and plain duty which we owe the people is to reduce taxation to the necessary expenses of an economical operation of the Government.
Context
Third Annual Message (first term)
12/05/1887