Ronald Reagan actually said...
One of the reasons I like this Gramm-Rudman bill is because it attacks budget deficits the right way, not by raising taxes, but by restraining spending.
Context
Remarks Announcing Bipartisan Support for Balanced Budget and Emergency Deficit Control Legislation
10/03/1985