Theodore Roosevelt actually said...
There must be no hurry, but there must also be no halt; and those who are anxious that there should be no sudden and violent changes must remember that precisely these sudden and violent changes will be rendered likely if we refuse to make the needed changes in cautious and moderate manner.
Context
Remarks at the Forty-Second Anniversary Banquet of the Union League Club in Philadelphia, Pennsylvania
01/29/1905