William Taft actually said...
As I say farewell to you, let me renew my expressions of affection and sincerest respect for you, and of my profound gratitude for your hard work, your unvarying loyalty, and your effective public service.
Context
Letter to Richard A. Ballinger Accepting His Resignation as Secretary of the Interior
03/06/1911