Herbert Hoover actually said...
I take this action with very sincere regret and cannot let the occasion pass without expressing my appreciation of your long and notable public service
Context
Letter Accepting the Resignation of Floyd R. Harrison as a Member of the Federal Farm Loan Board
09/03/1931