Franklin Roosevelt actually said...
I must confess that I do so with mixed feelings—because I find myself, as almost everyone does sooner or later in his lifetime, in a conflict between deep personal desire for retirement on the one hand, and that quiet, invisible thing called 'conscience' on the other.
Context
Radio Address to the Democratic National Convention Accepting the Nomination
07/18/1940