Andrew Johnson actually said...

"But he goes further, and plainly intimates what he means by 'public considerations of a high character,' and this is nothing else than his loss of confidence in his superior."

"Under a sense of public duty I am compelled to deny your right under the Constitution and laws of the United States."

"Public considerations of a high character constrain me to say that your resignation as Secretary of War will be accepted."

"Thus far and upon this vital policy there was perfect accord between the Cabinet and myself."