Andrew Johnson actually said...

"The suspension has not been revoked, and the business of the War Department is conducted by the Secretary ad interim."

"The mutual confidence and general accord which should exist in such a relation had ceased."

"But he goes further, and plainly intimates what he means by 'public considerations of a high character,' and this is nothing else than his loss of confidence in his superior."

"Under a sense of public duty I am compelled to deny your right under the Constitution and laws of the United States."