Andrew Johnson actually said...

I know no other way in which they can be preserved and maintained except by a constant adherence to them through the various vicissitudes of...

I submit to Congress whether this measure is not in its whole character, scope, and object without precedent and without authority.

The power of removal was incident to that duty, and might often be requisite to fulfill it.

I have carefully examined the bill 'to regulate the tenure of certain civil offices.'