Andrew Johnson actually said...
I have this day removed Mr. Stanton from office and designated the Adjutant-General of the Army to act as Secretary of War ad interim.
Context
Message to the Senate on the Removal of Edwin M. Stanton as Secretary of War
02/20/1868