Andrew Johnson actually said...
I have been unable to find in the Constitution of the United States any warrant for the exercise of the authority thus claimed by Congress.
Context
Veto Message
06/19/1868
Veto Message
06/19/1868