Andrew Johnson actually said...
It reduces the whole population of the ten States--all persons, of every color, sex, and condition, and every stranger within their limits--to the most abject and degrading slavery.
Context
Veto Message
03/01/1867