Abraham Lincoln actually said...
But they can not be required to take an oath of allegiance to this Government, because it conflicts with the duty they owe to their own sovereigns.
Context
Executive Order—In Regard to Behavior of Aliens
07/20/1862