James Madison actually said...
The United States, having been the first to abolish within the extent of their authority the transportation of the natives of Africa into slavery.
Context
Eighth Annual Message
12/02/1816
Eighth Annual Message
12/02/1816