Theodore Roosevelt actually said...
Each applicant under this provision must state in addition to the information now required in the application of a citizen of the United States that he owes allegiance to the United States and that he does not acknowledge allegiance to any other government
Context
Executive Order—Issuance of Passports to Residents of the Insular Possessions of the United States
07/18/1902