Franklin Roosevelt actually said...
Only the Secretary of State may grant and issue passports in the United States.
Context
Executive Order 7856—Rules Governing the Granting and Issuing of Passports in the United States
03/30/1938