Franklin Roosevelt actually said...
Except in the case of temporary employees, Sundays and holidays occurring within a period of annual leave shall not be charged as annual leave.
Context
Executive Order 7845—Prescribing Regulations Relating to Annual Leave of Government Employees
03/20/1938