Franklin Roosevelt actually said...
The right to vote must be open to our citizens irrespective of race, color, or creed—without tax or artificial restriction of any kind.
Context
Radio Address from the White House
10/04/1944