Ronald Reagan actually said...
I think I will start raising a holier that they ought to get rid of that law because it's an infringement on your right to vote for who you want to vote for.
Context
Remarks at a Republican Campaign Rally in Mount Clements, Michigan
11/04/1988