John Kennedy actually said...
I strongly urge them to live up to their responsibilities and to recognize no arbitrary bar of race or color-for such bars have no place in any institution, least of all one devoted to the truth and to the improvement of all mankind.
Context
Special Message to the Congress on Civil Rights and Job Opportunities
06/18/1963