Richard Nixon actually said...
Whenever the President of the United States is doing the right thing, whenever he is defending this country, he should not apologize or express regrets to Khrushchev or anybody else in the world.
Context
Speech of Vice President Richard M. Nixon, Arlin Field High School Football Stadium, Mansfield, OH
09/30/1960