John Kennedy actually said...
The United States retains the right to resume atmospheric testing forthwith if the Soviet Union should conduct tests in violation of the treaty.
Context
Letter to Senate Leaders Restating the Administration's Views on the Nuclear Test Ban Treaty.
09/10/1963