Jimmy Carter actually said...
I would not favor the sending of an American Olympic team to Moscow while the Soviet invasion troops are in Afghanistan.
Context
Meet the Press Interview with Bill Monroe, Carl T. Rowan, David Broder, and Judy Woodruff
01/19/1980