John Kennedy actually said...
I have reached the decision that silver metal should gradually be withdrawn from our monetary reserves.
Context
Letter to the Secretary of the Treasury Concerning Monetary Silver.
11/27/1961