Harry Truman actually said...
We are not surrendering these rights by terminating the state of war.
Context
Letter to the President of the Senate Recommending Legislation To Terminate the State of War With Germany.
07/08/1951