Harry Truman actually said...
It is expensive to keep up the forces necessary to prevent war, but in the long run it could be a lot more expensive not to have them.
Context
Radio and Television Report to the American People on the State of the National Economy.
07/12/1949