Harry Truman actually said...
I have instructed the Secretary of Defense to take steps to have the remaining instances of discrimination in the armed services eliminated as rapidly as possible.
Context
Special Message to the Congress on Civil Rights
02/01/1948