Lyndon Johnson actually said...
One man alone with his conscience-whether in the laboratory, or the study, or the classroom, or on the street corner--is to be jealously guarded from the thousand who, believing him wrong, would deny his right to search and his right to speak the truth.
Context
Remarks at the National Medal of Science Presentation Ceremony.
02/09/1966