Theodore Roosevelt actually said...
Lincoln, himself a man of Southern birth, did not hesitate to appeal to the sword when he became satisfied that in no other way could the Union be saved, for high though he put peace he put righteousness still higher.
Context
Remarks at the Lincoln Dinner of the Republican Club in New York City
02/12/1905