Theodore Roosevelt actually said...
Next only to a man's having worn the blue comes the fact of the man's having worn the gray to entitle him to honor in my sight.
Context
Remarks in Capitol Square in Richmond, Virginia
10/17/1905