Benjamin Harrison actually said...
He served his country, not for fame, not out of a sense of professional duty, but for love of the flag and of the beneficent civil institutions of which it was the emblem.
Context
Message to Congress Announcing the Death of General William Tecumseh Sherman
02/13/1891