Benjamin Harrison actually said...
His countrymen will sincerely mourn his loss while they cherish with grateful pride the memory of his deeds.
Context
Message to Congress Announcing the Death of Admiral of the Navy David Dixon Porter
02/12/1891