Andrew Johnson actually said...
The heads of the War and Navy Departments will respectively give orders for paying appropriate honors to the memory of the deceased.
Context
Executive Order
05/28/1866
Executive Order
05/28/1866