Andrew Johnson actually said...
It is manifest that it is due to emigration which is going on from that Territory into other regions within the United States, which either are in fact or are believed by the inhabitants of Colorado to be richer in mineral wealth and agricultural resources.
05/14/1866