Andrew Johnson actually said...
There must be confidence between the Government and the States, and while the Government confides in the people the people must have faith in the Government.
Context
Message to Governor Benjamin G. Humphreys of Mississippi
11/16/1865