Lyndon Johnson actually said...
When the burdens of the Presidency seem unusually heavy, I always remind myself that it could be worse--I could be a mayor of a city instead.
Context
Remarks Before the National Legislative Conference of the National League of Cities.
03/30/1966