Calvin Coolidge actually said...
Exclusive devotion to their subordinate even though important departments must give place to loyalty to the whole Government.
Context
Address at the Sixteenth Regular Meeting of the Business Organization of the Government
01/27/1929