Calvin Coolidge actually said...
Our constitutional history started with the states retaining all powers of sovereignty unimpaired, save those conferred upon the national Government.
Context
Memorial Day Address at Arlington National Cemetery in Arlington, Virginia
05/29/1925