Richard Nixon actually said...
We are not going to use executive privilege as a shield for conversations that might be just embarrassing to us, but that really don't deserve executive privilege.
Context
The President's News Conference
01/30/1973