George Bush actually said...
Punishment is necessary not only as a deterrent to future crimes but for its own sake -- which is to say, for the sake of justice.
Context
Remarks to the Law Enforcement Community in Kansas City, Missouri
01/22/1990