George Bush actually said...
It does not make sense to tax marriage when we need to encourage marriage and stable families.
Context
Statement of Administration Policy: H.R. 4181 - Permanent Marriage Penalty Relief Act
04/27/2004