Franklin Roosevelt actually said...
We must recognize clearly that housing will not be built if costs are too high in relation to the consumer's income.
Context
Message to Congress on Legislation for Private Construction of Housing
11/26/1937