“Targeting affordability requirements to support those most at risk would provide them with appropriate protections as well as freeing up lending for those who can afford it.”