“There are not many borrowers left who have an incentive to refinance”