But the firm remains focused on its non-agency asset portfolio despite slowdown