Mortgage rates moved higher for the second straight week, and the lending community is just beginning to feel the effects.

Total mortgage application volume fell 2.6 percent last week, according to the Mortgage Bankers Association's seasonally adjusted report. Volume remains 6.6 percent higher than the same week one year ago.

Applications to refinance a home loan, which are most sensitive to even the smallest moves in interest rates, fell 3 percent for the week and stand just 3 percent higher than a year ago. As rates continue to move higher, refinances will make sense for fewer borrowers.

The average contract interest rate for 30-year fixed-rate mortgages with conforming loan balances of $453,100 or less increased to 4.41 percent, its highest level since March, up from 4.36 percent, with points increasing to 0.56 from 0.54, including the origination fee, for 80 percent loan-to-value ratio loans.

"Rates moved higher last week driven by concerns over a weaker U.S. dollar, signs of more robust growth and rising rates abroad, and moderately strong fourth-quarter domestic growth," said MBA economist Joel Kan.

While the interest rate on the popular 30-year fixed rose to its highest level since March, other rates, such as the 15-year fixed and the FHA rate, were at their highest levels since 2011 and 2013, respectively.

The jump in the FHA rate caused a 7 percent drop in government purchase loans and a 13 percent decrease in applications for government refinance loans. FHA loans, which are insured by the government and allow low down payments, are often used by lower-income borrowers who have less room in their budgets.

Mortgage applications to purchase a home, which are less rate-sensitive week to week, fell 3 percent last week but are 10 percent higher than a year ago.

Homebuyers may be rushing into the market now, hoping to close a deal before mortgage rates move even higher. Rates this week did just that, rising to the highest level in four years.

A bond market sell-off is causing yields to rise sharply. Mortgage rates loosely follow the yield on the 10-year Treasury. There will surely be more volatility in the bond market this week, as the Federal Reserve will make a policy announcement Wednesday afternoon and the monthly employment report will be released Friday.