Investigators said they basically ignored these complaints. A lot of times they weren't even reported as having to receive the complaints; the complaints weren't investigated; Freddie Mac took no action to find out if the accusations were true and no action to correct some of the behavior that was causing problems.

The mortgage companies had paid to provide customer service to mortgage borrowers and not only failed to resolve many of those complaints in the required 30 days. They didn't keep the government informed and according to the report, the government was checking back.

The Housing Finance Agency's inspector general says more than 34,000 serious complaints were made by borrowers between October 2011 and November 2012. Those complaints were fraud, threats and intimidation from mortgage agencies.