One of the rules in question required for-profit colleges and certificate programs at non-profit colleges to show that the education their students receive leads to "gainful employment." If they fail to meet that standard, the schools' federal aid would be withheld.

The Borrower Defense to Repayment rule clarified how student borrowers who were defrauded or misled by their college can apply for loan forgiveness. It was created after the government received an unprecedented number of claims following the collapse of Corinthian Colleges.

This rule also created a fast-track way for students to apply for forgiveness in the event their college closed. That part of the rule was implemented early to help Corinthian students, specifically.

The department said it would keep its debt forgiveness promise to the 16,000 borrowers who currently have claims being processed.

"Fraud, especially fraud committed by a school, is simply unacceptable. Unfortunately, last year's rule-making effort missed an opportunity to get it right," DeVos said.

Critics argue that these rules are too burdensome for colleges. A group representing many for-profit colleges in California has sued the Department of Education seeking to block the borrower defense rule from going into effect.

The plaintiff, The California Association of Private Postsecondary Schools, said the rule "threatens the existence" of many of its member institutions, according to the lawsuit.

A group of nine Attorneys General, all Democrats, filed a motion this week to intervene in the lawsuit. Andsome Democratic senators have urged DeVos to keep the rules in place.

"Delaying this important pathway to debt relief would harm thousands of students, many with crushing levels of student loan debt and few meaningful job prospects," read a letter signed by Senators Elizabeth Warren, Patty Murray, Sherrod Brown and Dick Durbin.

The Department of Education said it will hold hearings on the rules in July.