A federal judge on Thursday set a $25,000 bond for former Mississippi Corrections Commissioner Chris Epps, who is accused along with a Rankin businessman in a bribery and kickbacks case.

"Today, Christopher Epps, the longest serving commissioner of the Mississippi Department of Corrections in our state's history, and Cecil B. McCrory, a former Mississippi legislator, justice court judge, Rankin County School Board chairman and local businessman, were arraigned on a 49-count indictment stemming from an almost decade-long scheme to violate the public trust of the citizens and state of Mississippi for their own personal benefit and gain," said acting U.S. Attorney Harold Brittain in a news conference on the steps of the federal courthouse in Jackson.

"This is definitely a day that has brought a black eye on our state," said State Auditor Stacey Pickering.

Federal investigators allege in the indictment that between 2007 and March 12, 2014, McCrory would bribe or provide kickbacks to Epps in exchange for the awarding of MDOC contracts, leases or work to companies owned by McCrory, or companies seeking contracts with MDOC, that paid McCrory as a consultant.

It is also alleged that Epps would steer MDOC contracts to McCrory's companies.

Federal prosecutors accuse McCrory of secretly paying Epps with cash and by paying off the mortgage on Epps' Flowood home, the equity of which Epps later used to take out a loan and buy a condo in Biloxi. Another large bribe payment from McCrory allowed Epps to "trade in his Biloxi condominium for a larger, more expensive condominium in Pass Christian," the indictment says.

Epps kept the cash in a safe at his home until he could deposit it in a bank in amounts no greater than $10,000, the indictment alleges.

The indictment said the federal government has seized Epps' Flowood home and his condo in the Coast, along with other property linked to the bribes, the indictment says.

"I am disappointed and angered that the former commissioner of the Department of Corrections appears to be involved in illegal activity," said Gov. Phil Bryant in a statement. "Such behavior cannot be tolerated and I am convinced that the state auditor and U.S. attorney will make certain justice is done."