Epstein only served 13 months in jail and was allowed to leave during the day on work release.

Acosta said he did not want his involvement in the case to interfere with the Trump administration's accomplishments.

President Donald Trump added that this was Acosta's decision.

Donald Trump, via CNBC Epstein has been under investigation for sex crimes against underage girls and has recently been charged with one count of sex trafficking of minors and one count of conspiracy to commit sex trafficking of minors.

Deputy Labor Secretary Patrick Pizzella will take Acosta's place in the meantime.