The University of Alabama board of trustees voted Friday to give back $21.5 million from a philanthropist who urged students to boycott the school over the state's controversial abortion law, and then promptly removed his name from the campus' law school named in his honor.

Hugh F. Culverhouse Jr. said the school was punishing him for urging students to consider other educational options in the state. He pledged last year to donate $26.5 million in all over four years -- in what would have been the largest donation in the school's 187-year history.

"I expected this response from UA," Culverhouse said in a statement to Fox News. "I will not allow my family's name to be associated with an educational system that advocates a state law which discriminates against women, disregards established federal law and violates our Constitution."