WHITE PLAINS – The Rev. Al Sharpton said civil rights groups will mobilize to come into Westchester if County Executive Rob Astorino does not change course and start living up to the terms of a fair housing settlement with the federal government.

"To continue to play games with millions of dollars in funds for people in need of affordable housing in a county that needs this kind of engagement is an insult to the people of this state," he said Thursday at a press conference outside the county office building.

The county was notified Wednesday that it would lose $5.2 million in federal community development grants from 2012 if it didn't reverse its long-standing contention that local zoning is not an obstacle to diversifying Westchester communities. An analysis of local zoning is a requirement of the settlement with the U.S. Department of Housing and Urban Development.

The loss of money in the middle of Astorino's campaign for governor against Andrew Cuomo has thrust Westchester's long fight with the federal government over the 2009 settlement into the spotlight. But it's still unclear how much the issue will resonate with voters outside of Westchester.

Speaking in his office after the press conference, Astorino, a Republican, disputed the idea that the county is not upholding its obligations, including a central requirement that the county build 750 units of affordable housing in 31 mostly white communities.

"We are complying with this settlement," he said. "We will build the 750 units as required in the time frame. We have not been fined. We are nowhere near being fined. We won't be fined."

Astorino said the $5.2 million, or any amount of money, wasn't worth giving up local control over zoning. The county lost $7.4 million in grants last year.

As HUD continued its pressure on the county, the federal judge overseeing the case is also soon to weigh in. Judge Denise Cote has called a conference for May 2 in response to complaints from the Anti-Discrimination Center, the Manhattan-based group whose lawsuit led to the settlement, that the county is flagrantly violating the agreement.