Gov. Chris Christie worked hard to win endorsements of blacks and Latinos in his re-election campaign and has frequently touted his inroads in minority communities in the buildup to a potential presidential run.

But many of the influential people he wooed back then have grown disillusioned with the governor, disturbed by what they see as his rightward turn and neglect of New Jersey as he has taken his message on the road. In...