On paper, New Jersey's Chris Christie leads the nation's Republican governors. In practice, he is becoming a favored target of his peers.

Forget, for the moment, about the cornfields and the straw polls, the live-free-or-die gun shops of Manchester and the sticky-sweet BBQ pits of South Carolina. There is a point in the 2016 presidential campaign, when the action that matters most is more likely to happen under gilded ceilings of Manhattan’s toniest restaurants than where voters actually live. Which is why New Jersey Governor Chris Christie found himself supping at Cipriani on May 18, seated between the billionaire who might fund his way to the White House and a rival governor who wants the job himself. It was a test meal, in its way, and Christie fumbled it.

Organizers had told the press to attend to hear Christie give a muscular address on his foreign policy vision. But the real audience was his table-mate, Sheldon Adelson, the casino mogul who dumped more than $100 million to elect Republicans in 2012 and was promising even more. Just weeks earlier, Christie had flown to Vegas with three other current and former Republican governors to meet with Adelson at his Venetian casino under the banner of the Republican Jewish Coalition. There Christie had botched his message, speaking of Israel’s “occupied territories,” a term that the Zionist Adelson does not favor. Christie later apologized during his few private minutes with the GOP kingmaker. Now he was back for what organizers called a “Major Speech on Israel and the Middle East.” And something went wrong again. He didn’t mention Israel once in his 18-minute address. In the midst of a political rehabilitation tour, his tablemate Texas Gov. Rick Perry saw a clear opportunity. When he rose to speak minutes later, Perry shoehorned three references to Israel within 90 seconds.

Popular Among Subscribers

As the head of the Republican Governors Association, Christie is the charismatic captain of a club composed of formal partners but tacit rivals. And that rivalry has only gotten stronger in recent months. Despite surface-level niceties and some degree of symbiotic friendship, many want to see him and his presidential ambitions go up in flames. On Thursday, the tensions broke into view as Republican state leaders broke with Christie, who has refused to publicly appear with Rob Astorino, a long-shot candidates hoping to replace Democratic New York Gov. Andrew Cuomo. “Glad to be with my buddy @RobAstorino in Aspen,” tweeted Perry, a few days after Christie told reporters he did not believe that the Republican Astorino had a chance of winning. Indiana Gov. Mike Pence, Louisiana Gov. Bobby Jindal, South Carolina Gov. Nikki Haley and Wisconsin Gov. Scott Walker have all since expressed support for Astorino.

This follows several other thinly veiled slights in recent months. Just last week Louisiana Gov. Bobby Jindal implicitly criticized Christie’s habit of picking and choosing issues to engage on, saying the GOP must offer ideas not style. “The next big elections can’t be ones about personalities or just about slogans,” he told TIME, after a question about Christie. After Christie became ensnared in a scandal over lane closures on the George Washington Bridge, Jindal had told reporters, “No one governor’s more important than the other.” In February, Scott Walker used Christie’s scandal to sidestep questions about an investigation into improper political activities by his former aides. “He addressed it early on, but obviously he’s not out of the woods yet,” Walker told TIME, saying unlike his, Christie’s troubles were “just beginning.” And when Christie was nearly down-for-the-count in the immediate aftermath of the bridge scandal, Perry fanned the flames. “Is a conservative in New Jersey a conservative in the rest of the country?” Perry asked in February on ABC’s This Week.

As the Republican Party looks to its governors for leadership after years of chaos and infighting in Washington, Christie is no longer a cut above the rest, even as he travels the country as the official leader of Republican governors. Christie is routinely on the road meeting donors and reporters, and by the nature of the job working to defend the 20 Republican-held governorships up for re-election this year. Christie allies said the group was close, despite occasional disagreements. “First and foremost, they’re friends, so they want to be able to help each other,” says RGA Executive Director Phil Cox. Like any club, behind the pretense there are tense personal relationships, but the stakes are unusually high. Perry, Walker, and Jindal are just some of the governors competing in 2016’s proto-primary alongside John Kasich of Ohio, and Mike Pence of Indiana.

The Jindal-Christie relationship is the most fraught, stemming from a bitter leadership battle for the high-profile helm of the RGA in 2012. Christie won out, securing enough votes to force Jindal to accept the number two spot. And with Perry, Christie’s conversations frequently could not be described as civil, people familiar with the exchanges said. With Christie’s fortunes soured, his opponents hurriedly planned trips to New York to meet with the donor class he once seemed to have a lock on. Jindal and Perry have been there as much as twice a month since the beginning of the year, while Walker has made at least four trips as he raises money for his own re-election. Meanwhile, top donors are once again clamoring for former Florida Gov. Jeb Bush to enter the race.

“It’s like your fiancé cheated on you,” said a person close to one of the ambitious governors, explaining why no other governor has yet emerged as a new favorite. “You don’t propose to the next girl you meet. You take your time to have some fun and meet everyone else.” Meanwhile many of the governors Christie is working to re-elect have tried to place some distance between themselves and Christie, with fewer joint events open to reporters. The calls from New York financiers for Christie to run have become less frequent as they take stock of the field. Christie’s core argument to his party and Wall Street has been his electability, and he is still struggling to show he can win despite the setbacks. More importantly to donors, the question is whether he has learned from the experience. “He’s still surrounded by the same guys,” said one top Republican bundler who was previously committed to Christie. “Where’s the growth? I’m not seeing it yet.”

But it is Christie’s economic record that is emerging as a concrete boot to his likely campaign. His state’s finances are in shambles, with Christie forced to rollback a signature effort to begin paying down the state’s skyrocketing unfunded pension liabilities after overestimating state revenues by nearly $1 billion for each of the next two years. Christie’s state lags most of his GOP colleagues on annual rankings of the best state to do business, while its unemployment rate puts New Jersey in the bottom third of states. Where Christie talks up the successes of all GOP governors, Perry and Jindal travel the country referring to the governors as “competitors” for jobs, not-so-subtly highlighting their states’ relative successes.

The bridge scandal has also revealed the insularity of Christie’s team, centered around strategist Mike DuHaime and former law partner and political fixer Bill Palatucci. The former Giuliani for President campaign manager and Republican National Committee member, are the hard-charging pair behind the harder-charging would-be-candidate. Todd Christie, the governor’s brother, rounds out the inner circle that once included Bill Stepien, his former campaign manager who was poised to take on a role with the RGA and was forced to resign in the wake of his involvement in the bridge scandal.

Where Jindal, Perry and Walker all maintain national and grassroots donor lists thanks to political action committees, Christie’s political network is largely confined to New Jersey outside of his appeal to large donors. “He’ll start out at a disadvantage,” said on GOP digital operative familiar with the potential candidates’ operations.

At the Law Vegas gathering of Republican Jewish donors in March, Scott Walker tried to steal some of Chris Christie’s thunder. He sonorously told of lighting a “menorah candle” around Hanukah and that his son Matthew’s name is derived from the Hebrew for ‘Gift from God.’ Walker sidestepped his lack of foreign policy experience by telling of Ronald Reagan’s showdown with air traffic controllers that “sent a message around the world,” and highlighted his ability to win over Latino voters around Milwaukee. Each of these anecdotes were staples of Christie’s now-familiar pitch to donors and party activists.

Thankfully for Christie, he’s still the more dynamic speaker. Following 45 minutes after Walker, Christie told the same stories—but this time, the crowd was brought to their feet for applause.

Correction: The story has been changed to properly describe the people who had characterized the New York event as a “Major Speech on Israel and the Middle East.” They were event organizers.