Scott Brown may be showing up in New Hampshire and speaking to Republican groups, but he is not amassing a serious campaign, New Hampshire activists say.

He does not appear to be calling political activists to drum up support or hiring local staff. The flirtation with the state irks some New Hampshire Republicans, who say it is time for Brown to decide whether he plans to mount a U.S. Senate run from the Granite State.

“At some point, it’s been now a number of months, you’ve got to put up or shut up,” said Jim Merrill, a political consultant for The Bernstein Shur Group who was a top adviser to the New Hampshire presidential campaigns of Republicans Mitt Romney and President George W. Bush. “I think it’s time for him to look in the mirror and decide what he wants to do here.”

Since losing his U.S. Senate seat to Democrat Elizabeth Warren in 2012, Brown has kept his name in the headlines, refusing to rule out runs for U.S. Senate from Massachusetts or New Hampshire or even for U.S. president. He visited New Hampshire five times in five weeks back in April and May and has since been back to compete in a triathlon, perform with the band Cheap Trick, attend a fundraiser for a state representative and, this week, speak at a Hampstead Republican town committee event.

However, several of New Hampshire’s top Republican political activists told The Republican/MassLive.com that Brown does not appear to be working behind the scenes to organize a campaign to challenge U.S. Sen. Jeanne Shaheen, a New Hampshire Democrat up for reelection in 2014.

“I don’t think he’s been making calls to the 25 people that somebody who’s exploring a statewide bid ought to be calling,” said Fergus Cullen, a former New Hampshire Republican Party chairman.

Jamie Burnett, a partner at the political consulting firm Profile Strategy Group, who worked for Romney in New Hampshire and for former New Hampshire Republican U.S. Senators John E. Sununu and Judd Gregg, said he has seen no signs of a Brown organization.

Former U.S. Sen. Scott Brown of Massachusetts watches a traditional drum ritual of the Pequot tribe during the 11th Annual "Keeping the Dream Alive" dinner commemorating the anniversary of Martin Luther King Jr.'s death on April 4, 2013 in Nashua, N.H. Declaring that he's likely not done with politics, Brown has refused to rule out a run for office in New Hampshire, while describing the Granite State as "almost a second home." (AP Photo/The Telegraph, Will Wrobel)

“I haven’t detected any signs of him trying to organize the state or even trying to recruit the ‘grasstops’ support that you’d want to line up if you’re going to run for Senate,” Burnett said.

In some ways, New Hampshire could be an appealing state for Brown. New Hampshire, more than Massachusetts, has a history of electing Republicans, particularly moderate Republicans. Brown has a summer home in Rye, N.H., where he has vacationed for years. The only confirmed Republican challenging Shaheen in 2014 is former state senator Jim Rubens, who is not well-known statewide, though the race will heat up significantly should former Republican Congressman Charlie Bass get in. Bass, who is said to be considering a run, did not return a phone call.

At the same time, Shaheen, a former New Hampshire governor, is popular, with approval ratings between 50 and 60 percent. Brown would have to counter the notion that he is a carpetbagger. “It’s not easy for anyone to uproot from Massachusetts, plop down in New Hampshire, say I’m here, I’m going to run and represent your state,” Burnett said. “Shaheen has served in the state a very long time.”

Tom Rath, a long-time political strategist who ran campaigns for Gregg and former Republican U.S. Sen. Warren Rudman and was a top adviser to five Republican presidential campaigns in New Hampshire, said Brown has the credibility and fundraising prowess to get into the race quickly. “But I see no evidence that’s going on,” Rath said.

Rath with no other big names in the Republican field yet, Brown likely sees no need to make a decision. “It’s an easy posture for him to be in right now,” Rath said. “I think he probably doesn’t see any need to go any further than where he is.”

However, that stance has bothered some Republicans. Both Shaheen and the New Hampshire Democratic Party have been using Brown’s visits to fundraise. Democratic Party spokesman Harrell Kirstein said a party fundraising email, sent in April after Brown first said he was thinking of running in New Hampshire, was “one of the most successful” fundraising emails the party has ever sent. Kirstein would not provide a dollar figure.

The conservative-leaning editorial board of the Union Leader, a statewide newspaper, wrote, “The ladies love his flirting, it is true, but the one who loves it the most is Jeanne Shaheen. Every time he bats an eye, she cashes a check.”

Merrill said Brown is also drawing attention away from other potential candidates. “As long as activists and donors here in New Hampshire and nationally think there’s a possibility Scott Brown may run, they may keep their powder dry,” Merrill said. “The longer that happens, the longer we go before we can contrast with Sen. Shaheen and draw the distinctions we need to to win the race.”

Cullen worries that Brown may be hurting his reputation by attending so many events, including ones that are not high-profile. “It sounds like he’ll accept your invitation so long as you’ve got rubber chicken on the menu,” Cullen said. “As a politician, you want to create this image that you’re hard to get, and Scott Brown seems to be creating this image of the opposite. If you invite him, he’ll come.”

Brown told the Union Leader on Tuesday that running against Shaheen “is not my priority,” and most activists say they see Brown’s visits as simply a flirtation. “Having never spoken to him, I don’t know for sure, but my gut tells me at the end of the day he does not run for office in New Hampshire,” Burnett said. “I don’t see that happening.”