Zeldin officially kicked off his campaign to unseat Rep. Tim Bishop (D-Southampton) on Thursday. Earlier, former Gov. George Pataki (backing rival House candidate George Demos) said Zeldin should stay in the Senate to help the GOP retain its share of power there, especially with Fuschillo's seat now in play.

Some other Republicans expressed similar thoughts. But Zeldin says it's full speed ahead. "Volunteering, endorsements, raising money -- everything is going in the direction we want," he said.

Get The 1600 newsletter

Get our inside look at the White House and goings on in the Donald Trump administration.