Campaigners expressed delight that the couple had taken advantage of Britain’s newly-introduced gay marriage laws and urged bishops to “bless” their partnership. They predict he will be the first of many gay clergy to marry.

But a leading member of the Church’s conservative evangelical wing called for “discipline” of any clergy seen to be breaking the rules. He warned of a “crisis” if the leadership failed to take action.

Earlier this year an acrimonious row broke out within the Church after the House of Bishops decided to ban gay clergy from marryingwhen same-sex marriage became legal last month. The decision, which means that anyone defying the ban could face lengthy disciplinary measures, was welcomed by traditionalists but infuriated liberals and campaigners for gay rights.

Although the Church of England formally objected to the introduction of gay marriage and has opted out of performing the ceremonies, there have been growing signs of a more relaxed stance on homosexuality. Bishops agreed that gay couples who get married will be able to ask for special prayers after the ceremony.

However, on Saturday night the Rev Preb Rod Thomas, chairman of the Reform evangelical group, said: “There’s no doubt that there is pressure within some parts of the church for the Church to change its mind on sexuality.

“If there is not clear discipline then it is the equivalent to saying 'we really didn’t mean what we said.’ It will precipitate a crisis.”

He warned that traditionalists “who stick by the biblical understanding” of marriage would be unable to accept a “messy compromise”, potentially leading to a situation similar to in the US where a traditionalist splinter Church has emerged from the liberal Episcopal Church.

However, the Rev Colin Coward, a friend of Canon Pemberton’s and director of the Changing Attitude campaign group, of which he is a former trustee, said: “I’m really, really happy for Jeremy and his partner that they are finally able to get married after a long time of being together as a couple.

“I hope the bishops find a way to affirm and bless their relationship rather than taking action against them.”

Dr Giles Fraser, the former canon chancellor of St Paul’s, also congratulated the couple.

The Bishop of Lincoln, the Rt Rev Christopher Lowson, said: “I am aware that a member of the clergy who works in the Diocese of Lincoln has married a partner of the same sex. The priest concerned wrote to me in advance to explain his intention and we had a subsequent meeting in which I explained the guidelines of the House of Bishops.”