“I think he is entitled to have a view on whether the burqa should be banned or not and as it happens I agree with him that it wouldn’t be banned.

“That would be a ban against items of religious clothing which I do not think is something that a free society does.

“Viewing it as a catholic, catholic items were banned in this country historically and it tends to be done by an oppressive state rather than by a free country.

“Suggesting that a burqa is not the most elegant form of clothing is a reasonable thing to do. Boris was saying he didn’t think it was an elegant form of dress but he wouldn’t ban it.

“If you view it in that context the row looks pretty synthetic and looks like there are people who do not like Boris and want to have a pop at him.”

Nigel Farage said there will be some people who were offended by Boris Johnson’s comments and asked: “Is it right within the limits of free speech to say things that cause offence to other people.”

Mr Rees-Mogg said: “Oh yes of course it is, you can’t have any public debate if every time somebody decides to be offended by something you shut it down and say you are not allowed to say that.

“This is where all the safe spaces nonsense comes from.

“You have to have a vigorous debate within the confines of the normal law, you can’t incite violence or do things of that kind but to say things that other people disagree with is how political debate needs to be conducted.”

The Environment Secretary said new opportunities outside the CFP will benefit the environment and coastal communities, and give a much-needed boost to the trawlermen.

He insisted freedom from EU rules would improve sustainability by enabling the Government to safeguard stocks for future generations by imposing controls on who fishes in UK waters and the methods they use.

Writing in The Times ahead of the release of a White Paper outlining his vision of Britain’s post-Brexit fishing industry Mr Gove said: “You’d be hard pressed to find anyone who cares about our seas, or depends on them economically, who has a good word say about the CFP.

“During the time that we’ve been in the EU our fishing industry has suffered, stocks have become depleted and a precious natural resource has been mismanaged.

“There have been reforms along the way which have mitigated some of that damage but the fact remains that the CFP hasn’t worked in our, or nature’s, best interests.”

Mr Gove complained Britain had been given an unfair share the fish in its waters which had a huge impact on fishing communities from Shetland to Cornwall.

He said: “Once thriving businesses have closed, families have lost their livelihoods, communities have been hollowed out. I’ve seen it up close and personal.

"For a maritime nation this loss has been much more than economic. It’s been soul-deep.

“What’s made it worse, is that the management of our seas under the common fisheries policy wasn’t driven by the highest environmental imperatives.

“And it hasn’t kept pace with our developing understanding of best practice in marine conservation.”

Mr Gove said after Brexit Britain would manage access to its waters by bringing in smarter controls to protect the marine environment.

He said he wanted the UK to build on the progress made by other independent coastal states such as Iceland and New Zealand which have both introduced successful fisheries policies.

He said: “The White Paper we’re launching today is another - very significant - part of that work.

“It demonstrates how Britain, outside the EU, can set a global gold standard for sustainable management of our seas.

“And it offers a brighter future to communities who deserve to know that we are on their side.”