The X Factor winner James Arthur, who has made no secret of his insecurities about his appearance, was offended when Frankie Boyle blasted him on Twitter, and now he says he won't put up with any more.

Frankie, 40, had tweeted: "James Arthur is like a cross between a tramp and a duckling." The comedian has shown no remorse following the unprovoked remark.

Not one to take it lightly, James retaliated by calling Frankie a "t**t".

Despite the feud being months behind the pair, James is still bruised from the comments made by Boyle and is adamant he won't back down.

According to the Sun newspaper, the northern lad, who is currently busy preparing for the X Factor tour, said: "I shouldn't have risen to it, to be honest. But he was taking the piss out of us so much and you have to stick up for yourself."

Then the usually calm James added that due to his 'street-fighting' past he can handle the comedian.

The 24-year-old said, "We may shake hands when we meet - either that or I'll give him a backhander. I used to be a street fighter." Ouch...