"Don't be that stupid d----- that loses the love of your life forever. Like me..." Carter tweeted Wednesday. "I'll spend the rest of my life trying to better myself to get back to her. I don't care what ANY of you think."

Carter admitted the woman he was referencing was Duff when asked directly by a fan. The admission comes less than two months ater news broke that Duff had split from husband Mike Comrie, with whom she has a 23-month-old son, Luca.