That was after the fact. Yes everyone wanted to fight Delahoya but in hindsight, Margarito scared a lot of people Floyd included. Floyd wanted an easy opponent with less risk so he took on Baldomir but he could taken Margarito because the offer there and Margarito has been calling him out. And after he is done with Margarito, Floyd could have fought Delahoya after the
Mayorga fight. You can call Floyd a smart businessmen for choosing Baldomir instead of Margarito to get to DelaHoya but do not complain if people call him COWARD for avoiding Margarito. Let me put it this way Margarito would look better for Floyd resume instead of Baldomir especially for boxing fans because that was most people wanted to see.

Even if there wasn't a split between Floyd and Arum/Top Rank, Floyd was going to fight Baldomir anyway since Zab f'd up...if he (Judah) did not, Floyd might have had one more big fight before the Oscar clash...