When looking at the problem manually, the mail was being rejected with the "421 Unexpected failure" message on "RCPT TO:". It wasn't related to dilys -- that was just the first address in the recipient list.