Solution

This issue occurs when a message is permanently deleted in Outlook, or the Deleted Items folder is cleared which previously contained the attachment. Delve indexes items from Outlook but after a message that has an attachment is permanently deleted, it takes some time for it to be removed from Delve.