How to prevent notification to external email address that sent in the mail

I have set up a custom field to log all external email addresses to be notified. But how do you prevent the system of sending an update notification to the mail address that sent in the comment on a query.