If you wanted to be sure you were updating you might try exporting the group or piece of audience you're looking to update first, make the changes in the exported spreadsheet, and reimport (selecting add & update).

Because this would be a direct export from your audience you could ensure that all of the contacts being 'imported' are existing already.

I hope this helps and feel free to take a look at our documentation on exporting below: