The simplest solution is to leave yourself a new voicemail. Then access your voicemail box and delete the message you left and any other messages remaining in your mailboxand it will remove the notification.

If that does not work, perform the following steps:

Go to Settings > Applications > Phone (All tab) >

Select Clear Data

Power your Galaxy S6 Off, wait 10 seconds then turn it back on and it should be gone!