Hangouts Contacts

Hi. When I go to send a new message in Hangouts, it brings up a screen where it shows "People You Hangout With." Here it shows 5 of my friends who apparently use Google Talk or Hangout or whatever.

I only use Hangouts for SMS so I went on Google + and unfriended all of my friends in hopes that no one would show up as a Hangout option. These 5 friends still however show up. Is there anyway to get rid of this?