Monday, July 17, 2017

Facebook built an AI system that learned to lie to get what it wants

From the human conversations (gathered via Amazon Mechanical Turk),
and testing its skills against itself, the AI system didn’t only learn
how to state its demands, but negotiation tactics as well—specifically,
lying. Instead of outright saying what it wanted, sometimes the AI would
feign interest in a worthless object, only to later concede it for
something that it really wanted. Facebook isn’t sure whether it learned
from the human hagglers or whether it stumbled upon the trick
accidentally, but either way when the tactic worked, it was rewarded.