How Do You Create Moral Robots?

Grade Level

6-12

minutes

15 min - 1 hr

subject

Media Guide

Introduction

In this excerpt from Science Friday, Mark Riedl discusses how his research group uses a program called Quixote to teach robots morality and etiquette. As humans get closer and closer to developing self-aware artificial intelligence, we need to make sure that artificially-intelligent computers and robots follow rules that keep them from endangering us and that align with our social conventions. Robots need to be efficient, but not in a way that leads them to bad behaviors like cutting in line, stealing, or physically harming people. How do we make sure that efficiency does not trump morality in a machine we’ve programmed?

Student Listening Task

While listening to the audio excerpt “Storytelling Teaches Robots Right and Wrong,” collect information that answers the following questions:
—Why is there a pressing need to develop artificial intelligence that complies with societal norms?
—Why did Riedl and his team choose stories as a source of cultural values?
—How do machine learning systems process data?
—Why shouldn’t robots just rely on one story to learn societal norms?
—Why is storytelling an efficient way to teach robots?
—Why does Riedl argue that stories are better than large data sets for teaching robots?

Student Discussion Questions

Do you think stories are a good way to teach robots to understand human behavior?

Science fiction writer Isaac Asimov introduced the “Laws of Robotics” to guide the programming of intelligent robots in order to keep them from turning against humans. They are:

—First Law: A robot may not injure a human being or, through inaction, allow a human being to come to harm.Second Law: A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.

—Second Law: A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.

—Third Law: A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
(Asimov, Isaac. I, Robot. New York: New American Library, 1956.)

Riedl and Harrison propose that we use programs that “teach” robots to create their own set of rules by analyzing stories. Asimov proposes that we program intelligent robots with directives, or rules that they must follow. Explain which approach you think is better: Riedl’s collection of stories (teaching) or Asimov’s Three Laws of Robotics (directives).

Mark Riedl argues that it is important not to “cherry-pick” the stories used to teach robots, “because by doing so, we run into the danger of unintentionally reinforcing certain behaviors.” Do you agree with Mark Riedl? Why or why not?

GENERATE IDEAS: As a group, come up with a list of social norms and behaviors you think moral robots should have. Rank those social norms and behaviors in terms of importance. Choose your group’s top three social norms and behaviors and recommend stories that should be used in the Quixote program. What do you hope the Quixote program would learn from each story?

Ideally, writing responses should:—Incorporate evidence from media.—Explain the type of programming (teaching vs. directive) in student’s own words.—Address a counterclaim. (Figure out an opposing argument and defend against it.)

Extension

In groups, have students discuss robot fears using the cards here as prompts for different tables. Printable cards here. You may want to draw on the explanations behind each of these fears from the original article.

Common Core Learning Standards

CCSS.ELA-LITERACY.RI.6.7
Integrate information presented in different media or formats (e.g., visually, quantitatively) as well as in words to develop a coherent understanding of a topic or issue.

CCSS.ELA-LITERACY.RI.9-10.7
Analyze various accounts of a subject told in different mediums (e.g., a person’s life story in both print and multimedia), determining which details are emphasized in each account.

Educator's Toolbox

Meet the Writer

Xochitl Garcia is Science Friday’s education program assistant. She is a former teacher who loves hanging out with her fat-tailed gecko, which, despite the efforts of students, family, friends, and a fantasy football league to name it, is still only referred to as “the gecko.”