X-Message-Number: 30194
From:
Date: Fri, 21 Dec 2007 18:45:44 EST
Subject: Re: CryoNet #30177 - #30186
In a message dated 12/21/2007 3:16:52 AM Mountain Standard Time,
writes:
[Henson]:
Robert, I am not even sure that will do it. "Minimize human misery"
is explicit and unambiguous. A machine without social motives might
rationally conclude that killing the entire population of humans was
the most effective way to reach the goal. "Maximize human happiness"
could be equally lethal.
Jack Williamson's "The Humanoids" is a fine dystopian story in which a
powerful AI charged to "Protect" humans becomes a patronizing monster that won't
allow you to do anything that might be "harmful". A good read, from around
1950.
Because of a thousand such science fiction stories stretching over nearly a
century, it is unlikely that an AI will be given physical power or contact
with the outside world through the Net.
Alan
**************************************See AOL's top rated recipes
(http://food.aol.com/top-rated-recipes?NCID=aoltop00030000000004)
Content-Type: text/html; charset="US-ASCII"
[ AUTOMATICALLY SKIPPING HTML ENCODING! ]
Rate This Message: http://www.cryonet.org/cgi-bin/rate.cgi?msg=30194