JulianMorrison comments on Points of Departure - Less Wrong

14 Post author: Eliezer_Yudkowsky 09 September 2008 09:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (36)

Sort By: Old

You are viewing a single comment's thread.

Comment author: JulianMorrison 10 September 2008 08:09:37PM -1 points [-]

It seems to me that screenwriters are missing a trick. That is, a more real-ish AI would actually be a better villain. To a human, an unFriendly but only slightly superhuman AI would feel... evil. Amoral, manipulative, a liar, a backstabber, a blackmailer, an offerer of devil's bargains, a plotter of deeply laid plots, willing to sink to any cruelty for purely instrumental aims. Congenial, many-faced, hypocritical, completely untrustworthy by friend and foe alike. Of course the AI would see it as "playing humans like chess", but it's not going to say so. At least, not unless it's using that fear to manipulate someone, too.