You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

hairyfigment comments on "Stupid" questions thread - Less Wrong Discussion

40 Post author: gothgirl420666 13 July 2013 02:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (850)

You are viewing a single comment's thread. Show more comments above.

Comment author: hairyfigment 15 July 2013 08:38:56PM -1 points [-]
  1. I meant that by going meta we might not have to solve them fully.

  2. All the problems you list sound nearly identical to me. In particular, "what matters to humans" sounds more vague but just as meta. If it includes enough details to actually reassure me, you could just tell the AI, "Do that." Presumably what matters to us would include 'the ability to affect our environment, eg by giving orders.' What do you mean by "very powerful but insane"? I want to parse that as 'intelligent in the sense of having accurate models that allow it to shape the future, but not programmed to do what matters to humans.'

Comment author: ikrase 16 July 2013 07:51:48AM 0 points [-]

"very powerful but insane" : AI's response to orders seem to make less than no sense, yet AI is still able to do damage. "What matters to humans": Things like the Outcome Pump example, where any child would know that not dying is supposed to be part of "out of the building", but not including the problems that we are bad at solving, such as fun theory and the like.