hairyfigment comments on The genie knows, but doesn't care - Less Wrong

54 Post author: RobbBB 06 September 2013 06:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (515)

You are viewing a single comment's thread. Show more comments above.

Comment author: hairyfigment 11 September 2013 05:40:08PM 0 points [-]

Yeah, I can think of two general ways to interpret this:

  • In a variant of CEV, the AI uses our utterances as evidence for what we would have told it if we thought more quickly etc. No single utterance carries much risk because the AI will collect lots of evidence and this will likely correct any misleading effects.

  • Having successfully translated the quoted instruction into formal code, we add another possible point of failure.