whpearson comments on The mathematics of reduced impact: help needed - Less Wrong

10 Post author: Stuart_Armstrong 16 February 2012 02:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (94)

You are viewing a single comment's thread. Show more comments above.

Comment author: whpearson 22 February 2012 10:39:58AM *  0 points [-]

My formulation of minimising difference is something like the folllowing:

  • Assume A is the answer given by the oracle
  • Predict what would happen to the world if the AI was replaced by a program that consisted of a billion NOPs and then something that output: A . Call this W1
  • When assessing different strategies predict what would happen in the world given that strategy call this W2.
  • Minimise the difference between W1 and W2

Is this a more succinct formulation or is it missing something?