eli_sennesh comments on New paper from MIRI: "Toward idealized decision theory" - LessWrong

27 Post author: So8res 16 December 2014 10:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 17 December 2014 12:55:19PM 1 point [-]

A proper solution to this problem would be an optimal decision theory. Consider the decision itself as a random variable, then take some epistemic model of the world and infer, from a third-person point of view, what an optimal agent with certain knowledge and preferences should have done. Then output that decision.

Comment author: shminux 17 December 2014 05:28:03PM 1 point [-]

I am not talking about optimal at all. Just being able to forensically detect any sign of agency rather than... what?