So8res comments on New paper from MIRI: "Toward idealized decision theory" - Less Wrong

27 Post author: So8res 16 December 2014 10:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: So8res 21 December 2014 01:46:47AM 2 points [-]

Then you get spurious proofs of inconsistency :-)

(If PA is strong enough to prove what the agent will do, then PA + "A()=x" is only consistent for one particular action x, and the specific action x for which it is consistent will be up for grabs, depending upon which proof the inconsistency checker finds.)

Comment author: Skeptityke 21 December 2014 02:02:40AM 1 point [-]

Got it. Thank you!