orthonormal comments on Decision Theories: A Semi-Formal Analysis, Part II - Less Wrong

16 Post author: orthonormal 06 April 2012 06:59PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

You are viewing a single comment's thread. Show more comments above.

Comment author: orthonormal 07 April 2012 03:40:03PM 1 point [-]

Who said anything about sentience? NDT, as described, is a perfectly comprehensible program that (in certain games that you or I would regard as fair tests) generates spurious counterfactuals and thus makes terrible decisions, thanks to a particular kind of circularity.

In this sequence, I'm not talking about FAI or anything beyond my current understanding, and I'm not intentionally drawing metaphors. I'm simply outlining programs which (if I could write a good automated theorem-prover) I could write myself, and comparing how they do in a straightforward tournament setting, with the twist of allowing read-access to source codes. We should be able to agree on that base level.

Comment author: Dmytry 07 April 2012 04:14:52PM *  1 point [-]

Yea, NDT is no good, agreed about that. That doesn't so much results from substitution as from full blown two way equivalence.