ArisKatsaris comments on Consequentialism Need Not Be Nearsighted - Less Wrong

53 Post author: orthonormal 02 September 2011 07:37AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (118)

You are viewing a single comment's thread. Show more comments above.

Comment author: ArisKatsaris 03 September 2011 06:42:47PM 1 point [-]

Having an intention to trick those you can trick can itself be a bad idea (for some categories of trickable opponents that respond to your having this intention).

Yes, it can be a bad idea -- I'm just saying TDT doesn't say it's always a bad idea.

Comment author: Vladimir_Nesov 03 September 2011 06:53:28PM 0 points [-]

(DefectBot is sufficient to demostrate it's not always a bad idea to defect. In other cases, it can be much more subtle.)

Comment author: Vladimir_Nesov 03 September 2011 06:49:02PM *  0 points [-]

TDT can't reason about such things, it gets its causal graphs by magic, and this reasoning involves details of construction of the causal graphs (it can still make the right decisions, provided the magic comes through). UDT is closer to the mark, but we don't have a good picture of how that works. See in particular this thought experiment.