You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

XiXiDu comments on AI-Box Experiment - The Acausal Trade Argument - Less Wrong Discussion

9 Post author: XiXiDu 08 July 2011 09:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread. Show more comments above.

Comment author: XiXiDu 09 July 2011 09:21:20AM *  1 point [-]

Why do you need to invoke acausal trade if your selling point is "I've proven that I can pre-commit to some arbitrary X"?

I don't think Eliezer would argue that the AI is going to turn itself "friendly", that would amount to suicide and therefore wouldn't be instrumental. But you are right, I don't think the experiment makes much sense. I just tried to pick the most convincing argument that might still be considered a realistic possibility given my best guess about the mindset and framework of beliefs of the people involved in the "experiment".