JoshuaZ comments on How many people here agree with Holden? [Actually, who agrees with Holden?] - Less Wrong

4 Post author: private_messaging 14 May 2012 11:44AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (105)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaZ 14 May 2012 05:21:19PM *  2 points [-]

Eliezer had decided that AIXI isn't a serious threat, so in that time his views seem essentially to have changed. See this conversation. The point about designing something similar to AIXI does seem to be valid though.

Comment author: private_messaging 14 May 2012 06:48:35PM 3 points [-]

Ahh, okay. I was about to try to write for Holden at least a sketch of a proof based on symmetry, that AIXI is benign.

In any case, if AIXI is benign, that constitutes an example of a benign system that can be used as an incredibly powerful tool, and is not too scary when made into an agent. Whenever we call something generally intelligent if it opts to drop anvil on it's head, that's matter of semantics.