private_messaging comments on Have you changed your mind lately? On what? - Less Wrong

25 Post author: Emile 04 June 2012 07:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (105)

You are viewing a single comment's thread.

Comment author: private_messaging 06 June 2012 10:34:57AM *  5 points [-]

Changed my mind from lack of particular opinion on SI to SI being complete cranks. Changed my mind from opinion that AIs may be dangerous, to much lower estimate of potential danger. (I have post history on Dmytry account to prove changing mind).

Comment author: jsalvatier 06 June 2012 03:39:15PM 0 points [-]

What changed your mind on the latter?

Comment author: private_messaging 07 June 2012 08:47:10AM *  1 point [-]

When I seen circulating notion of serious AI danger, without details, I guess I assumed it originated from better/more relevant arguments.

What I see instead is arguments of general difficulty of some aspects of AI (such as real world motivation) crafted as to suggest update of unlikelihood of only "friendly AI that genuinely cares about mankind" but not the general unlikelihood of real world motivation on AI, because the one making the arguments tells you that you should update the former but doesn't tell about the latter.

This is combined with some theoretical notion of "rationality" that would work for updates on a complete inference graph, but which is about as rational on an incomplete inference graph such as the one above, as it is true that due to law of inertia after walking off the top of 10 story building, you'll just keep on walking.