Dahlen comments on 'Dumb' AI observes and manipulates controllers - Less Wrong

33 Post author: Stuart_Armstrong 13 January 2015 01:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (19)

You are viewing a single comment's thread. Show more comments above.

Comment author: Dahlen 14 January 2015 09:55:16PM 2 points [-]

Yeah, me too.

Perhaps change the "observes", "manipulates" to "observing", "manipulating"? It doesn't have the same connotation of "this actually happened".

Also, had it been a real occurrence, it might have been the first thing to make me care just a little about MIRI's mission.

Comment author: Stuart_Armstrong 14 January 2015 10:08:18PM 2 points [-]

Well, FaceBook and Google algorithms are real occurrences - they're just not "simple algorithms in a box".

Comment author: Gunnar_Zarncke 15 January 2015 10:27:00PM *  3 points [-]

These 'dumb' algorithms probably have a much higher impact than one might guess. It's just a much more subtle but extremely far reaching effect. Complete surfing habits change. Industries rise and fall due to it. It is operating on a longer time-frame and without spectacular events. It smears out it's effect. If it is intentional this is called salami tactics, long lie and other things. We are not well prepared to deal with or even detect this rationally because we feel the effect only via its aggregate over lots of events. Things our subconscious long term feeling notices but can only propagate to the concsious via vague feelings of dissatisfaction, frustration and other. But there is no specific 'enemy' that can be hit. The effect looks more like an inevitable force of nature than a conscious act of an agent. Even if it should be so. Fear the dumb but massively parallel AI.

Comment author: Dahlen 14 January 2015 10:31:34PM 1 point [-]

Perhaps. But whatever news I've heard about social network AI didn't pass the threshold for my caring about it. A hypothetical story with the above title would have. As far as I'm concerned Facebook/Google AI discussion lies outside of the scope of my comment.