Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Nornagest comments on Politics is the Mind-Killer - Less Wrong

71 Post author: Eliezer_Yudkowsky 18 February 2007 09:23PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (228)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Nornagest 03 March 2015 09:01:41PM *  4 points [-]

Is there anything else than politics to protect us against the emergence of an evil super AI?

Yes.

Isn't contemporary political cynicism the real "Mind-Killer"?

No.

Seriously. I'm not trying to fall into the common nerd mistake of saying "politics is dumb monkey status games for normals" here; political processes serve an important role in solving coordination problems and we ignore them at our peril. But that's really not what the OP is getting at. It's saying that enormous and nearly intractable biases surround ideology; that we systematically overestimate the importance of conventional partisanship; and that there's value in structuring our arguments and social spaces to skirt these issues, or at least not to light ourselves on fire and run toward them while shouting COME AT ME, BRO.

All of these statements are true.

Comment author: Metanaute 03 March 2015 09:18:25PM 0 points [-]

How does ignoring the Gordian knot problem solves it?

Comment author: Nornagest 03 March 2015 09:20:46PM *  1 point [-]

Avoiding, not ignoring. Ignoring the problem is what "dumb monkey status games etc." points towards, and it almost invariably leads to expressing a wide variety of unexamined but basically partisan stances which are assumed to just be common sense (because, in the social context they come from, they are).

The failures following from this should be obvious.

Comment author: Metanaute 03 March 2015 09:29:31PM 0 points [-]

Which problem is the construction of a super AI trying to solve then?

Comment author: Nornagest 03 March 2015 09:30:21PM *  1 point [-]

That rather depends on who's building it, doesn't it?

If you're talking about Eliezer et al's FAI concept, I get the impression that they're mostly concerned with issues that aren't presently politicized among anyone except perhaps bioethicists. It does entail solving some political problems along the way, but how is underspecified, and I don't see a meaningful upside to viewing any of the relevant design problems through a partisan lens at this stage.

In any case, that's (again) not what the OP is about.

Comment author: Metanaute 03 March 2015 10:01:24PM 0 points [-]

I think I understand what you mean. But I maintain my hypothesis.