You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

cousin_it comments on Kevin Drum's Article about AI and Technology - Less Wrong Discussion

19 Post author: knb 15 May 2013 07:38AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread.

Comment author: cousin_it 15 May 2013 09:12:23PM *  6 points [-]

When the robot revolution happens, we need to have many supporters of efficient charity among the ruling class, at least while the ruling class still consists of humans.

Comment author: Multiheaded 15 May 2013 10:10:21PM *  10 points [-]

When the robot revolution happens, we need to have many supporters of efficient charity among the ruling class

The problem is much worse. All the ethical sophistication in the world (as argued by e.g. Richard Rorty) can not in practice serve as a barrier to cruelty and domination if there's no underlying moral sentiment of empathy, of sharing a certain "human circle" with your fellow beings.

The ruling class needs to share some moral emotions that would allow preference-utilitarian/negative-utilitarian ethics towards the "worthless" poor in the first place. Otherwise they might simply decide that the "efficiency" in "efficient charity" is best achieved by enslaving the former working class or lumping it with domestic animals... for the proles' own safety/virtue/moral benefit/etc, of course. They're dirty and uncouth! they would revert to "savagery" without proper control! they have no use for the liberties that the superior man enjoys! empathizing with them as equals is simply an intellectual mistake and naive sentimentality! ...Basically, see every rationalization for slavery ever made; when slavery cannot be opposed by force or starved economically, those aspiring to become the new "aristocracy" could grow very enamored of such rationalizations again.

I can hardly even begin describing my fears of how the new technocratic/quasi-aristocratic elite might conduct its relations with the "common people" that have no economic or military leverage over it. This is why I am so fucking terrified about the emerging association between transhumanism and an anti-egalitarian/far-right ideology!

The Jacobin magazine has a very good article on this subject from a while ago:

The great danger posed by the automation of production, in the context of a world of hierarchy and scarce resources, is that it makes the great mass of people superfluous from the standpoint of the ruling elite. This is in contrast to capitalism, where the antagonism between capital and labor was characterized by both a clash of interests and a relationship of mutual dependence: the workers depend on capitalists as long as they don’t control the means of production themselves, while the capitalists need workers to run their factories and shops. It is as the lyrics of “Solidarity Forever” had it: “They have taken untold millions that they never toiled to earn/But without our brain and muscle not a single wheel can turn.” With the rise of the robots, the second line ceases to hold.

The existence of an impoverished, economically superfluous rabble poses a great danger to the ruling class, which will naturally fear imminent expropriation; confronted with this threat, several courses of action present themselves. The masses can be bought off with some degree of redistribution of resources, as the rich share out their wealth in the form of social welfare programs, at least if resource constraints aren’t too binding. But in addition to potentially reintroducing scarcity into the lives of the rich, this solution is liable to lead to an ever-rising tide of demands on the part of the masses, thus raising the specter of expropriation once again. This is essentially what happened at the high tide of the welfare state, when bosses began to fear that both profits and control over the workplace were slipping out of their hands.

If buying off the angry mob isn’t a sustainable strategy, another option is simply to run away and hide from them. This is the trajectory of what the sociologist Bryan Turner calls “enclave society”, an order in which “governments and other agencies seek to regulate spaces and, where necessary, to immobilize flows of people, goods and services” by means of “enclosure, bureaucratic barriers, legal exclusions and registrations.” Gated communities, private islands, ghettos, prisons, terrorism paranoia, biological quarantines; together, these amount to an inverted global gulag, where the rich live in tiny islands of wealth strewn around an ocean of misery. In Tropic of Chaos, Christian Parenti makes the case that we are already constructing this new order, as climate change brings about what he calls the “catastrophic convergence” of ecological disruption, economic inequality, and state failure. The legacy of colonialism and neoliberalism is that the rich countries, along with the elites of the poorer ones, have facilitated a disintegration into anarchic violence, as various tribal and political factions fight over the diminishing bounty of damaged ecosystems. Faced with this bleak reality, many of the rich – which, in global terms, includes many workers in the rich countries as well – have resigned themselves to barricading themselves into their fortresses, to be protected by unmanned drones and private military contractors. Guard labor, which we encountered in the rentist society, reappears in an even more malevolent form, as a lucky few are employed as enforcers and protectors for the rich.

But this too, is an unstable equilibrium, for the same basic reason that buying off the masses is. So long as the immiserated hordes exist, there is the danger that it may one day become impossible to hold them at bay. Once mass labor has been rendered superfluous, a final solution lurks: the genocidal war of the rich against the poor. Many have called the recent Justin Timberlake vehicle, In Time, a Marxist film, but it is more precisely a parable of the road to exterminism. In the movie, a tiny ruling class literally lives forever in their gated enclaves due to genetic technology, while everyone else is programmed to die at 25 unless they can beg, borrow or steal more time. The only thing saving the workers is that the rich still have some need for their labor; when that need expires, so presumably will the working class itself.

Comment author: cousin_it 15 May 2013 10:30:58PM *  6 points [-]

I wonder how this bleak picture might change if we throw cheap cognitive enhancement into the mix. Especially considering Eliezer's idea that increased intelligence should make the poor folks better at cooperating with each other.

Comment author: Multiheaded 15 May 2013 10:54:48PM 4 points [-]

I wonder how this bleak picture might change if we throw cheap cognitive enhancement into the mix.

Considered it too. I just pray to VALIS that there'll be a steep enough curve of diminishing returns associated with intelligence amplification - so that even if the technocratic elite desperately wants to maintain supremacy, it can't just throw exponentially more resources at "boutique" small-scale enhancement and maintain the gap with "mass-enhanced" humans.

Comment author: NancyLebovitz 16 May 2013 12:03:53AM 4 points [-]

I suspect there are unknown unknowns in the scenario. The masses are more likely to have open source research. I think the elite is more likely to screw itself up with a bad ideology, but that might be mere wishful thinking.

Comment author: someonewrongonthenet 15 May 2013 11:22:40PM *  3 points [-]

This is why I am so fucking terrified about the emerging association between transhumanism and an anti-egalitarian/far-right ideology!

Can you provide some examples of this association?

If you're just talking about libertarians or something, my impression is that they want a reasonably egalitarian society too....they just have different economic policies for bringing it about.

Comment author: [deleted] 15 May 2013 11:49:38PM 4 points [-]

Not libertarians. Reactionaries.

authoritarian anti-egalitarians.

Comment author: someonewrongonthenet 16 May 2013 01:20:49AM 1 point [-]

I just meant that I haven't come across any examples of people who are simultaneously transhumanist and authoritarian. Where do I find these writings?

Comment author: [deleted] 16 May 2013 01:44:53AM *  6 points [-]

these guys are lesswrongers.

I am transhumanist and authoritarian.

Nick Land I think is another big example?

Comment author: someonewrongonthenet 16 May 2013 02:40:52AM *  3 points [-]

Oh...so basically the whole Dark Enlightenment school of thought?

I've only started reading this strand of thought recently, and haven't yet made the connection to authoritarianism. I get that they reject modern liberalism, democracy, and the idea that everyone has equal potential, but do they also reject the idea of meritocracy and the notion that everyone aught to have equal opportunity? Do they also believe that an elite group should have large amounts of power over the majority? And do they also believe that different people have (non-minor) differences in intrinsic value as well as ability?

EDIT thoughts after reading the sources you linked:

Perhaps an anti-egalitarian can be thought of one who does not value equality as an intrinsic moral good? Even if everyone is valued equally, the optimal solution in terms of getting the most satisfaction to everyone does not necessarily involve everyone being satisfied in roughly equal measures.

Basically, on Haidt's moral axis, the anti-egalitarians would score highly only on Harm Avoidance, and low on everything else...

...actually, come to think of it that's almost how I scored when i took it a few years ago. - 3.7 harm, 2.0 fairness, 0 on everything else.

you've given yourself the label "authoritarian". If you took Haidt's test, did you score high on authoritarianism? (just trying to pin down what exactly is meant by authoritarianism in this case)

Comment author: [deleted] 16 May 2013 04:11:14AM 1 point [-]

Can't speak for others, but here's my take:

s/they/you:

but do they also reject the idea of meritocracy and the notion that everyone aught to have equal opportunity?

I think it's more important to look at absolute opportunity than relative opportunity.

That said, in my ideal world we all grow up together as one big happy family. (with exactly the right amount of drama)

Do they also believe that an elite group should have large amounts of power over the majority?

Yes, generally. Note that everything can be cast in a negative light by (in)appropriate choice of words.

The elites need not be human, or the majority need not be human.

My ideal world has an nonhuman absolute god ruling all, a human nobility, and nonhuman servants and npc's.

And do they also believe that different people have (non-minor) differences in intrinsic value as well as ability?

Yes, people currently have major differences in moral value. This may or may not be bad, I'm not sure.

But again, I'm more concerned with people's absolute moral value, which should be higher. (and just saying "I should just value everyone more" ie "lol I'll multiply everyone's utility by 5" doesn't do anything)

Basically, on Haidt's moral axis, the anti-egalitarians would score highly only on Harm Avoidance, and low on everything else...

Dunno, you'd have to test them.

My general position on such systems is that all facets of human morality are valuable, and people throw them out/emphasize them for mostly signalling/memetic-infection reasons.

All of those axes sound really important.

you've given yourself the label "authoritarian". If you took Haidt's test, did you score high on authoritarianism? (just trying to pin down what exactly is meant by authoritarianism in this case)

Haven't taken the test. Self-describing as an "authoritarian" can only really be understood in the wider social context where authority and hierarchy have been devalued.

So a more absolute description would be that I recognize the importance of strong central coordination in doing things (empirical/instrumental), and find such organization to have aesthetic value. For example, I would not want to organize my mind as a dozen squabbling "free" modules, and I think communities of people should be organized around strong traditions, priests, and leaders.

Of course I also value people having autonomy and individual adventure.

Comment author: someonewrongonthenet 16 May 2013 04:33:34AM *  2 points [-]

Haven't taken the test. Self-describing as an "authoritarian" can only really be understood in the wider social context where authority and hierarchy have been devalued.

I think that's really the crux of it. When someone says they are authoritarian, that doesn't necessarily have anything to do with present/past authoritarian regimes.

My general position on such systems is that all facets of human morality are valuable

Isn't that a bit recursive? Human morality defines what is valuable. Saying that a moral is valuable is implying some sort of meta-morality. If someone doesn't assign "respect for authority" intrinsic value (though it may have utility in furthering other values), isn't that ...just the way it is?

My ideal world has an nonhuman absolute god ruling all, a human nobility, and nonhuman servants and npc's

I think everyone's ideal world is one where all our actions were directed by a being with access to the CEV of humanity (or, more accurately, each person wants humanity to be ruled by their own CEV). On LessWrong, that's not even controversial - it would be by definition the pinnacle of rational behavior.

The question is intended to be answered with realistic limitations in mind. Given our current society (or maybe given our society within 50 years, assuming none of that "FOOM" stuff happens) is there a way to bring about a safe, stable authoritarian society which is better than our own? There's no point to a political stance unless it has consequences for what actions one can take in the short term.

Comment author: fubarobfusco 16 May 2013 08:31:47AM 1 point [-]

When someone says they are authoritarian, that doesn't necessarily have anything to do with present/past authoritarian regimes.

Sounds pretty dangerous.

Comment author: [deleted] 16 May 2013 03:07:28PM *  0 points [-]

If someone doesn't assign "respect for authority" intrinsic value (though it may have utility in furthering other values), isn't that ...just the way it is?

No. Generally people are confused about morality, and such statements are optimized for signalling rather than correctness with respect to their actual preferences.

For example, I could say that I am a perfectly altruistic utilitarian. This is an advantageous thing to claim in some circles, but it is also false. I claim that the same pattern applies to non-authoritarianism, having been there myself.

So when I say "all of it is valuable" I am rejecting the pattern "Some people value X, but they are confused and X is not real morality, I only value Y and Z" which is a common position to take wrt the authority and purity axes on haidt, because that is supposedly a difference between liberals and conservatives, hence ripe for in-group signalling.

If some people value X, consider the proposition that it is actually valuable. Sometimes it isn't, and they're just weird, but that's rare, IMO.

The question is intended to be answered with realistic limitations in mind. Given our current society (or maybe given our society within 50 years, assuming none of that "FOOM" stuff happens) is there a way to bring about a safe, stable authoritarian society which is better than our own? There's no point to a political stance unless it has consequences for what actions one can take in the short term.

You are asking me to do an extremely large computational project (designing not only a good human society, but a plausible path to it), based on assumptions I don't think are realistic. I don't have time for that. Some people do though:

Moldbug has written plenty about how such a society could function and come about (the reaction)

Yvain has also recently laid out his semi-plausible authoritarian human society (raikoth) (eugenics, absolute rule by computer, omnipresent surveillance, etc)

I expect moreright will have some interesting discussion of this as well.

Comment author: ESRogs 16 May 2013 06:26:03PM 2 points [-]

Enslaving, in terms of putting to work w/o pay, doesn't make much sense in the hypothetical where the marginal value of human labor is effectively worthless, right? What would the poor be enslaved to do?

Perhaps a more realistic scary scenario would be this one: http://unqualified-reservations.blogspot.com/2009/11/dire-problem-and-virtual-option.html (essentially: when you're no longer of productive benefit to society, you go to virtual reality / video game heaven).

How scary that proposal sounds might be a matter of debate, though I suppose most folks around here would prefer a more egalitarian scenario where cognitive enhancement is distributed evenly enough that no human is left behind.

Comment author: TheOtherDave 16 May 2013 08:46:35PM 3 points [-]

For my own part, I'm content to wirehead to the extent that I have confidence that machines are capable of being more productive-to-others than I am along the axes I value being productive-to-others on.

Put differently: I don't seem to care very much whether I am doing important things, as long as important things are getting done at least as effectively as they would be were I doing them.

There's a slight refinement to this in the case where the entities doing the important things are basically like me, since there's a whole question of whether I'm defecting in a Prisoner's Dilemma, but I interpret the connotations of "machine" as implying that this complication doesn't arise here.

Comment author: ESRogs 16 May 2013 09:07:19PM 0 points [-]

Ah, a very interesting point of view. Framing it as a dichotomy between important work and wireheading seems a bit stark though. Are you meaning to include any sort non-productive fun under the umbrella of wireheading? I usually think of that term as implying only simple, non-complex fun (e.g. pleasure of orgasm vs experience of love and friendship).

Comment author: TheOtherDave 16 May 2013 10:46:15PM 3 points [-]

This gets difficult to specify, because "productive" and "important" are themselves ill-defined, but I certainly mean to include "virtual reality/video game heaven" within "wireheading," including VR environments including virtual people that pretend to love and befriend me. (This is distinguished from actual people who really do love and befriend me, whether they have flesh-and-blood bodies or not.)

That said, I have no idea, ultimately, if I would prefer the continuous-orgasm video game or the fake-love-and-friendship video game... I might well prefer the latter, or to switch back and forth, or something else.

Comment author: ESRogs 17 May 2013 05:47:59PM 0 points [-]

Ah, that clears things up, thanks!

Comment author: MugaSofer 23 May 2013 04:16:33PM 0 points [-]

Perhaps a more realistic scary scenario would be this one: http://unqualified-reservations.blogspot.com/2009/11/dire-problem-and-virtual-option.html (essentially: when you're no longer of productive benefit to society, you go to virtual reality / video game heaven).

It certainly seems more analogous to welfare or gated communities than a hypothetical "war against the poor" does.