You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Xachariah comments on [video] Robin Hanson: Uploads Economics 101 - Less Wrong Discussion

6 Post author: mapnoterritory 05 August 2012 09:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (54)

You are viewing a single comment's thread.

Comment author: Xachariah 06 August 2012 03:17:17AM 9 points [-]

I'm struck by the vastly incompatible views of the future he seems to be holding simultaneously. At the beginning he says, "economy will double every two weeks," and "if you save a little the investment money will make you rich from the economy doubling" coupled with "the entire EM economy could be located all in one small Scandinavian country near where uploading is first created," and "the population 10 trillion cities will consume huge amounts of resources, destroy the environment, and eventually consume the globe." How does that count as anything except a hard takeoff that leaves humanity in the dust, and how do you plan to cash out your investment from the immortal Em society when they decide not to honor your 10^26% compound interest?

I was left with the impression that a lot of the ideas were made because he wanted them to be real first, then were rationalized how it would work later. Some of the things discussed seem especially incoherent. His whole section on Em socialization seems odd when you can just duplicate friends at any time. In fact, the entire talk seems predicated entirely on having near-perfect mind theft security which is covered at the very end in a single slide.

There's also a bit about corporations at ~37 mins. A company with 256 line workers that organizes in 4 man teams needs with 64 line bosses, 16 higher bosses, 4 VPs, and one executive. That's 5 levels of communication which can cause all sorts of problems, not to mention the cost in ~25% of the company being managers. The solution he describes is a single, time accelerated boss running at ~21x speed able to coordinate all 64 teams and keeping the entire company running as one entity. (Note that uber-boss is still taking up 25% of the company's em time.)

The issue I have with this is that it ignores the entire advantages of emulation discussed earlier in the talk, namely duplication of workers. If you can duplicate workers effectively infinitely (eg plumber example) and you can create and destroy workers every 10 minutes (eg computer programmer example), then you don't need an organization at all. Parallelizable tasks can all be solved whenever (again, plumber), and all the work that remains will be in serial. Ems will be tasked with jobs on their instantiation, and will return their results to whoever needed it when their task is completed (which could just be another worker). This brings corporations outside of the realm of bosses and economists and pulls them into the realm of computer scientists. Corporations will look a lot less like pyramids and a lot more like computer programs.

I feel like I'm gonna lose some karma on this comment, but... yeah. Hanson normally strikes me as very insightful but this talk just felt like a mess.

Comment author: RomeoStevens 06 August 2012 07:06:33AM 6 points [-]

Oh god, running an Em could just be a function call. Guess I'm not sleeping tonight.

Comment author: Wei_Dai 08 August 2012 02:38:33AM 3 points [-]

Oh god, running an Em could just be a function call. Guess I'm not sleeping tonight.

Forking processes in Unix make use of copy-on-write memory, and forking uploads could perhaps be like that, so that when an upload copy terminates it literally is just losing some new memories. Would this be better or worse, I wonder, than making and deleting complete copies?

Comment author: CarlShulman 08 August 2012 02:58:54AM 2 points [-]

Why would it be worse?

Comment author: Wei_Dai 08 August 2012 03:43:45AM 2 points [-]

It might be worse for example if you are a total utilitarian and complete copies count more than copy-on-write forks.

And in case anyone is wondering, it might be better because terminating a copy-on-write fork seems less like killing someone than deleting a complete copy.

Comment author: knb 06 August 2012 05:01:29AM 2 points [-]

how do you plan to cash out your investment from the immortal Em society when they decide not to honor your 10^26% compound interest?

Why would you assume investments won't be honored?

As Hanson points out, we could rob our retirees of their investments. This doesn't actually happen because "non-retiree" is a shallow category that doesn't make for an actual functioning political/military coalition. Note that right-handed people are a large majority and could form a political coalition to rob left-handed people of their money. Yet this hasn't actually happened.

Comment author: Xachariah 06 August 2012 06:04:45AM *  4 points [-]

He was talking about Ems at the equivalent of .3mm space living 500 years in a month. If you invest when we start seeing a 1 month doubling period and cash out two weeks later, then that's longer than America's been a country. Two months later goes back to before the dark ages, four months is the death of Jesus, and holding on to your investment for a year is basically the entirety of recorded civilization. If you had a time machine and went back and invested in any of those time periods, what are the chances you'd get that money back?

Hanson's analogy about foragers seems more apt. Something along the lines of "there are foragers still today, we didn't kill them off... as long as they're using something we don't care about we're not that bothered by them." Just remember what happens any time native foragers 1) have something we want or 2) try to make a claim against anything we have. It never ends well for the foragers.

Comment author: knb 06 August 2012 04:58:19PM *  3 points [-]

Well, you completely ignored the point I made, which is that there is no reason to think emulations would conspire with each other to deny people their investments. Many emulations would also have long periods of investing and money and earning enormous amounts through interest payments. Many non-uploaded humans would probably invest money in funds that would be run (like almost anything else) by uploaded people. Both rich uploads and upload fund managers would have an incentive to oppose confiscations.

If you had a time machine and went back and invested in any of those time periods, what are the chances you'd get that money back?

Benjamin Franklin actually did invest money in 1790, and the amount with 200 years of interest really was paid out in the way specified in the trust. People have owned land titles and shares in businesses for over a thousand years through multiple dynasties and regimes.

1) have something we want or 2) try to make a claim against anything we have. It never ends well for the foragers.

The difference being that foragers don't have titles/deeds or even a clear understanding of property-ownership.

ETA: I should really proofread my comments before I post.

Comment author: gwern 06 August 2012 09:26:03PM 3 points [-]

The difference being that foragers don't have titles/deeds or even a clear understanding of property-ownership.

So what? History is still not kind. I pointed out 2 more examples to Hanson, which I think he blogged about, where someone doing something very similar to Franklin saw the money completely wasted. 1/3 odds is not especially encouraging given that the analysis has only just begun...

For example, a deeper analysis might include the Islamic world's perpetual charity corporation, the waqf which form dates back almost to the beginning, collectively comprised a huge chunk of various economies - but while they did much better than one might expect, most still ceased to exist at some point. As far as I know, every wafq started in, say, 1000 AD is now dead. There may be a few Egyptian survivors from later centuries, attached to the University, but nevertheless, the overall picture is one of a very low survival rate. (I've pointed out waqfs to Hanson multiple times, but I don't know what he makes of them.)

Comment author: Xachariah 06 August 2012 10:11:43PM 4 points [-]

Just a rough dirty outline since I'm headed out of town for two days. I may make a discussion post about some of the points later.

  • The natural human method of property division is killing people and taking their stuff. Capitalism is a blip on the radar.

  • Ems will be entering an entirely different context than 20th century humans. We'll be lucky if capitalism translates to the digital world at all.

  • Ems vs human will be a natural division point. Every human (if lucky) becomes a retiree at some point, no Ems become human. Humans do not have a good track record of respecting the property rights of those different to them.

  • Humans literally cannot object to Ems doing this. We literally cannot think fast enough to stop it from happening and it only needs happen once in 5000 years each year for us.

  • 5000 years? That's older than the entire concept of capital. Unless capitalism is the one true economic system for all eternity, you'll be out of luck. Historically, the vast majority of economic systems wouldn't honor your holding onto that property without a means to personally enforce it.

  • 5000x wasn't the cap. Hanson made a comment about potential 1,000,000x speeds. One year goes longer back than our ancestors could even say the word 'capitalism'. I say ancestors because homo sapiens weren't around back then. I'm imagining making a capital investment to Krogg, and trying to get that repaid today.

  • This ignores the possibility of Em-space becoming a free for all of replicators trying to ascend into Godhood. I consider it the most likely possibility (but that's the subject of another thread). But even if that doesn't happen and they keep capitalism, and Ems have no government shakeups, and they bother keeping track of debts to humans, you won't be able to withdraw because...

  • Sheer magnitude of value. A human working earning, lets say $20,000 in one year pre-uploading, is worth one man-year of work. A human investing that money and earning a year's interest during the 1-month doubling time frame suddenly has $81,000,000. People would happily steal from retirees if that much money was changing hands.

  • Meanwhile the average wage has dropped to $4 a year. There is no moral system I can imagine that figures it's okay for one person's year of work to be worth someone else's 20-million years of work just because they got lucky when they made it.

  • Scratch that. I know that there's a similar-ish disparity between a CEO and a bottom quintile Nigerian. Lucky for the CEO, current Nigerians don't run at 5000x speed because they would happily take his money away and be morally okay with that. Lets say some Ems are on the side of giving humans back their money. You're going to have literally a thousand times the current population of the earth as poor Nigerians who will be set for a literal million years if they can get just a fraction of the money away from the old human dinosaurs who literally cannot object to them. That's a lot of literals.

  • Similarly, the opportunity cost of 'pay off that human' vs 'give 10,000,000 ems a better standard of living' is an easy choice. Who could morally side with the human? Well, maybe a human but they won't be making that decision.

  • All the goods are digital. You can't eat zeros and ones. Your money will increase by 4,000x+ a year, but the number of apples won't increase by 4,000x+ a year, so the gains will just be inflated away for physical goods.

  • Actually, the economy will probably become mostly decoupled between digital and physical goods. Ems may increase thinking capacity a trillion fold, but it's not they'll will significantly increase the number of apples we grow.

  • Scratch that. Having Ems will increase apples, because all the computer programmers, and bureaucrats, and entertainers, and etc, etc, etc, will now be out of jobs except for growing apples and delivering microchips to the Em towers. So, I guess that's nice?

My original post was expressing derision at the idea that you could live off the interest from Ems. I understand that it's not a popular message to say, "Ems are gonna hard takeoff, and leave us in the dust, but we won't necessarily go extinct (unless we do)." However, it's a lot more honest than promising fantastic wealth just for surviving until uploading even if you yourself don't upload. As I mentioned above these are rough objections, but I may make a post.

Comment author: CarlShulman 07 August 2012 05:08:27AM 2 points [-]

One key objection to this argument is that even though a human with enough money to survive is fantastically rich relative to individual digital folk (and immensely worth expropriating from the perspective of individuals, or those in physical proximity), she can still be vanishingly poor relative to the em society as a whole. If 1 in 1,000,000,000,000,000 available units of free energy within a certain jurisdiction goes to humans while the rest goes to much cheaper digital life, national-scale digital politicians won't be able to promise any noticeable improvement in average living standards in exchange for expropriating the humans.

Comment author: RobinHanson 09 August 2012 11:02:36AM 0 points [-]

You seem to be under the impression that I am promising a guarantee that every form of retiree investment will live up to all retiree hopes, no matter how much change happens in the political or economic systems. But even in times of peace where law is upheld, many supposedly "safe" investments will disappoint. The recent downturn is an obvious example. In such times of turmoil, even government guaranteed investments may fail. And in times of war, there are even fewer safe investments.

But this is all a pretty generic fact about the future - the more change it sees, the more at risk are individual investments. If change speeds up, then the realization of this risk speeds up. There really isn't a realistic alternative -- all of this applies no matter what kids of big changes are coming.

Comment author: asr 06 August 2012 05:58:09AM 1 point [-]

It periodically does happen that governments default on their pensions, either completely or partly. Consider Argentina, or Greece. Assorted California cities are currently in bankruptcy court asking a judge to let them reduce their pension obligations.

Even beyond government default, private-sector Investments routinely go bust. If your pension was run by a bank that turned out to be or to become crooked, your long-term compound interest may never happen.

Comment author: knb 06 August 2012 05:01:03PM 0 points [-]

I'm not talking about government run pensions, but about private retirement accounts or other investments owned by retirees.

Comment author: asr 06 August 2012 08:13:20PM *  4 points [-]

There again, there is tail risk. You may not be made whole if the pension custodian is bankrupted by fraud, seized by the government, or otherwise subject to accident.

There's an easy empirical way to assess this. Ask how common are violent political revolutions and what happens to financial products sold before the revolution. Did the All-Russia Insurance Company continue to pay out on policies after the 1917 Revolution? The headquarters building was seized by the Cheka and I believe the owners and executives were exiled or liquidated. What happened if you had your pension investments in Iran in 1979?

Yes, there are rich, developed, stable countries where revolution is rare. How long will they stay that way? A century? Two centuries? In the presence of Singularity-scale disruption? These stories about multiplying wealth by factors of thousands or more seem to be making a very heavy bet on permanent stability of the sort never previously seen on Earth.

Comment author: CarlShulman 06 August 2012 04:23:59AM *  1 point [-]

Parallelizable tasks can all be solved whenever (again, plumber), and all the work that remains will be in serial. Ems will be tasked with jobs on their instantiation, and will return their results to whoever needed it when their task is completed (which could just be another worker). This brings corporations outside of the realm of bosses and economists and pulls them into the realm of computer scientists. Corporations will look a lot less like pyramids and a lot more like computer programs.

This doesn't make sense to me as an objection. Some tasks are not very short and parallelizable, so you need extended serial work. And some of those tasks will profit from coordination between different minds with different skills, or different memories from earlier in the project. Coordinating those units would require some kind of communication and management.

Comment author: Xachariah 06 August 2012 06:18:47AM 0 points [-]

I'm sure it says more about my imagination than the nature of future work, but I still can't imagine anything one can meaningfully work on that can't be either parallelized, or treated like a computer program. It makes it hard to think about the subject without a concrete example to wrap my head around.

Comment author: CarlShulman 06 August 2012 06:56:15AM 0 points [-]

Take 50 researchers working on related topics to improve an algorithm to do object recognition in industrial robots. Each topic involves lemmas building upon lemmas, experiments selected based on previous experiments, and other serial steps. The steps are different for the different subtopics. As intermediate results come in, communication and management are used to allocate resources between subtopics, to determine which researchers spend how much time explaining their work to one another to cross-fertilize insights, and so forth.