Comment author: Wei_Dai 07 August 2012 04:06:00AM *  2 points [-]

Robin talks about a class system where those running at higher speeds are in a higher social class. But given Robin's assumption that cost for emulation speed will be linear up to 1000000x, I don't see why anyone (except those with physical work, which Robin estimates at 20% of the population) wouldn't want to run at the top end of this range. In his scenario of a boss running at 21x the speed of the workers, why isn't the whole team being run at the higher speed? Does anyone understand his reasoning here?

Comment author: RobinHanson 09 August 2012 02:52:06AM 0 points [-]

In order for faster ems to talk to each other naturally, they have to be closer to each other, and thus occupy more expensive prime real estate. So they don't want to be faster than they need to be to match the other tasks with which they coordinate.

Comment author: gwern 06 August 2012 10:00:32PM *  5 points [-]

Notes:

  • So he's writing a book on em economics? I'm actually a little disappointed - I was hoping for a grand synthesis of all the health care/Near-Far/signaling material on OB. Well, hopefully he'll be able to marshal all sorts of good details and analogies that he has to skim over in a talk (eg. when he talked about the big economy being spatially small, I thought of the Kuznets curve; location made me think of datacenters, which fortunately he did bring up)
  • An Apple user. Always kind of thought of him as a PC.
  • The transition example is interesting. I didn't realize that there would be several years before world growth hits insane numbers like 100+% annual growth. This undermines some of my ideas about investing for an em scenario: instead of investing now heavily in equities, it may be better to instead wait for world growth to hit 7%+ and then invest as frantically as possible.
  • Luxurious virtual environments will be common: this seems trivially false or at least questionable. Just previously, he points out that wages and costs will fall to the level at which another em can be created/copied. Even if a luxurious virtual environment were cheap in some absolute sense, that doesn't say they'll be cheap in a relative sense. Existing virtual environments require specialized hardwired mini-supercomputers (GPUs) to handle rendering environments, much of which is static, and fall far short of 'luxury'. (As nice as any existing video game like Crysis may look, would you not find being imprisoned in it very unpleasant, to say nothing of extremely luxurious?) AAA games are in a well-known death spiral as the gigabytes of artwork and other demands inflate production costs into the hundreds of millions already. I'd find this point much more convincing if he instead took a tack more like 'yes, it will require terabytes of artwork and gigaflops of rendering, but this will only be 1% or less of the most plausible estimates for emulating minds, and so it's quite plausible such environments will yield a +1% productivity improvement' (until selection pressures eliminate the need or desire for luxurious environments because that's 1% that could be spent better, anyway...).
  • It was notably light on the issues of values (farmer vs forager) and selection pressure leading to em hell.
  • It was much longer and more comprehensive than I thought. It stands as a pretty decent summary of all the em posts on OB.
Comment author: RobinHanson 09 August 2012 02:46:54AM *  2 points [-]

Maybe I can write more on near-far and signaling in another book. One thing at a time. Most of the things that make our physical world luxurious or impoverished have little to do with the cost of simulating them. A dirty smelly hut is just as expensive to simulate as a vast mansion. Yes, they might spend 0.1% more relative to brain computing costs on computing VR if that increases work productivity by more than 0.1%.

Comment author: [deleted] 06 July 2012 12:01:06AM 4 points [-]

I used to work on a program that was designed to run binaries compiled for one processor on another. It was only meant to run the binaries compiled for a single minor revision of a GNU/Linux distro on one processor on the same minor revision of the same distro on another processor.

We had access to the source code of the distro -- and got some changes made to make our job easier. We had access to the full chip design of one chip (to which, again, there were changes made for our benefit), and to the published spec of the other.

We managed to get the product out of the door, but every single code change -- even, at times, changes to non-functional lines of code like comments -- would cause major problems (mention the phrase "Java GUI" to me even now, a couple of years later, and I'll start to twitch). We would only support a limited subset of functionality, it would run at a fraction of the speed, and even that took a hell of a lot of work to do at all.

Now, that was just making binaries compiled for a distro for which we had the sources to run on a different human-designed von Neumann-architecture chip.

Given my experience of doing even that, I'd say the amount of time it would take (even assuming continued progress in processor speeds and storage capacity, which is a huge assumption) to get human brain emulation to the point where an emulated brain can match a real one for reliability and speed is in the region of a couple of hundred years, yes.

Comment author: RobinHanson 06 July 2012 10:15:32AM 1 point [-]

Yes, emulation can be hard. But even so, writing software with the full power of the human brain from scratch seems much harder. If you agree, then you should still expect emulations to be the first AI to arrive.

Comment author: stcredzero 02 July 2012 08:34:54PM 1 point [-]

Instead of the deletion or killing of uploads that want to live but can't cut it economically, why not slow them down? (Perhaps to the point where they are only as "quick" and "clever" as an average human being is today.) Given that the cost of computation keeps decreasing, this should impose a minimal burden on society going forward. This could also be an inducement to find better employment, especially if employers can temporarily grant increased computation resources for the purposes of the job.

Comment author: RobinHanson 04 July 2012 12:05:21PM 0 points [-]

This is close to the me-now immorality that I have said can be possible: http://www.overcomingbias.com/2011/12/the-immortality-of-me-now.html

Comment author: Khoth 03 July 2012 06:08:15PM 0 points [-]

Okay, compare it to life now.

Comment author: RobinHanson 04 July 2012 12:02:21PM *  2 points [-]

That isn't a realistic choice. If you mean imagine that 1) humanity continues on as it has without ems arriving, or 2) ems arrive as I envision, then we'd be adding trillions of ems with lives worth living onto the billions of humans who would exist anyway with a similar quality of life. That sounds good to me.

Comment author: Khoth 03 July 2012 12:13:47PM 2 points [-]

Yeah, the reason I asked is that he's been evasive about it before and I wanted to try to pin down an actual answer.

Comment author: RobinHanson 03 July 2012 05:36:52PM *  6 points [-]

If you want more precise answers you have to ask more precise questions. Whether or not I favor any particular thing depends on what alternatives it is being compared with.

Comment author: Khoth 03 July 2012 12:11:11PM 4 points [-]

Hang on, yesterday you were telling me that there's very little anyone could do to make a real difference to the outcome. So why tell Stuart that your analysis could be helpful in bringing about a different outcome?

Comment author: RobinHanson 03 July 2012 05:35:15PM 3 points [-]

The issue is the size of the influence you can have. Even if you only have a small influence, you still want to think about how to use it.

Comment author: Stuart_Armstrong 03 July 2012 09:38:46AM *  6 points [-]

Stuart, it sounds like you think that the life of the typical animal, and of the typical human in history, were not worth living -- you'd prefer that they had never existed.

I'd prefer that their lives were better, rather than there were more of them.

What you'd most want from the future is to stop change enough to ensure that people very much like you continue to dominate.

What I'd most want from the future is change in many directions (more excitement! more freedom! more fun!), but not in the direction of low-individual-choice, death-filled worlds (with possibly a lot of pain). I'd eagerly embrace a world without mathematicians, without males, without academics, without white people (and so on down the list of practically any of my characteristics), without me or any copy of me, in order to avoid the malthusian scenario.

Comment author: RobinHanson 03 July 2012 12:01:30PM 9 points [-]

Even if you and I might disagree on trading number/length of lives for some measure of quality, I hope you see that my analysis can help you identify policies that might push the future in your favored direction. I'm first and foremost trying to predict the outcomes of a low regulation scenario. That is the standard basis for analyzing the consequences of possible regulations.

Comment author: Vladimir_M 03 July 2012 02:04:04AM 11 points [-]

What are humans doing now that we need only ~2% of the workforce to grow food and ~15% to design and make stuff?

Comment author: RobinHanson 03 July 2012 11:56:04AM 3 points [-]

Most of those other people are doing useful tasks, without which people wouldn't get nearly as much of what they want. If you don't understand our current economy, you don't have much of a prayer of understanding future ones.

Comment author: pjeby 02 July 2012 08:01:15PM 12 points [-]

ISTM that the major flaw in Hanson's logic is the assumption that uploads won't replace themselves with simpler nonsentients based on their expertise. The real evolutionary pressure wouldn't be to have optimum levels of pain and pleasure, but to replace motivation with automation: it takes less power, computing time, and storage space.

Comment author: RobinHanson 03 July 2012 11:53:39AM 5 points [-]

The issue is the time period being considered. I don't claim to analyze an asymptotic future after all tech change has stopped. I instead try to consider the "next" era after foraging, farming, industry. While that era might be short on a cosmic timescale, it may be long subjectively to the creatures involved.

At the moment human minds are vastly more productive than automation. Automation is slowly getting more capable yes, but with ems, they will also increase in efficiency.

View more: Prev | Next