Will the ems save us from the robots?

Stuart_Armstrong

At the FHI, we are currently working on a project around whole brain emulations (WBE), or uploads. One important question is if getting to whole brain emulations first would make subsequent AGI creation

more or less likely to happen,
more or less likely to be survivable.

If you have any opinions or ideas on this, please submit them here. No need to present an organised overall argument; we'll be doing that. What would help most is any unusual suggestion, that we might not have thought of, for how WBE would affect AGI.

EDIT: Many thanks to everyone who suggested ideas here, they've been taken under consideration.

more or less likely to happen,
more or less likely to be survivable.

EDIT: Many thanks to everyone who suggested ideas here, they've been taken under consideration.

I'm afraid don't recall who I'm (poorly) paraphrasing here, but:

Why would we expect emulated humans to be any Friendlier than a de novo AGI? At least no computer program has tried to maliciously take over the world yet; humans have been trying to pull that off for millennia!

That's individual humans. The percentage of the population that's trying to take over the world maliciously at any given time is very low.

7Stuart_Armstrong14y

The case for WBE over AGI, simply put: the chances of getting a nice AI is vanishingly small. The chance of getting an evil AI is vanishingly small. The whole danger is in the huge "lethally indifferent" zone. WBE are more likely to be nice, more likely to be evil, and less likely to be lethally indifferent. Since evil and lethally indifferent have similar consequences (and a lot of evil will be better than indifferent), this makes WBE better than AGI.

0Curiouskid14y

What is the psychological motivation of a WBE upload? The people who try to take over the world are psychopaths and we would be able to alter their brain structures to remove those psychotic elements.

10

Will the ems save us from the robots?

10

10

10

Will the ems save us from the robots?

10

10