gwern comments on Malthusian copying: mass death of unhappy life-loving uploads - Less Wrong

12 Post author: Stuart_Armstrong 02 July 2012 04:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread.

Comment author: gwern 02 July 2012 05:05:56PM 9 points [-]

'Pain asymbolia' is when people feel pain but it isn't painful: they are aware of the damage but it causes no suffering. (As opposed to conditions like leprosy or diabetes, where the pain nerves are dead, report nothing, and this causes endless health problems.)

We already find it very useful to override pain in the interests of long-term gain or optimization (eg. surgery). Why should we not expect uploads to quickly be engineered to pain asymbolia? Pain which is more like a clock ticking away in the corner of one's eye than a needle through the eye doesn't seem like that bad a problem.

Comment author: Jack 03 July 2012 06:36:32PM *  1 point [-]

You probably don't even need to do that much re-engineering. The 'suffering' of uploads in a Malthusian existence isn't physical pain, just endless mental drudge work. They could probably just interfere with their emotional experience of time so that they didn't get bored or overwhelmed. See, e.g. Diane Van Deren who became one of the world's top ultra-runners (100-300 mile races) after epilepsy surgery damaged her perception of time.

Comment author: gwern 04 July 2012 11:51:48PM 1 point [-]

Interesting; I'd never heard of her before. My closest example was the late Jure Robic

Comment author: Khoth 02 July 2012 05:48:07PM 1 point [-]

Those uploads would probably be outcompeted by uploads that feel extreme pain any time they aren't working.

Comment author: gwern 02 July 2012 05:49:19PM 4 points [-]

Do companies that judge projects based on their Return on Investment over the next week outcompete companies that judge RoI over months or years?

Comment author: Khoth 02 July 2012 06:19:42PM 4 points [-]

Okay, it couldn't be taken to extreme levels, but I think some things (like arguing about uploads on LW) are sufficiently unlikely to improve workplace productivity that a dose of pain for doing it would be have positive expected survival value.

Comment author: gwern 02 July 2012 07:35:15PM *  6 points [-]

Far more efficiently dealt with by some simple cognitive prostheses like RescueTime... What's better, a few machine instructions matching a blocked Web address, or reengineering the architecture of the brain with, at a minimum, operant conditioning? This is actually a good example of how a crude ancestral mechanism like pain is not very adaptive or applicable to upload circumstances!

Comment author: Khoth 02 July 2012 09:22:02PM 1 point [-]

I'll concede that it's not terribly likely, then (with the pascal's wager caveat of it being very bad if it is true (and the anti-caveat that I don't think the upload scenario is stable anyway))

Comment author: Stuart_Armstrong 03 July 2012 09:27:28AM 0 points [-]

Selection, not reegineering. The question is whether there are people alive today with the best sets of characteristics to become these malthusian uploads.

Comment author: Stuart_Armstrong 03 July 2012 09:28:02AM 0 points [-]

The mass of uploads seem much more likely to be contractors rather than employees or bosses; hence they would be required to be very performant in the short term. Even if they are employees, their short-term copies would have the same requirements.

Comment author: DanArmak 02 July 2012 10:39:09PM 1 point [-]

Only if nobody succeeded in developing non-pain-based cognitive architecture modifications that achieved competitive results. E.g., making work addictive via positive feedback.

Very simplified POCs are already feasible in lab rats, so I expect future ems (which would allow for very rapid and extensive modification and testing) could solve the problem for humans. The interesting question is whether there will be legal or market pressures for anyone to work on the problem at all.