You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

gwern comments on Malthusian copying: mass death of unhappy life-loving uploads - Less Wrong Discussion

12 Post author: Stuart_Armstrong 02 July 2012 04:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 02 July 2012 05:05:56PM 9 points [-]

'Pain asymbolia' is when people feel pain but it isn't painful: they are aware of the damage but it causes no suffering. (As opposed to conditions like leprosy or diabetes, where the pain nerves are dead, report nothing, and this causes endless health problems.)

We already find it very useful to override pain in the interests of long-term gain or optimization (eg. surgery). Why should we not expect uploads to quickly be engineered to pain asymbolia? Pain which is more like a clock ticking away in the corner of one's eye than a needle through the eye doesn't seem like that bad a problem.

Comment author: Khoth 02 July 2012 05:48:07PM 1 point [-]

Those uploads would probably be outcompeted by uploads that feel extreme pain any time they aren't working.

Comment author: gwern 02 July 2012 05:49:19PM 4 points [-]

Do companies that judge projects based on their Return on Investment over the next week outcompete companies that judge RoI over months or years?

Comment author: Khoth 02 July 2012 06:19:42PM 4 points [-]

Okay, it couldn't be taken to extreme levels, but I think some things (like arguing about uploads on LW) are sufficiently unlikely to improve workplace productivity that a dose of pain for doing it would be have positive expected survival value.

Comment author: gwern 02 July 2012 07:35:15PM *  6 points [-]

Far more efficiently dealt with by some simple cognitive prostheses like RescueTime... What's better, a few machine instructions matching a blocked Web address, or reengineering the architecture of the brain with, at a minimum, operant conditioning? This is actually a good example of how a crude ancestral mechanism like pain is not very adaptive or applicable to upload circumstances!

Comment author: Khoth 02 July 2012 09:22:02PM 1 point [-]

I'll concede that it's not terribly likely, then (with the pascal's wager caveat of it being very bad if it is true (and the anti-caveat that I don't think the upload scenario is stable anyway))

Comment author: Stuart_Armstrong 03 July 2012 09:27:28AM 0 points [-]

Selection, not reegineering. The question is whether there are people alive today with the best sets of characteristics to become these malthusian uploads.

Comment author: Stuart_Armstrong 03 July 2012 09:28:02AM 0 points [-]

The mass of uploads seem much more likely to be contractors rather than employees or bosses; hence they would be required to be very performant in the short term. Even if they are employees, their short-term copies would have the same requirements.