You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanArmak comments on Malthusian copying: mass death of unhappy life-loving uploads - Less Wrong Discussion

12 Post author: Stuart_Armstrong 02 July 2012 04:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 02 July 2012 05:05:56PM 9 points [-]

'Pain asymbolia' is when people feel pain but it isn't painful: they are aware of the damage but it causes no suffering. (As opposed to conditions like leprosy or diabetes, where the pain nerves are dead, report nothing, and this causes endless health problems.)

We already find it very useful to override pain in the interests of long-term gain or optimization (eg. surgery). Why should we not expect uploads to quickly be engineered to pain asymbolia? Pain which is more like a clock ticking away in the corner of one's eye than a needle through the eye doesn't seem like that bad a problem.

Comment author: Khoth 02 July 2012 05:48:07PM 1 point [-]

Those uploads would probably be outcompeted by uploads that feel extreme pain any time they aren't working.

Comment author: DanArmak 02 July 2012 10:39:09PM 1 point [-]

Only if nobody succeeded in developing non-pain-based cognitive architecture modifications that achieved competitive results. E.g., making work addictive via positive feedback.

Very simplified POCs are already feasible in lab rats, so I expect future ems (which would allow for very rapid and extensive modification and testing) could solve the problem for humans. The interesting question is whether there will be legal or market pressures for anyone to work on the problem at all.