You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanArmak comments on Malthusian copying: mass death of unhappy life-loving uploads - Less Wrong Discussion

12 Post author: Stuart_Armstrong 02 July 2012 04:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: pjeby 02 July 2012 08:01:15PM 12 points [-]

ISTM that the major flaw in Hanson's logic is the assumption that uploads won't replace themselves with simpler nonsentients based on their expertise. The real evolutionary pressure wouldn't be to have optimum levels of pain and pleasure, but to replace motivation with automation: it takes less power, computing time, and storage space.

Comment author: DanArmak 02 July 2012 10:24:16PM *  4 points [-]

That's an explicit assumption he makes: that even the future ems will fail to design AIs or highly-modifed or nonhuman ems that will outcompete regular human ems. This seems to me very unlikely, but it's the premise of the discussion, as you correctly note.

Edit: didn't mean to imply Hanson makes this assumption without arguing for it and justifying it. I'm pretty sure he's posted about it.