Manfred comments on Perfectly Friendly AI - Less Wrong

7 Post author: Desrtopa 24 January 2011 07:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (39)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 24 January 2011 07:33:07PM 0 points [-]

I would think it needs more flesh. Maybe try to put some math to how much you want the aliens to be happy. What do you think about human life vs. alien life, in terms of "worth?" Is your personal happiness enough for you, or do you want the universe to be tiled with utopias?

Comment author: Desrtopa 24 January 2011 07:42:36PM 0 points [-]

I don't think I know my utility function that well. I'm skeptical that tiling the universe with utopias is actually a good idea, but that might just be scope insensitivity on my part. I'm afraid that putting math to how much I want the aliens to be happy is almost certainly beyond me; I don't think any equation I could write up would be a realistic model of my values.