jimrandomh comments on Perfectly Friendly AI - Less Wrong

7 Post author: Desrtopa 24 January 2011 07:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (39)
Tags: ai decision disaster

Comments (39)

You are viewing a single comment's thread. Show more comments above.

Comment author: jimrandomh 25 January 2011 02:10:55PM 0 points [-]

Accounting for the alien volition could outweigh our volition by their sheer number (e.g. if they are insectoids).

If we account for alien volition directly, then yes, this could be a problem. But if we only care about aliens because we're implementing CEV and some humans care about aliens, then scope insensitivity comes into play and the amount of resources that will be dedicated to the aliens is limited.

Comment author: endoself 26 January 2011 04:55:03AM 2 points [-]

Scope insensitivity is a failure to properly account for certain things. CEV is designed to account for everything. It is possible that some conclusions arrived at due to scope insensitivity will be upheld, but we do not yet know whether that is true and current human choices that we know to be the product of biases definitely do not count as evidence about how CEV will choose.

Comment author: XiXiDu 25 January 2011 02:12:55PM 2 points [-]

But if we only care about aliens because we're implementing CEV and some humans care about aliens...

If we only implement CEV for people working for the SIAI and some of them care about the rest of humanity...what's the difference?

Powered by Reddit Powered by Reddit