skeptical_lurker comments on Superintelligence 24: Morality models and "do what I mean" - Less Wrong

7 Post author: KatjaGrace 24 February 2015 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread. Show more comments above.

Comment author: skeptical_lurker 25 February 2015 11:32:41AM 0 points [-]

Choosing between "all humans CEV" and "all humans + extrapolation of uplifted minds" and "CEV of various future minds that we would value" is non-obvious for example.

Take an average.

Comment author: RomeoStevens 25 February 2015 04:51:22PM *  1 point [-]

Weighting the uncertainty and value of each CEV is non-obvious, so you've pushed the uncertainty up one level.

Comment author: skeptical_lurker 26 February 2015 08:54:38AM -1 points [-]

True, but it seems easier to compromise on.