You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Luke_A_Somers comments on Superintelligence 20: The value-loading problem - Less Wrong Discussion

4 Post author: KatjaGrace 27 January 2015 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (21)

You are viewing a single comment's thread. Show more comments above.

Comment author: Luke_A_Somers 27 January 2015 11:20:19PM 2 points [-]

Well, then, it seems like almost all the difficulty is in the value and formalization problems. Once we've really formalized it, it's 99% of the way to machine code from where it started as human intuition.

Comment author: torekp 02 February 2015 08:38:43PM 2 points [-]

Doesn't that mean the value loading strategy is an alternative to the (direct) formalization strategy?

Comment author: Luke_A_Somers 03 February 2015 03:01:04PM 1 point [-]

Via, say, doubly-indirect meta-ethics? Well, we need to decide that that's really the decision algorithm that's going to result in the right answer, both that it's ethically correct and predictably converges on that ethically correct result.