eli_sennesh comments on Value learning: ultra-sophisticated Cake or Death - Less Wrong

9 Post author: Stuart_Armstrong 17 June 2014 04:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (15)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 19 June 2014 07:33:28PM 0 points [-]

Wouldn't you want to motivate it to say "good"?

I might be committing mind-projection here, but no. Data is data, evidence is evidence. Expected moral data is, in some sense, moral data: if the AI predicts with high confidence that I will say "bad", this ought to already be evidence that it ought not have done whatever I'm about to scold it for.

Comment author: Stuart_Armstrong 20 June 2014 10:33:17AM 0 points [-]