You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Jiro comments on Help needed: nice AIs and presidential deaths - Less Wrong Discussion

1 Post author: Stuart_Armstrong 08 June 2015 04:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread. Show more comments above.

Comment author: Jiro 09 June 2015 05:50:14PM *  0 points [-]

My objection isn't about defining niceness to the people programming the AI. My objection is about defining niceness (actually, defining "extending niceness" which isn't the same) to the people determining whether the answer is correct. If we don't know what it means to "extend niceness", then we can't know that any given answer is "extending niceness", which means we have no way to know whether it's actually an answer.

Comment author: Stuart_Armstrong 10 June 2015 09:29:50AM 0 points [-]

I don't think that's actually the case - I think we can extend niceness without knowing what that means in this sense. Working on a potential solution currently...

Comment author: Jiro 11 June 2015 03:25:39AM 0 points [-]

Well, you can do it without knowing whether you're doing it, but how would you know if you've ever succeeded?

Furthermore, knowing that something is "extending niceness" is not the same as knowing if something is niceness. Let's say you know what niceness is. What counts as an extension?