Nick_Tarleton comments on Open Thread: June 2009 - Less Wrong

4 Post author: Cyan 01 June 2009 06:46PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (142)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 02 June 2009 10:01:45PM 1 point [-]

Of course, hence "...and probably complicated in some other ways that haven't occurred to me in two minutes.".

Comment author: SoullessAutomaton 02 June 2009 11:00:03PM *  1 point [-]

Right. I know you realize this, and the post was fine in the context of "random discussion on the internet". However, if someone wants to actually, seriously specify a utility function for an AI any description that starts with "here's a high-level rule to avoid bad things" and then works from there looking for potential loopholes is deeply and fundamentally misguided completely independently of the rule proposed.