You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Goal completion: the rocket equations - Less Wrong Discussion

4 Post author: Stuart_Armstrong 20 January 2016 01:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (13)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 20 January 2016 03:44:34PM *  4 points [-]

I'm calling "goal completion" the idea of giving an AI a partial goal, and having the AI infer the missing parts of the goal, based on observing human behaviour. Here is an initial model to test some of these ideas on.

Given that we cannot exhaustively explain all of the definitions and assumptions behind a goal, and these have to be inferred based on background knowledge about us, isn't the process of giving an AI any non-trivial goal an example of goal completion?

Comment author: Stuart_Armstrong 21 January 2016 11:06:11AM 0 points [-]

In a sense, yes. But here we're trying to automate the process.