You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

MrMind comments on Open thread, Apr. 18 - Apr. 24, 2016 - Less Wrong Discussion

2 Post author: MrMind 18 April 2016 07:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (176)

You are viewing a single comment's thread.

Comment author: MrMind 22 April 2016 08:51:10AM 0 points [-]

Inspired by the recent post of Kaj Sotala, I ask myself: is any kind of meta-goal a convergent instrumental goal? If so, isn't any kind of meta-meta-goal convergent instrumental for the meta-goal?
Does this create a Zeno effect of AI motivation, trying to achieve more and more meta goals?