MrMind comments on Open thread, Apr. 18 - Apr. 24, 2016 - Less Wrong

2 Post author: MrMind 18 April 2016 07:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (176)

You are viewing a single comment's thread.

Comment author: MrMind 22 April 2016 08:51:10AM 0 points [-]

Inspired by the recent post of Kaj Sotala, I ask myself: is any kind of meta-goal a convergent instrumental goal? If so, isn't any kind of meta-meta-goal convergent instrumental for the meta-goal?
Does this create a Zeno effect of AI motivation, trying to achieve more and more meta goals?