You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Gunnar_Zarncke comments on Open thread, September 15-21, 2014 - Less Wrong Discussion

6 Post author: gjm 15 September 2014 12:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (339)

You are viewing a single comment's thread. Show more comments above.

Comment author: Gunnar_Zarncke 17 September 2014 09:55:25AM *  5 points [-]

See also EYs Failed Utopia #4-2

FAI-created X ... is this a problem?

I'm not sure we can extrapolate this currently. If we knew more, thought faster... maybe.

For me this means that one contraint on FAI is that it may not perform changes arbitrarily fast. Too fast for humans to react and adapt. There must be a 'smooth' trajectory. Surely not the abrupt change suggested in Failed Utopia.