You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Gunnar_Zarncke comments on Open thread, September 15-21, 2014 - Less Wrong Discussion

6 Post author: gjm 15 September 2014 12:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (339)

You are viewing a single comment's thread. Show more comments above.

Comment author: NancyLebovitz 16 September 2014 03:36:15PM 8 points [-]

I have a notion that an FAI will be able to create better friends and lovers for you than actual humans could be. Family would be a more complex case if you value the history as well as the current experience.

I'm not talking about catgirls-- if some difficulties in relationships are part of making relationships better in the long haul, then the FAI will supply difficulties.

If people eventually have relationships with FAI-created humans rather than humans generated by other means, is this a problem?

Comment author: Gunnar_Zarncke 17 September 2014 09:55:25AM *  5 points [-]

See also EYs Failed Utopia #4-2

FAI-created X ... is this a problem?

I'm not sure we can extrapolate this currently. If we knew more, thought faster... maybe.

For me this means that one contraint on FAI is that it may not perform changes arbitrarily fast. Too fast for humans to react and adapt. There must be a 'smooth' trajectory. Surely not the abrupt change suggested in Failed Utopia.