You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

MrMind comments on Stupid Questions, 2nd half of December - Less Wrong Discussion

2 Post author: Bound_up 23 December 2015 05:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (186)

You are viewing a single comment's thread. Show more comments above.

Comment author: MrMind 24 December 2015 01:01:19PM 2 points [-]

Since we have no AI, we do not have any direct evidence.
The argument though goes like this: AI is orthogonal to purpose, so any sufficiently advanced AI could self-improve and have an exponential impact on our society. But human values are fragile and complex, and if we do not carefully design said AI purpose carefully, it could trample all over them uncaringly.