Viliam_Bur comments on In favour of a selective CEV initial dynamic - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (110)
They would kill us, or worse, without giving us any chance.
Just like a super-human AI without design for friendliness will probably kill us, or worse. An AI designed for friendliness will need some choices from us -- for example whether to use CEV of humankind, and how to approximate it if we can't measure literally every person on the planet -- and a bad choice could have horrible consequences.