Kaj_Sotala comments on Diseased thinking: dissolving questions about disease - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (343)
Probably not, because it really was a super-intelligent AI, it could solve the problem without needing to kill anyone.
For general well-being. Something among the lines of "the amount of happiness minus the amount of suffering", or "the successful implementation of preferences" would probably be a decent first approximation, but even those have plenty of caveats (we probably wouldn't want to just turn everyone to wireheads, for instance). Human values are too complex to really be summed in any brief description. Or book-length ones, for that matter.
They could possibly come up with an alternative, but we must consider that it very well may be the most efficient thing to do is to kill them, unless we implement goals that make the killing the least efficient option. If your going with AI, then there is another thing to consider: time. How much time would the AI spend considering its options and judging the person in question? Shortest amount of time possible? Longest? There is no such thing as an ultimate trade off.
In other words, we have to set its goal as the ability to predict our values, which is a problem since you can't make AI goals in english.
I'm not sure of what exactly you're trying to say here.
Yup.