John_Maxwell_IV comments on The AI design space near the FAI [draft] - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (48)
For what it's worth, your "nearly friendly" examples all seem better than dying to me, maybe even significantly better.
Are you kidding?
This seems like a pretty silly thing to say; we should expect simple utility functions all else equal. A superintelligence that's ambivalent about helping humanity would have a pretty complicated utility function.
I agree that unfriendly AI would want to know lots about humans; I don't see why that requires preserving them. Seems like a scan and computer simulation would work much better.