SilasBarta comments on Human values differ as much as values can differ - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (205)
Yes, this is a concern I've had: a CEV-valuing FAI would also have to be a very good politician to have the social support necessary to keep the project from being shut down. But good politicians are a danger in and of themselves.
Once an AGI is out, you won't be able to shut it down. The Internet makes it pretty much impossible, even if the AGI is not superintelligent.