SilasBarta comments on Human values differ as much as values can differ - Less Wrong

13 Post author: PhilGoetz 03 May 2010 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (205)

You are viewing a single comment's thread. Show more comments above.

Comment author: SilasBarta 04 May 2010 04:15:18PM -1 points [-]

Since existing high-status people's cooperation may be required to build a CEV-like AI

Yes, this is a concern I've had: a CEV-valuing FAI would also have to be a very good politician to have the social support necessary to keep the project from being shut down. But good politicians are a danger in and of themselves.

Comment author: Vladimir_Nesov 04 May 2010 05:10:38PM *  0 points [-]

Once an AGI is out, you won't be able to shut it down. The Internet makes it pretty much impossible, even if the AGI is not superintelligent.