wedrifid comments on Only humans can have human values - Less Wrong

34 Post author: PhilGoetz 26 April 2010 06:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 28 April 2010 05:52:34AM *  2 points [-]

Suppose Clippy takes over this galaxy. Does Clippy stop then and make paperclips, or continue immediately expansion to the next galaxy?

Whatever is likely to produce more paperclips.

Suppose Clippy takes over this universe. Does Clippy stop then and make paperclips, or continue to other universes?

Whatever is likely to produce more paperclips. Including dedicating resources to figuring out if that is physically possible.

Does your version of Clippy ever get to make any paperclips?

Yes.

Does Clippy completely trust future Clippy, or spatially-distant Clippy, to make paperclips?

Yes.

At some point, Clippy is going to start discounting the future, or figure that the probability of owning and keeping the universe is very low, and make paperclips. At that point, Clippy is non-competitive.

A superintelligence that happens to want to make paperclips is extremely viable. This is utterly trivial. I maintain my rejection of the below claim and discontinue my engagement in this line of enquiry. It is just several levels of confusion.

The implied argument is that there aren't any values at all that most people will agree on, because one imagined and not-evolutionarily-viable Clippy doesn't think anything other than paperclips have value.