ciphergoth comments on Thoughts on the Singularity Institute (SI) - Less Wrong

256 Post author: HoldenKarnofsky 11 May 2012 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1270)

You are viewing a single comment's thread. Show more comments above.

Comment author: ciphergoth 14 May 2012 09:41:36AM *  2 points [-]

Yes, I am; I think that the human value of interestingness is much, much more specific than the search space optimization you're pointing at.

[This reply was to an earlier version of timtyler's comment]

Comment author: timtyler 14 May 2012 10:17:37AM 1 point [-]

So: do you really think that humans wouldn't find a martian civilization interesting? Surely there would be many humans who would be incredibly interested.

Comment author: ciphergoth 14 May 2012 10:48:21AM 2 points [-]

I find Jupiter interesting. I think a paperclip maximizer (choosing a different intuition pump for the same point) could be more interesting than Jupiter, but it would generate an astronomically tiny fraction of the total potential for interestingness in this universe.

Comment author: timtyler 14 May 2012 11:13:48AM *  2 points [-]

Life isn't much of an "interestingness" maximiser. Expecting to produce more than a tiny fraction of the total potential for interestingness in this universe seems as though it would be rather unreasonable.

I agree that a paperclip maximiser would be more boring than an ordinary entropy-maximising civilization - though I don't know by how much - probably not by a huge amount - the basic problems it faces are much the same - the paperclip maximiser just has fewer atoms to work with.