shokwave comments on The Design Space of Minds-In-General - Less Wrong

19 Post author: Eliezer_Yudkowsky 25 June 2008 06:37AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: shokwave 21 January 2011 03:36:08PM 0 points [-]

Counter:

Sample a million people from different continents. Automatically cluster to find the 10,000 that are most similar to each other. Anything is a person if it is more similar to one of those along every analytical dimension than another in the set.

This is already tripping majoritarianism alarm bells.

I would meditate on this for a while when trying to define a paperclip.

Comment author: TheOtherDave 21 January 2011 04:23:54PM 0 points [-]

Sure.

For that matter, one could play all kinds of Hofstadterian games along these lines... is a staple a paperclip? After all, it's a thin piece of shaped metal designed and used to hold several sheets of paper together. Is a one-pound figurine of a paperclip a paperclip? Does it matter if you use it as a paperweight, to hold several pieces of paper together? Is a directory on a computer file system a virtual paperclip? Would it be more of one if we'd used the paperclip metaphor rather than the folder metaphor for it? And on and on and on.

In any case, I agree that the intuition that paperclips are an easy set to define depends heavily on the idea that not very many differences among candidates for inclusion matter very much, and that it should be obvious which differences those are. And all of that depends on human values.

Put a different way: picking 10,000 manufactured paperclips and fitting a category definition to those might exclude any number of things that, if asked, we would judge to be paperclips... but we don't really care, so a category arrived at this way is good enough. Adopting the same approach to humans would similarly exclude things we would judge to be human... and we care a lot about that, at least sometimes.

Comment author: datadataeverywhere 22 January 2011 01:03:34AM 0 points [-]

TheOtherDave got it right; I'm wasn't trying to give a complete definition of what is and isn't a paperclip, I was just offering forth an easy to define (without human values) subset that we would still call paperclips.

It has plenty of false negatives, but I don't really see that as a loss. Likewise, your personhood algorithm doesn't bother me as long as we don't use it to establish non-personhood.

Comment author: shokwave 22 January 2011 07:47:19AM 0 points [-]

as long as we don't use it to establish non-personhood.

Ah. This distinction escaped me; I tend to use definitions in a formal logical style (P or ~P, no other options).