MaoShan comments on Modularity and Buzzy - LessWrong

24 Post author: Kaj_Sotala 04 August 2011 11:35AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (26)

You are viewing a single comment's thread. Show more comments above.

Comment author: MaoShan 10 August 2011 09:56:28PM 4 points [-]

I have produced an offspring. It has friends, teachers, its own room, allowance, personal tastes.... It has a separate name and existence from me. It operates according to compatible, but distinct, purposes, opportunities and choices to mine. And, if I accomplish my goal, it will operate even more independently in the future than it does now, and may at some point, exist entirely separate from me. But, I'm not tempted to attribute an "I" to it.

When a system achieves sufficient complexity, we have a tendency to reify it. That bias might be called "parenthood". But in the spirit of not giving preference to biological human people, why would you consider your business to be less alive than a turkey? I agree that there's a point where we start to call it a conscious agent, and if left to itself, your business would act irrationally, and possibly die, but it -would- act. This just means that you are not finished programming yet. If there's no possibility of ever calling your business conscious, given mind-bogglingly clever planning, then we can all give up and go back to bed now. My point is that I think we have a tendency to attribute agency to things because it is useful to treat as if they had agency, even if they really don't. If you can predict accurately using the wrong model, you may be wrong but at least you're predicting accurately.

Comment author: Alicorn 10 August 2011 10:13:36PM 3 points [-]

Does your offspring know that you refer to it as "it"?

Comment author: MaoShan 19 August 2011 03:03:48AM 2 points [-]

Du-dun, tsh! That was in reference to my general, hypothetical offspring. I usually use personal pronouns for my own three. Although they would probably get the humor if I did--the replication/improvement is going smoothly. They are already used to my speeches about psychology, artificial intelligence, and evolution, and quantum physics, even though they are eight, six, and two. They frequently accuse me of being (or possibly actually believe that I am) an alien, a robot, or both. I take that as a compliment, seeing as I am the one who planted that idea.