DaFranker comments on The Level Above Mine - Less Wrong

42 Post author: Eliezer_Yudkowsky 26 September 2008 09:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (387)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: DaFranker 23 January 2013 05:30:54PM *  5 points [-]

So if you ever have an insight that constitutes incremental progress toward being able to run lots of small, stupid, suffering conscious agents on a home computer, shut up.

"The Sims" is often heralded as the best-selling videogame of all time, and it attracts players of all ages, races and genders from all across the world and from all walks of life.[citation needed]

Now imagine if the toons in the game could actually feel what was happening to them and react believably to their environment and situation and events?

I'm sure I don't need to quote the Rules of Acquisition; everyone here should know where this leads if word of such a technique gets out.

Comment author: fubarobfusco 24 January 2013 02:44:02AM 3 points [-]

Now imagine if the toons in the game could actually feel what was happening to them and react believably to their environment and situation and events?

There have always been those who would pull the wings off flies, stomp on mice, or torture kittens. Setting roosters, fish, or dogs to fight each other to death remains a well-known spectacle in many rural parts of the world. In Shakespeare's day, Londoners enjoyed watching dogs slowly kill bulls or bears, or be killed by them; in France they set bushels of cats on fire to watch them burn. Public executions and tortures, gladiatorial combat among slaves, and other nonconsensual "blood sports" have been common in human history.

What's the difference?

Comment author: Eliezer_Yudkowsky 24 January 2013 03:05:45AM 14 points [-]

Scale.

Comment author: MugaSofer 24 January 2013 10:19:27AM 2 points [-]

The average individual could not hold private gladiatorial contests, on a whim, at negligible cost. Killing a few innocents by torture, as public spectacle, is significantly less than repeatedly torturing large groups, as private entertainment, for as little as the average individual would have paid for their ticket to the cockfight.

Also, some people reckon the suffering of animals doesn't matter. They're wrong, but they wouldn't care about most of your examples (or at least they would claim it's because they increase the risk you'll do the same to humans, which is a whole different kettle of fish.)

Comment author: [deleted] 24 January 2013 03:42:36PM 1 point [-]

Not to mention the sizeable fraction of car drives who will swerve in order to hit turtles. What the hell is wrong with my species?

Comment author: MugaSofer 25 January 2013 12:15:50PM *  -1 points [-]

Link is broken.

... seriously? Poor turtles >:-(

Comment author: [deleted] 25 January 2013 12:18:18PM 1 point [-]

It was mentioned recently on Yvain's blog and a few months ago on LW (can't find it right now).

Comment author: [deleted] 25 January 2013 03:26:45PM 1 point [-]
Comment author: shminux 24 January 2013 04:12:58AM *  4 points [-]

Now imagine if the toons in the game could actually feel what was happening to them and react believably to their environment and situation and events?

How do you know that they don't?

Comment author: [deleted] 24 January 2013 05:35:50AM *  6 points [-]

Why do you always have to ask subtly hard questions? I can just see see your smug face, smiling that smug smile of yours with that slight tilt of the head as we squirm trying to rationalize something up quick.

Here's my crack at it: They don't have what we currently think is the requisite code structure to "feel" in a meaningful way, but of course we are too confused to articulate the reasons much further.

Comment author: shminux 24 January 2013 06:52:25AM 1 point [-]

Thank you, I'm flattered. I have asked Eliezer the same question, not sure if anyone will reply. I hoped that there is a simple answer to this, related to the complexity of information processing in the substrate, like the brain or a computer, but I cannot seem to find any discussions online. Probably using wrong keywords.

Comment author: Kaj_Sotala 24 January 2013 09:49:14AM 0 points [-]
Comment author: [deleted] 24 January 2013 03:04:07PM *  1 point [-]

related to the complexity of information processing in the substrate

Not directly related. I think it has a lot to do with being roughly isomorphic to how a human thinks, which requires large complexity, but a particular complexity.

When I evaluate such questions IRL, like in the case of helping out an injured bird, or feeding my cat, I notice that my decisions seem to depend on whether I feel empathy for the thing. That is, do my algorithms recognize it as a being, or as a thing.

But then empathy can be hacked or faulty (see for example pictures of african children, cats and small animals, ugly disfigured people, far away people, etc), so I think of a sort of "abstract empathy" that is doing the job of recognizing morally valuable beings without all the bugs of my particular implementation of it.

In other words, I think it's a matter of moral philosophy, not metaphysics.

Comment author: DaFranker 24 January 2013 02:37:23PM *  3 points [-]

How do you know that they don't?

Well, I can't speak for the latest games, but I've personally read (some of) the core AI code for the toons in the first game of the series, and there was nothing in there that made a model of said code or attempted any form of what I'd even call "reasoning" throughout. No consciousness or meta-awareness.

By being simulated by the code simulating the game in which they "are", they could to some extent be said to be "aware" of certain values like their hunger level, if you really want to stretch wide the concept of "awareness". However, there seems to be no consciousness anywhere to be 'aware' (in the anthropomorphized sense) of this.

Since my priors are such that I consider it extremely unlikely that consciousness can exist without self-modeling and even more unlikely that consciousness is nonphysical, I conclude that there is a very low chance that they can be considered a "mind" with a consciousness that is aware of the pain and stimuli they receive.

The overall system is also extremely simple, in relative terms, considering the kind of AI code that's normally discussed around these parts.

Comment author: MugaSofer 24 January 2013 10:05:56AM -1 points [-]

Why would them feeling it help them "react believably to their environment and situation and events"? If they're dumb enough to "run lots of small, stupid, suffering conscious agents on a home computer", I mean.

Of course, give Moore time and this objection will stop applying.

Comment author: DaFranker 24 January 2013 02:58:53PM *  1 point [-]

We're already pretty close to making game characters have believable reactions, but only through clever scripting and a human deciding that situation X warrants reaction Y, and then applying mathematically-complicated patterns of light and prerecorded sounds onto the output devices of a computer.

If we can successfully implement a system that has that-function-we-refer-to-when-we-say-"consciousness" and that-f-w-r-t-w-w-s-"really feel pain", then it seems an easy additional step to implement the kind of events triggering the latter function and the kind of outputs from the former function that would be believable and convincing to human players. I may be having faulty algorithmic intuitions here though.

Comment author: MugaSofer 25 January 2013 09:24:54AM 0 points [-]

Well, if they were as smart as humans, sure. Even as smart as dogs, maybe. But if they're running lots of 'em on a home PC, then I must have been mistaken about how smart you have to be for consciousness.

Comment author: [deleted] 24 January 2013 03:43:39PM *  3 points [-]

"The Sims"

I used to torture my own characters to death a lot, back in the day.

EDIT: Not to mention what I did when playing Roller Coaster Tycoon.

Comment author: wedrifid 25 January 2013 03:59:46AM 1 point [-]

Now imagine if the toons in the game could actually feel what was happening to them and react believably to their environment and situation and events?

The favourite Sim household of my housemate was based on "Buffy the Vampire Slayer". Complete with a graveyard constructed in the backyard. Through the judicial application of "remove ladder" from the swimming pool.

And this is all without any particular malice!