You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Cube comments on [LINK] Utilitarian self-driving cars? - Less Wrong Discussion

7 Post author: V_V 14 May 2014 01:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: Cube 14 May 2014 03:22:37PM 0 points [-]

Conventional mortality would dictate that the car minimize global loss of life, followed by permanent brain damage, permanent body damage. I think in the future that other algorithms will be illegal but existent.

However. The lives each car would have the most effect on would be those inside of it. So in most situations all actions would be directed towards said persons.

Comment author: Houshalter 14 May 2014 05:19:07PM 3 points [-]

The issue is that it could create bad incentives. E.g. motorcyclists not wearing helmets and even acting inappropriately around self-driving cars, knowing it will avoid them, even if it causes it to crash. Or people stop buying safer cars because they are always chosen as "targets" by self-driving cars to crash into, making them statistically less safe.

I don't think the concerns are large enough to worry about, but hypothetically it's an interesting dilemma.

Comment author: roystgnr 15 May 2014 04:03:30PM 6 points [-]

When I was a dumb kid, my friends and I regularly jaywalked (jayran?) across 3 lanes at a time of high speed traffic, just to get to a nicer place for lunch. Don't underestimate the populations of stupid and selfish people in the world, or the propensity to change behavior in response to changing incentives.

On the other hand, I'm not sure how the incentives here will change. Any self-driving car is going to be speckled with cameras, and "I know it will slam on the brakes or swerve to avoid me" might not be much temptation when followed with "then it will send my picture to the police".

Comment author: Transfuturist 15 May 2014 06:48:08PM 0 points [-]

Aaaaand now you brought privacy controversy into the mix.

Comment author: Luke_A_Somers 16 May 2014 01:42:18AM 1 point [-]

In a completely reasonable way. If your driving strategy involves making problems for other people, that's intrinsically a non-private activity.

Comment author: Lumifer 14 May 2014 06:05:52PM *  5 points [-]

acting inappropriately around self-driving cars, knowing it will avoid them, even if it causes it to crash.

Ah, an interesting possibility. Self-driving cars can be gamed. If I know a car will always swerve to avoid me, I can manipulate it.

Comment author: Nornagest 14 May 2014 05:35:44PM *  2 points [-]

I doubt if self-driving cars would have to choose between crashing into two vehicles often enough for these considerations to show up in statistics.

Comment author: Lumifer 14 May 2014 03:42:23PM 2 points [-]

Conventional mortality would dictate that the car minimize global loss of life

I don't know about that. "Conventional morality" is not a well-formed or a coherent system and there are a lot of situations where other factors would override minimizing loss of life.

Comment author: Cube 14 May 2014 03:47:37PM -1 points [-]

What kind of things override loss of life and and can be widely agreed upon?

Comment author: Lumifer 14 May 2014 04:00:00PM *  2 points [-]

What kind of things override loss of life and and can be widely agreed upon?

Going to war, for example.

Or consider involuntary organ harvesting.

Comment author: Eugine_Nier 20 May 2014 03:14:26AM 2 points [-]

In the self-driving car example, say "getting to your destination". Keep in mind that the mere act of the car getting out on the road increases the expected number of resulting deaths.

Comment author: DanielLC 15 May 2014 09:44:55PM 0 points [-]

The lives each car would have the most effect on would be those inside of it.

I disagree. The driver of a car is much less in danger than a pedestrian.

Comment author: RowanE 24 May 2014 03:23:19PM 1 point [-]

No one pedestrian is more likely to die as a result of an accident involving a particular car than the owner of that car, though, which I think is what Cube meant.

Comment author: DanielLC 25 May 2014 12:02:41AM 0 points [-]

True, but that doesn't change the fact that if you're at risk of crashing into a pedestrian, your car will act to save the pedestrian, rather than you.