You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Coscott comments on [LINK] Utilitarian self-driving cars? - Less Wrong Discussion

7 Post author: V_V 14 May 2014 01:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread.

Comment author: Coscott 14 May 2014 08:41:57PM 7 points [-]

I think a less contrived question is "Should a self driving car minimize travel time for you or all people on the road?"

Comment author: V_V 14 May 2014 09:12:59PM *  2 points [-]

A personal or privately operated self-driving car should probably minimize the passenger travel time as this probably best aligns with the customer's and, in a reasonably competitive market, the manufacturer's interests.
The crash case is more complicated because there are ethical and legal liability issues.

Comment author: kilobug 15 May 2014 08:17:36AM 7 points [-]

I think there is a confusion going on there. Should reflect to what is ethical, what would be the best option, and I don't see how the manufacturer’s interests really matter for that. Self-driving cars should cooperate with each other in various prisoner's dilemma, not defect with each other, and more generally, they should behave in a way to smooth traffic globally (which at the end of the year would lead to less traffic time for everyone if all cars do so), not behave selfishly and minimize the passenger's travel time.

Now, in a competitive market, due to manufacturer's interests, it is indeed unlikely they would do so. But that is different from should. That's a case of pure market leading to a suboptimal solution (as often with Nash equilibrium), but there might be ways to fix it, either from manufacturers negotiating with each others outside the market channel to implement more globally efficient algorithms (like many standard bodies do), or through the state imposing it to them (like EU imposing the same charger for all cell phones).

Of course there are drawbacks and potential pitfall with all those solutions, but that's a different matter than the should issue.

Comment author: DanielLC 15 May 2014 09:38:45PM 0 points [-]

What if a company makes a large number of cars? Would they make cars that minimize travel time for their occupants, or for all people who buy cars from that company? Would multiple companies band together, and make cars that minimize travel time for everyone who buys cars from any of those companies?

Comment author: private_messaging 16 May 2014 07:08:19AM *  0 points [-]

They'd all band together and create a regulatory agency which ensures everyone's doing that. This is what happens in other industries, and this is what happens in car manufacturing.