JoachimSchipper comments on SotW: Check Consequentialism - Less Wrong

38 Post author: Eliezer_Yudkowsky 29 March 2012 01:35AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (311)

You are viewing a single comment's thread. Show more comments above.

Comment author: duckduckMOO 28 March 2012 08:23:12PM *  5 points [-]

Why is teaching people to think like consequentialists a good idea again? Serious question.

If they're (relatively successful) mathematicians and programmers I don't see how it could go wrong but I'm awfully worried about some of the rest of the population. Specifically people not being able to sustain it without letting other things slip.

second edit: I should clarify. It's teaching the habit that I'm thinking about. Everyone should be able to think like a consequentialist but is instilling these reflexes gonna be a net positive?

Comment author: JoachimSchipper 29 March 2012 07:27:56AM 1 point [-]

Umm, are you under the impression that (the non-mathematical-ish part of the population/anyone) is constantly operating near their sustainable cognitive maxima? So near that adding a nearly-automatic reflex would push them over?

Neither looking around nor introspection suggests that that is true.

Comment author: scav 29 March 2012 08:19:58AM 5 points [-]

Indeed. That would imply that our shared goal of raising the sanity waterline would cause most of the population to drown :)

Mind you, I like that the OP is asking what the consequences would be. However my guess is: more people making slightly better decisions some of the time, and with no obvious mechanism for "letting other things slip", I don't see a downside.

Comment author: AspiringKnitter 04 April 2012 03:39:18AM *  0 points [-]

What if the problem isn't that it's too cognitively taxing, but that, applied in the sloppy way most people apply their heuristics, it could lead to irrational choices or selfish behavior?

Comment author: scav 04 April 2012 08:19:39AM 1 point [-]

People already make irrational choices. I don't think teaching them one way to mitigate that could make things worse. What's the opposite of status quo bias? I might have some of that, whatever it is :)

Comment author: handoflixue 03 April 2012 12:22:38AM 0 points [-]

That would imply that our shared goal of raising the sanity waterline would cause most of the population to drown :)

Upvoted because I rather like that phrasing :)