TheOtherDave comments on Reply to Holden on 'Tool AI' - Less Wrong

94 Post author: Eliezer_Yudkowsky 12 June 2012 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (348)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vaniver 18 July 2012 10:01:54PM 3 points [-]

I can't speak for anyone else, but I expect that a sufficiently well designed intelligence, faced with hard choices, makes them. If an intelligence is designed in such a way that, when faced with hard choices, it fails to make them (as happens to humans a lot), I consider that a design failure.

The level of executive function required of normal people to function in modern society is astonishingly high by historical standards. It's not surprising that people have a lot of "above my pay grade" reactions to difficult decisions, and that decision-making ability is highly variable among people.

Comment author: TheOtherDave 18 July 2012 10:50:08PM 6 points [-]

100% agreed.

I have an enormous amount of sympathy for us humans, who are required to make these kinds of decisions with nothing but our brains. My sympathy increased radically during the period of my life when, due to traumatic brain injury, my level of executive function was highly impaired and ordering lunch became an "above my pay grade" decision. We really do astonishingly well, for what we are.

But none of that changes my belief that we aren't especially well designed for making hard choices.

It's also not surprising that people can't fly across the Atlantic Ocean. But I expect a sufficiently well designed aircraft to do so.

Comment author: jacoblyles 18 July 2012 11:29:11PM 2 points [-]

It's interesting that we view those who do make the tough decisions as virtuous - i.e. the commander in a war movie (I'm thinking of Bill Adama). We recognize that it is a hard but valuable thing to do!