Vaniver comments on The autopilot problem: driving without experience - Less Wrong

23 Post author: Stuart_Armstrong 13 May 2013 12:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread.

Comment author: Vaniver 13 May 2013 02:14:43PM *  5 points [-]

Firstly, if the automation performs flawlessly, the overseers will become complacent, blindly trusting the instruments and failing to perform basic sanity checks. They will have far less procedural understanding of what's actually going on, since they have no opportunity to exercise their knowledge.

There's a related problem in manufacturing whose name I've forgotten, but basically, the less frequent defective parts are, the less likely it is human quality control people will notice defective parts, because their job is more boring and so they're less likely to be paying attention when a defective part does happen. (Conditioned on the part being defective, of course.)

Comment author: shminux 13 May 2013 04:13:00PM *  13 points [-]

Right, one of the original solutions, though rarely implemented, is to add a steady stream of defective parts to guarantee optimal human attention. These artificially defective parts are marked in a way that lets them to be automatically separated and recycled later, should any slip by the human QA.

Comment author: Stuart_Armstrong 13 May 2013 04:57:06PM 2 points [-]

They apparently do this in airport x-rays - inject an image of a bag with a gun, to see if the observer reacts.

Comment author: shminux 13 May 2013 05:07:04PM 4 points [-]

But apparently not for keeping pilots alert in flight... A "Fuel pressure drop in engine 3!" drill exercise would probably not, umm, fly.

Comment author: Stuart_Armstrong 13 May 2013 05:10:39PM 0 points [-]

There might be other ways - you could at least do it on simulators, or even on training flights (with no passengers).

Comment author: shminux 13 May 2013 05:35:42PM *  -1 points [-]

Surely they already do that. The trick is not knowing whether an abnormal input is a drill or not, or at least not knowing when a drill might happen. All these issues have been solved in the military a long time ago.

Comment author: Decius 14 May 2013 03:09:59AM *  0 points [-]

Knowing when a drill might happen improves alertness during the drill period only. Drills do develop and maintain the skills required to respond to a non-standard situation.

Comment author: maia 13 May 2013 08:10:55PM 1 point [-]

Wow. That's an really cool example of careful design, taking humans into account as well as technical issues.

Comment author: shminux 13 May 2013 08:16:35PM 3 points [-]

Yeah, I was equally impressed when one of my instructors at the uni explained the concept, some decades ago, as an aside while teaching CPU design.

Comment author: RichardKennaway 13 May 2013 02:38:03PM 2 points [-]

I've heard that in proof-reading, optimal performance is achieved when there are about 2 errors per page.

Comment author: SilasBarta 14 May 2013 05:47:55AM *  1 point [-]

I've heard that when you play mouse-chasing-themed games with your cat, the maximal cat fun is achieved when there are between 1 and 2 successes for every 6 pounces.

Comment author: falenas108 13 May 2013 04:25:58PM -1 points [-]

Optimal performance may be maximized, but the output isn't.

I would be surprised if there were less overall errors in the final product if it started at 2 per page, rather than say 1/4 per page.

This is also valid against the suggestion in the OP. Although humans will catch more errors if there are more to begin with, that doesn't mean there will be less failures overall.

Comment author: shminux 13 May 2013 04:41:49PM 6 points [-]

As I mentioned in my other comment, if some of the errors are injected to keep the attention at the optimal level, and then removed post-QA, the other errors are removed with better efficiency. As an added benefit, you get an automated and reliable metric of how attentive the proof-reader is.