cousin_it comments on Hardened Problems Make Brittle Models - Less Wrong

51 Post author: cousin_it 06 May 2009 06:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 07 May 2009 12:14:36AM *  3 points [-]

What's the goal of that controlled experiment? If my decision apparatus fails on Newcomb's problem or the "true PD", does it tell you anything about my real world behavior?

Comment author: SoullessAutomaton 07 May 2009 10:11:00AM 3 points [-]

It tells us that your real world behavior has the potential to be inconsistent.

Many people carry a decision apparatus that consists of a mess of unrelated heuristics and ad hoc special-cases. Examining extreme cases is a tool for uncovering places where the ad hoc system falls down, so that a more general system can be derived from basic principles, preferably before encountering a real world situation where the flaws in the ad hoc system become apparent.

To my mind, a better analogy than "controlled experiment" would be describing these as decision system unit tests.