TheOtherDave comments on The Least Convenient Possible World - Less Wrong

165 Post author: Yvain 14 March 2009 02:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (186)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nanashi 10 February 2015 01:48:17PM *  1 point [-]

I find this method to be intellectually dangerous.

We do not live in the LCPW, and constantly considering ethical problems as if we do is a mind-killer. It trains the brain to stop looking for creative solutions to intractable real world problems and instead focus on rigid abstract solutions to conceptual problems.

I agree that there is a small modicum of value to considering the LCPW. Just like there's a small modicum of value to eating a pound of butter for dinner. It's just, there are a lot better ways to spend ones time. The proper response to "Well, what about the LPCW?" is, "How do you know we are in the LCPW?" I think there is far more value in having a conversation that explores our assumptions about a difficult problem rather than indulges them.

Q: Consider the Sick Villager problem. How do we know that the patients won't die due to transplant rejection? A: Oh, well, Omega says so. Q: Okay. So, how do we know Omega is right? A: Because Omega is omniscient. Q: If Omega is omniscient, why can't it tell us how to grow working organs without need for human sacrifice? A: Because there are limits to how much it knows. Q: Ok, so if I knew in advance that Omega is omniscient but has these limitations, why on earth am I working in a village helping 10 villagers instead of working on advancing Omega to the point where it doesnt have those limitations. (And if I don't know this in advance, why would I suddenly start believing some random computer that claims it is Omega?) A: I don't know, because it's the LCPW.

That conversation yields a lot more intellectual value; it trains you to think creatively and explore all possible solutions, rather than devise a single heuristic that is only applicable in a 5d-corner case. As I indicated above, it can actually be dangerous because novice rationalists may feel compelled to apply that narrow heuristic to situations where a more optimal, creative solution is present.

Comment author: TheOtherDave 10 February 2015 08:38:16PM 1 point [-]

I agree that insisting on assuming the LCPW is a lousy strategic approach to most real-world situations, which (as you say) don't normally occur in the LCPW. And I agree that assuming it as an analytical stance towards hypothetical situations increases the chance that I'll adopt it as a strategic approach to a real-world situation, and therefore has some non-zero cost.

That said, I would also say that a one-sided motivated "exploration" of a situation which happens to align with our pre-existing biases about that situation has some non-zero cost, for basically the same reasons.

The OP starts out by objecting to that sort of motivated cognition, and proposes the LCPW strategy as a way of countering it. You object to the LCPW strategy, but seem to disregard the initial problem of motivated cognition completely.

I suspect that in most cases, the impulse to challenge the assumptions of hypothetical situations does more harm than good, since motivated cognition is pretty pervasive among humans.

But, sure, in the rare case of a thinker who really does "explore assumptions about a difficult problem" rather than simply evade them, I agree that it's an exercise that does more harm than good.

If you are such a thinker and primarily engage with such thinkers, that's awesome; whatever you're doing, keep it up!