Eliezer_Yudkowsky comments on The Shadow Question - Less Wrong

28 Post author: Alicorn 14 October 2009 01:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (45)

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 14 October 2009 02:14:34AM 0 points [-]

I did have to read (only) the first sentence before I got it. Do I get 15 geek points or 20?

Comment author: pjeby 14 October 2009 03:04:32AM 1 point [-]

I got it from the title alone, but skimmed right past the part of the introduction where points were being offered. Guess that means I'm still too unlucky minded!

Comment author: Alicorn 14 October 2009 12:15:25PM 0 points [-]

By "the first sentence" do you mean "This is part 2 of a sequence on problem solving", or "You have to be careful what you wish for"?

Comment author: Eliezer_Yudkowsky 14 October 2009 03:47:40PM 0 points [-]

The latter, of course.

Comment author: CronoDAS 14 October 2009 05:23:36AM 0 points [-]

I got the reference.

And I've never actually watched more than a couple of episodes of the show...

Comment author: wware 17 October 2009 03:30:46AM 0 points [-]

Ouch, I got it wrong. I thought it was talking about the radio program from my father's childhood. The tagline I had in mind was, "Who knows what evil lurks in the hearts of men? The Shadow knows." Yikes, dating myself.

The silly examples with the library book reminded me of the idea that if you're sitting on a local maximum of the fitness function, any direction you go is down. I think that's why these shadow questions are hard: they are asking you to change your status quo, which almost certainly means coming down (at least temporarily) from a local maximum. I suppose that's why smart people can sometimes seem so over-analytical about big changes. They're smart enough to already be sitting on a pretty good local maximum, and smart enough to recognize that any tradeoffs involved may be complicated.