Eliezer_Yudkowsky comments on Stuff That Makes Stuff Happen - Less Wrong

51 Post author: Eliezer_Yudkowsky 18 October 2012 10:49AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (127)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 18 October 2012 01:03:12AM 4 points [-]

So... the main thing I want to convey over and above "exercise" is that rather than there being a straightforward task-to-solve, you're supposed to ponder the statement and say, "What do I think of this?"

A word other than "koan" which conveys this intent-to-ponder would indeed be appreciated.

Comment author: Kindly 18 October 2012 02:04:23AM 8 points [-]

What about "riddle" or "puzzle"?

Comment author: Manfred 18 October 2012 07:47:54PM *  2 points [-]

The only trouble I see is that "koan" makes it totally okay to think about it for a while without finding the answer, while "puzzle" might cause people to propose solutions.

Comment author: Kaj_Sotala 19 October 2012 05:59:07AM 2 points [-]

Given that most people seem likely to look at the koan and think "yeah, I could solve that if I thought about it for a while" and then move on without actually thinking about it, anything that actually gets people to think about it seems like a good thing.

Comment author: Manfred 19 October 2012 03:18:55PM 2 points [-]

The only trouble is if people then have to unthink things, which humans are notoriously bad at :P

Comment author: Kindly 18 October 2012 09:21:24PM 1 point [-]

People have already been proposing solutions to the "koans", and I don't understand why that's a bad thing.

Comment author: DaFranker 18 October 2012 09:35:48PM -1 points [-]

The goal is to apply those algorithms we call "rationality" towards solving the koan, one of which involves withholding even just mentally formulating solutions as much as possible, and instead just thinking about the elements and properties of the problem properly without subjecting oneself to hack heuristics.

The word puzzle is, for most people, loaded with a trained impulse to shoot the first solution-sounding thing that pops to mind so that you can see whether you get a hedon / tribal status coin for a good answer or not.

Comment author: Kindly 18 October 2012 10:23:15PM 0 points [-]

Alright. I see where you're coming from, though I doubt that "puzzle" and "koan" have as many deep connotations as you claim.

Maybe the right thing to do is to actually write something to the effect of "Here is how you should be approaching these puzzles/koans"?

Comment author: Jayson_Virissimo 18 October 2012 12:15:09PM 1 point [-]

What about "riddle" or "puzzle"?

"Puzzle" is good because it suggests that there is a solution, whereas some "problems" don't have solutions, because they are simply confused.

Comment author: DaFranker 18 October 2012 08:18:40PM 0 points [-]

However, the trained behavior of most people when facing a puzzle is to look at it for a few seconds and then throw the first good-sounding solution you can think of.

Comment author: Kaj_Sotala 19 October 2012 06:01:06AM 1 point [-]

Which isn't necessarily a bad thing. Either they'll get a right answer despite throwing the first possible solution at it, or they'll widely miss the mark, in which case they might actually realize that they've learned something by the time that the right answer is demonstrated.

Comment author: DaFranker 19 October 2012 02:24:05PM 2 points [-]

You have a point. My (subconscious) priors on that end are skewed towards "Never, ever throw out solutions before you've laid things out properly" because of lots and lots of little personal experiences with complete failure modes due to stopping with the first solution I found.

Comment author: MaoShan 18 October 2012 02:28:12AM *  6 points [-]

I don't think "noodle" is taken, yet.

Comment author: Eliezer_Yudkowsky 18 October 2012 02:40:22AM 4 points [-]

Hm. I like the direction this points. Any similar suggestions?

Comment author: [deleted] 18 October 2012 04:13:03AM 11 points [-]

Meditation.

Comment author: Eliezer_Yudkowsky 22 October 2012 05:31:57AM 7 points [-]

Your suggestion has been... accepted!

Comment author: [deleted] 22 October 2012 06:39:35AM 0 points [-]

Huzzah!

Comment author: MaoShan 19 October 2012 03:08:03AM 3 points [-]

You could use "udon" instead of "noodle" to make it sound foreign and mysterious ;)

Comment author: Doriana_Mandrelli 18 October 2012 12:51:27PM 3 points [-]

The word "pabulum" (from Latin for "fodder") was once used in English to mean "food for thought". However, it (or "pablum") is now more likely to denote insipid fare. We could reclaim the original meaning—in which case these statements-to-be-pondered are "pabula".

Comment author: shminux 19 October 2012 03:37:28AM *  1 point [-]

Consider adding "straightforward" exercises for the lesser mortals, and mark the harder ones, (koans?) with stars, like the standard textbooks do.

Comment author: lsparrish 20 October 2012 07:01:57PM 0 points [-]

"Pondering exercise" maybe?

Interesting that "pondering" is a cognitive skill that needs exercised. The term derives from a latin term for "weight". Perhaps this can be thought of as something analogous to barbells or dumbells for epistemological strength-training.

Comment author: [deleted] 20 October 2012 08:20:41PM 0 points [-]

Perhaps this can be thought of as something analogous to barbells or dumbells for epistemological strength-training.

I like the way you think. Care to elaborate?

Comment author: lsparrish 20 October 2012 10:56:49PM *  1 point [-]

Pondering means thinking about something in a way that makes it "heavy" or difficult for the mind to process (just as heavy objects are difficult to lift). Like the metaphorical "burden of proof," it references mental difficulty of processing ideas to physical difficulty in lifting objects. The way this happens involves increasing the complexity of your mental instantiation of an idea, thereby bringing more cognitive algorithms to bear on it.

The strength-training metaphor only works if it can be contrasted with endurance-training. Otherwise it would just be a generic kind of training. Strength training involves shorter bursts of focused effort followed by a recovery period. These koans are short and intended for 5-15-minutes of focused thought, so they are probably more on that end of the spectrum than lengthier articles that describe complex concepts.

Epistemological endurance training (assuming there is such a thing) would be where you use longer periods of time thinking about a problem that has a fair degree of mental effort required but not overwhelming. That would analogize to running, biking, and so forth where rather than doing the hardest thing you can do, you are doing something rather hard for a longer time.

Comment author: [deleted] 21 October 2012 01:58:51AM 0 points [-]

Ooops I miscommunicated. I think the surface analogy isn't the most interesting part of this.

I was more interested in what ideas you had for training epistemological ability. The burst vs endurance thing could be interesting if it could be detailed in on its own terms (ie. inside view instead of analogizing).

I've been thinking a lot about rationality training recently, so anything that looks like a possible excercise really catches my attention.

Comment author: lsparrish 21 October 2012 03:23:35AM 0 points [-]

So it must have been "pondering as a rationality skill" which got your attention. Sorry for misinterpreting. :)

For me it's not hard to ponder. I do that naturally. But I don't always ponder exactly what I'm told to ponder, even when I have every reason to think the person who told me to ponder something knows what they're talking about and this is something that if I ponder it I will benefit from the resulting enlightenment. It's like there is something in the nature of pondering that is perverse and rebellious (at least for the way my mind works, some of the time).

Perhaps a good exercise would be to deliberately ponder specific things that you aren't (yet) naturally curious about. Maybe set a timer and commit to only focus on that particular topic until the timer goes off. I wonder what an optimal time length would be? Also, what kinds of topics could/should be used for the exercise?