Wei_Dai comments on Rationality: Appreciating Cognitive Algorithms - Less Wrong

37 Post author: Eliezer_Yudkowsky 06 October 2012 09:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (134)

You are viewing a single comment's thread.

Comment author: Wei_Dai 07 October 2012 05:03:30AM 6 points [-]

When Anna tells me, "I'm worried that you don't seem very curious about this," there's this state of mind called 'curiosity' that we both agree is important - as a matter of rational process, on a meta-level above the particular issue at hand - and I know as a matter of process that when a respected fellow rationalist tells me that I need to become curious, I should pause and check my curiosity levels and try to increase them.

Having someone who would occasionally point out deficiencies in one's rational processes sounds awesome. Do you think it is possible for LWers to perform this service for each other on this forum, or does it require much closer interactions and/or intimate knowledge?

(It seems like the real meat of this post is in the second half, but a lot of people, including myself, got distracted by problems in the first half.)

Comment author: Vaniver 07 October 2012 11:28:54PM 6 points [-]

Do you think it is possible for LWers to perform this service for each other on this forum, or does it require much closer interactions and/or intimate knowledge?

So, one of the easiest ways to detect curiosity is to notice things like posture and demeanor- which seems difficult to do over a text-based channel! I have noticed that online comments telling me "I think you're suffering from bias X" have seemed more like arguments than observations, whereas similar statements in person can be more like observations than arguments.

Comment author: gwern 08 October 2012 12:37:09AM 2 points [-]
Comment author: TheOtherDave 07 October 2012 05:28:10AM 2 points [-]

There are people on this site whose thinking I respect enough that, were they to say something of this sort to me, I would at least acknowledge that I ought to re-evaluate the process that got me to where I am, despite their having not much intimate knowledge about me. (There are also people in my real life who have that property.)

Whether I would actually do it is a much more complicated and contingent question.

Comment author: Wei_Dai 07 October 2012 06:52:24AM *  3 points [-]

I was asking more about the sending side of the advice rather than the receiving side. How do I debug someone else's rationality processes using just the information I can get from their posts and comments on LW? (Assuming they are not a newbie with really obvious flaws, but closer to Eliezer's level.)

Comment author: TheOtherDave 07 October 2012 06:58:38AM 2 points [-]

Hm.
Are you asking "how could I tell that someone else isn't being rational?" or "how could I communicate to someone else that they aren't being rational in such a way that they'd benefit from it?" or something else?

Comment author: Wei_Dai 07 October 2012 08:40:56PM 4 points [-]

Are you asking "how could I tell that someone else isn't being rational?" or "how could I communicate to someone else that they aren't being rational in such a way that they'd benefit from it?" or something else?

Something else: I can sometimes tell that someone else on LW isn't being rational but can't see which part of their rationality process is broken, or not sufficiently activated. (Communicating this to them may also be a problem but wasn't the one I specifically had in mind.) I'm wondering if Eliezer thinks it is possible to do this over LW. Perhaps others have better skills for this than I do, or we should just try harder?

Comment author: TheOtherDave 08 October 2012 01:52:34AM 0 points [-]

Ah, gotcha. Yes, that makes sense; thanks for clarifying.

Comment author: Peterdjones 08 October 2012 12:38:50PM 0 points [-]

It is certainly possible, it happens, and it generally results in the point-er losing karma. At leat when the point-er suggests all the answers might not be found in the Sequences.

Comment author: fortyeridania 01 November 2012 04:33:45PM 0 points [-]

I assume you are employing hyperbole. Nevertheless, I think your comment is unfair. Even just on LW, lots of great stuff isn't included in the Sequences. Moreover, people here regularly recommend materials (e.g., books) other than the Sequences.

Comment author: Peterdjones 01 November 2012 04:49:41PM 0 points [-]
Comment author: fortyeridania 01 November 2012 04:26:49PM 0 points [-]

Do you think it is possible for LWers to perform this service for each other on this forum, or does it require much closer interactions and/or intimate knowledge?

This could have perverse consequences, because "You don't seem very curious about this" seems like a criticism.

In my case anyway, having an irrationality-cop would have two effects. First, it would motivate me to avoid the criticism by being more rational (like it does for Eliezer). Second, it would motivate me to avoid the criticism by hiding my irrationality better. The latter effect would be bad, because then both the cop and I would overestimate my level of rationality. (Why would I, too, overestimate it? Because I'd hide my failures from myself as well, in an unconscious effort to hide them from others more effectively.)

I think the fundamental issue here is that I dread criticism. (Solutions to this problem include exposure therapy and CBT.) People for whom this is less of a hurdle are likely to benefit more from having an irrationality-cop.