You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Training Reflective Attention

21 BrienneYudkowsky 21 December 2014 12:53PM

Crossposted at Agenty Duck

And somewhere in the back of his mind was a small, small note of confusion, a sense of something wrong about that story; and it should have been a part of Harry's art to notice that tiny note, but he was distracted. For it is a sad rule that whenever you are most in need of your art as a rationalist, that is when you are most likely to forget it. —HPMOR, Ch. 3

A rationalist’s art is most distant when it is most needed. Why is that?

When I am very angry with my romantic partner, what I feel is anger. I don’t feel the futility of throwing a tantrum, or the availability of other options like honest communication, or freewriting, or taking a deep breath. My attention is so narrowly focused on the object of my anger that I’m likely not even aware that I’m angry, let alone that my anger might be blinding me to my art.

When her skills are most needed, a rationalist is lost in an unskillful state of mind. She doesn’t recognize that it’s happening, and she doesn’t remember that she has prepared for it by learning and practicing appropriate techniques.

I've designed and exercise that trains a skill I call reflective attention, and some call mindfulness. For me, it serves as an anchor in a stormy mind, or as a compass pointing always toward a mental state where my art is close at hand.

Noticing that I am lost in an unskillful state of mind is a separate skill. But when I do happen to notice—when I feel that small, small note of confusion—reflective attention helps me find my way back. Instead of churning out even more pointless things to yell at my partner, it allows me to say, “I am angry. I feel an impulse to yell. I notice my mind returning over and over to the memory that makes me more angry. I’m finding it hard to concentrate. I am distracted. I have a vague impression that I have prepared for this.” And awareness of that final thought allows me to ask, “What have I trained myself to do when I feel this way?”

The goal of the following exercise is to practice entering reflective attention.

It begins with an instruction to think of nothing. When you monitor yourself to make sure you’re not having any thoughts, your attention ends up directed toward the beginnings of thoughts. Since the contents of consciousness are always changing, maintaining focus on the beginnings of thoughts prevents you from engaging for an extended period with any particular thought. It prevents you from getting “lost in thought”, or keeping attention focused on a thought without awareness of doing so. The point is not actually to be successful at thinking nothing, as that is impossible while conscious, but to notice what happens when you try.

Keeping your focus on the constant changes in your stream of consciousness brings attention to your experience of awareness itself. Awareness of awareness is the anchor for attention. It lets you keep your bearings when you’d otherwise be carried away by a current of thought or emotion.

Once you’re so familiar with the feeling of reflection that creating it is a primitive action, you can forget the introductory part, and jump straight to reflective attention whenever it occurs to you to do so.


This will probably take around five minutes, but you can do it for much longer if you want to.

Notice what your mind is doing right now. One thing it’s doing is experiencing sensations of black and white as you read. What else are you experiencing? Are there words in your inner monologue? Are there emotions of any kind?

Spend about thirty seconds trying not to think anything. When thirty seconds is up, stop trying not to think, and read on.

.

.

.

What’s happening in your mind is constantly changing. Even when you were trying not to think, you probably noticed many times when the stillness would shift and some new thought would begin to emerge in conscious awareness.

Turn your attention to those changes. When a new thought emerges in consciousness, see if you can notice the exact moment when it happens, becoming aware of what it feels like for that particular change to take place.

If it helps at first, you can narrate your stream of consciousness in words: “Now I’m seeing the blue of the wall, now I’m hearing the sound of a car, now I’m feeling cold, now I’m curious what time it is…” You’ll probably find that you can’t narrate anywhere near quickly enough, in part because thoughts can happen in parallel, while speech is serial. Once narrating starts to become frustrating, stop slowing yourself down with words, and just silently observe your thoughts as they occur.

If you’re finding this overwhelming because there are too many thoughts, narrow your focus down to just your breathing, and try to precisely identify the experience of an exhale ending and an inhale beginning, of an inhale ending and an exhale beginning. Keep doing that until you feel comfortable with it, and then slowly expand your attention a little at a time: to other experiences associated with breathing, to non-breath-related bodily sensations, to non-tactile sensations from your environment, and finally to internal mental sensations like emotions.

If you notice an impulse to focus your attention on a particular thought, following it and engaging with it—perhaps you notice you feel hungry, and in response you begin to focus your attention on planning lunch—instead of letting that impulse take over your attention, recognize it as yet another change in the activity of your mind. If you’re narrating, say, “now I’m feeling an impulse to plan my lunch”, and keep your focus broad enough to catch the next thought when it arises. If you realize that you’ve already become lost in a particular thought, notice that realization itself as a new thought, and return to observing your stream of consciousness by noticing the next new thought that happens as well.

.

.

.

You might need to practice this many times before you get the hang of it. I suggest trying it for ten minutes to half an hour a day until you do.

Once you feel like you can recognize the sensation of reflective attention and enter that state of mind reliably given time, begin to train for speed. Instead of setting a timer for fifteen minutes or however long you want to practice, set it to go off every minute for the first half of your practice, spending one minute in reflective attention, and one minute out. (Don’t do this for all of your practice. You still need to practice maintenance.) When you can consistently arrive in reflective attention by the end of the minute, cut the intervals down to 45 seconds, then thirty, fifteen, and five.


In real life, the suspicion that you may be lost in an unskillful state of mind will be quiet and fleeting. “Quiet” means you’ll need to learn to snap your attention to the slightest hint of that feeling. For that, you’ll need to train “noticing”. “Fleeting” means you’ll need to be able to respond in less than five seconds. You’ll need to begin the process in less than one second, even if it takes a little longer to fully arrive in reflective attention. For that, training for speed is crucial.

Human Memory: Problem Set

13 BrienneYudkowsky 31 October 2013 04:08AM

I'm working on a post about how best to use human memorywhen it's good to store things in your own brain and why, when it's best to outsource your memory, what memory upgrades are worthwhile in what contexts, and how to integrate and apply memory systems in real life. I'm hoping the following set of memory problems will draw out approaches that haven't occurred to me so I can compare a wider range of methods.

I'll post the first solutions I thought of myself later on, but for now I'd like to hear what you would do in each of these situations and what you believe to be the pros and cons of your answers. Can you think of ways to improve upon your first thoughts and the answers of others?

(You don't have to respond to all of the questions; feel free to post as little or as much as comes to mind.)


continue reading »

Book Suggestion: "Diaminds" is worth reading (CFAR-esque)

1 MarkL 03 May 2013 12:19AM

The reason for this submission is that I don't think anyone who visits this website will ever read the book described below, otherwise. And that's a shame.

Simply stated, I think CFAR curriculum designers and people who like CFAR's approach should check out this book:

Diaminds: Decoding the Mental Habits of Successful Thinkers by Mihnea Moldoveanu

I claim that you will find illustrations of high-utility thinking styles and potentially useful exercises within. Yes, I am attempting to promote some random, highly questionable book to your attention.

You contemptuously object:

Stay with me.

Moldeveanu has a "secret identity" as a successful serial entrepreneur (first company sold for $21 million). And, he explicitly discusses the disadvantages of his book, his lack of experimental design, selection bias, explanation versus prediction, etc. The only grounds for his claim of having decoded the mental habits of successful thinkers is that he's done a lot of reading, thinking, and doing, and he has a bunch of interview transcripts of successful people. ("Interview transcripts?!")

You might have more objections:
  • If you dig around a little bit online you'll see that the second author writes highly rated popular business books.
  • If you read a little bit of the book, you'll hear a lot about Nicholas Nassim Taleb, black swans, poorly justified claims about how the mind uses branching tree searches, and other assorted suspicious physical, mathematical, and computational analogies for how the mind works.
  • He even asserts that "death is inevitable" (or something like that) in the introduction. *Gasp!*
Finally, you're thinking:
  • "There are 65 million titles out there. What are the chances that this particular crackpot book will be useful to me or CFAR?"
Stay with me.

Ok, still here? I think if you read this book you will continuously oscillate between swiftly-rising-annoyed-skepticism and hey-that's-uncommonly-smart-and-concisely-useful-and-I-could-try-that.

The exercises are not the sole value of the book, but here are some quickly assembled examples:

"Pick a past event that has been precisely recorded (for good example, a significant rise or fall in the price of the stock you know something about). Write down what you believe to be the best explanation for the event. How much would you bet on the explanation being valid, and why? Next, make a prediction based on your explanation (another movement in the stock's value within a certain time window). How much would you bet on the prediction being true, and why? Are the two sums equal? Why or why not?"

"Pick a difficult personal situation[....] In written sentences, describe the situation the way you typically would when talking about it with a friend or family member. Next, figure out -- and write down -- the basic causal structure of the narrative you've written up. [...E]xpand the range of causal chains you believe were at work. [...]"

"[... G]etting an associate to give you feedback, especially cutting, negative feedback, is not easy [...]. So arm her with a deck of file cards, on each of which is written one of the following in capital letters: WHY?, FOR WHAT PURPOSE?, BY WHAT MECHANISM?, SO WHAT?, I DISAGREE! I AGREE! [...]"

"Keep a record of your thinking process as you go through the steps of trying to solve [these problems]. [...] When you've finished, go through the transcript you've produced and 'encode it' using the coding language (mentalese) we have developed in this chapter. Your coding system should include the following simplified typology: The problem complexity class (easy/hard); The solution search process you used (deterministic/probabilistic); The type of solution your mind is searching for (global/local/adaptive); Your perceived distance from the answer to the problem at several different points in the problem-solving process. [...]"

Those were just some snippets that were easy to type up. Most of the exercises are meatier, and he doesn't just say "write down causal structure" without any context. There is buildup if not hand-holding. There's plenty of cognitive bias-flavored stuff, debiasing stuff, mental-model-switching stuff, OODA loop-type stuff, and much more.

Anyway, Moldoveanu tries to describe tools to change how people think. I think he succeeds, in concreteness and concision, at least, more than anything I've ever read on the subject, so far. I'm not saying this is a masterpiece; it's turgid and a little poisonous, like some PUA stuff. And it's uneven. And, I personally am not making any of the exercises a priority in my life, nor am I saying you should. But you might find helpful ideas in here for your personal experiments, and I think CFAR curriculum designers would probably benefit from reading this book.

You can burn through a first pass of the book in a long evening. It's short enough to do so. Chapter 1 (as opposed to the Preface, Praeludium, and Chapter 6) is probably the best thing to read for deciding whether to keep reading. But go back and read the Preface and Praeludium.

Needed: A large database of statements for true/false exercises

3 Academian 13 April 2012 02:26AM

Does anybody know where to find a large database of statements that are roughly 50% likely to be true or false?  These would be used for confidence calibration / Bayesian updating exercises for CMR/HRP.

One way to make such a database would be to buy a bunch of trivia games with True/False questions, and type each statement and its negation into a computer.  A problem with this might be that trivia questions are selected to have surprising/counterintuitive truth values; I'm not sure if that's true.  I'd be happy to acquire an already-made database of this form, but ideally I'd like statements that are "more neutral" in terms of how counterintuitive they are.

Any thoughts on where we might find a database like this to use/buy?

Thanks for any help!

Revision: We actually want a database of two-choice answer questions. This way, the player won't get trained on a base rate of 50% of statements in the world being true... they'll just get trained that when there are two possible answers, one is always true.  In the end, the database should look something like this (warning: I made up the "correct" answers):

Question: "Which is diagnosed more often in America (2011)?"; 
Answers: (a) "the cold", (b) allergies"; 
Correct Answer: (a); 
Tags: {medical}

Question: "Which city has a higher average altitude?"; 
Answers: (a) "Chicago", (b) "Las Vegas"; 
Correct Answer: (a)
Tags: {geography}

Question: "Who sold more albums while living"?; 
Answers: (a) "Michael Jackson", (b) "Elvis Presley"; 
Correct Answer: (b)
Tags: {history, pop-culture, music}

Question: "Was the price of IBM stock higher or lower at the start of the month after the Berlin wall fell, compared with the start of the previous month?"; 
Answers: (a) "higher", (b) "lower"; 
Correct Answer: (a)
Tags: {history, finance}

 

 

Making Beliefs Pay Rent (in Anticipated Experiences): Exercises

28 RobinZ 17 April 2011 03:31PM

The following is a series of exercises designed to test one's understanding of "Making Beliefs Pay Rent (in Anticipated Experiences)", a post in the Mysterious Answers to Mysterious Questions sequence by Eliezer Yudkowsky.

continue reading »