Another month has passed and here is a new rationality quotes thread. The usual rules are:
- Please post all quotes separately, so that they can be upvoted or downvoted separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
- Do not quote yourself.
- Do not quote from Less Wrong itself, Overcoming Bias, or HPMoR.
- No more than 5 quotes per person per monthly thread, please.
I acknowledge & respect this criticism, but for two reasons I maintain Simon had a worthwhile insight(!) here that bears on rationality:
Insight, intuition & recognition aren't quite the same, but they overlap greatly and are closely related.
Simon's comment, although not literally true, is a fertile hypothesis that not only opens eyeholes into the black boxes of "insight" & "intuition", but produces useful predictions about how minds solve problems.
I should justify those. Chapter 4 of Simon's The Sciences of the Artificial, "Remembering and Learning: Memory as Environment for Thought", is relevant here. It uses chess as a test case:
The seemingly mysterious insights & intuitions of the chessmaster derive from being able to recognize many memorized patterns. This conclusion applies to more than chess; Simon's footnote points to a champion backgammon-playing program based on pattern recognition, and a couple of pages before that he refers to doctors' reliance on recognizing many features of diseases to make rapid medical diagnoses.
From what I've seen this even holds true in maths & science, where people are raised to the level of geniuses for their insights & intuitions. Here's cousin_it noticing that Terry Tao's insights constitute series of incremental, well-understood steps, consistent with Tao generating insights by recognizing familiar features of problems that allow him to exploit memorized logical steps. My conversations with higher ability mathematicians & physicists confirm this; when they talk through a problem, it's clear that they do better than me by being better at recognizing particular features (such as symmetries, or similarities to problems with a known solution) and applying stock tricks they've already memorized to exploit those features. Stepping out of cognitive psychology and into the sociology & history of science, the near ubiquity of multiple discovery in science is more evidence that insight is the result of external cues prompting receptive minds to recognize the applicability of an idea or heuristic to a particular problem.
The reduction of insight & intuition to recognition isn't wholly watertight, as you note, but the gains from demystifying them by doing the reduction more than outweigh (IMO) the losses incurred by this oversimplification. There are also further gains because the insight-is-intuition-is-recognition hypothesis results in further predictions & explanations:
Prediction: long-term practice is necessary for mastery of a sufficiently complicated domain, because the powerful intuition indicative of mastery requires memorization of many patterns so that one can recognize those patterns.
Prediction: consistently learning new domain-specific patterns (so that one can recognize them later) should, with a very high probability, engender mastery of that domain. (Putting it another way: long-term practice, done correctly, is sufficient for mastery.)
Explanation of why "[i]n a couple of domains [chess and classical music composition] where the matter has been studied, we do know that even the most talented people require approximately a decade to reach top professional proficiency" (TSotA, p. 91).
Prediction: "When a domain reaches a point where the knowledge for skillful professional practice cannot be acquired in a decade, more or less, then several adaptive developments are likely to occur. Specialization will usually increase (as it has, for example, in medicine), and practitioners will make increasing use of books and other external reference aids in their work" (TSotA, p. 92).
Prediction: "It is probably safe to say that the chemist must know as much as a diligent person can learn in about a decade of study" (TSotA, p. 93).
Explanation of Eliezer's experience with being deep: the people EY spoke to perceived him as deep (i.e. insightful) but EY knew his remarks came from a pre-existing system of intuitions (transhumanism and knowledge of cognitive biases) which allowed him to immediately respond to (or "complete") patterns as he recognized them.
Explanation of how intensive childhood training produced some famous geniuses and domain experts (the Polgár sisters, William James Sidis, John Stuart Mill, Norbert Wiener).
Prediction: "This accumulation of experience may allow people to behave in ways that are very nearly optimal in situations to which their experience is pertinent, but will be of little help when genuinely novel situations are presented" ("On How to Decide What to Do", p. 503).
Prediction: one can write a computer program that plays a game or solves a problem by mechanically recognizing relevant features of the input and making cached feature-specific responses.
I know I've gone on at length here, but your criticism deserved a comprehensive reply, and I wanted to show I wasn't just being flippant when I quoted Simon. I agree he was hyperbolic, but I reckon his hyperbole was sufficiently minor & insightful as to be RQ-worthy.
Independent of whether the particular quote is labelled a rationality quote, Simon had an undeniable insight in the linked article and your explanation thereof is superb! To the extent that this level of research, organisation and explanation seems almost wasted on a comment. I'll look forward to reading your future contributions (be they comments or, if you have a topic worth explaining, posts).