gwern comments on Open thread, July 16-22, 2013 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (297)
While reading a psychology paper, I ran into the following comment:
Besides the obvious connection to Schmidhuber's esthetics, it occurred to me that this has considerable relevance to LW/OB. Hanson in the past has counseled contrarians like us to pick our battles and conform in most ways while not conforming in a few carefully chosen ones (eg Dear Young Eccentric, Against Free Thinkers, Even When Contrarians Win, They Lose); this struck me as obviously correct, and that one could think of oneself as having a "budget" where non-conforming on both dress and language and ideas blows one's credit with people / discredits oneself.
This idea about familiarity suggests a different way to think of it is in terms of novelty and familiarity: ideas like existential risk are highly novel compared to regular politics or charities. But if these ideas are highly novel, then they are likely "distrusted and hard to process" (which certainly describes well many people's reaction to things on LW/OB), and any additional novelty like that of vocabulary or formatting or style, is more likely to damage reception or perhaps push readers past some critical limit than if applied to some standard familiar boring thing like evolution, where due to sufficient familiarity, idiosyncratic or novel aspects will not damage reception but instead improve reception. Consider the different reactions to Nick Bostrom and Eliezer Yudkowsky, who write about many of the same exact ideas and problems - but no one put on Broadway plays or YouTube videos mocking Bostrom or accusing him of being a sinister billionaire's tool in a plot against all that is good and just - while on the other hand, Hofstadter's GEB is dearly beloved for its diversity of novel forms and expressions, even if it's all directed toward exposition on pretty standard unshocking topics like Godel's theorems or GOFAI.
This line of reasoning suggests a simple strategy for writing: the novelty of a story or essay's content should be inverse to the novelty of its form.
If one has highly novel, perhaps even outright frightening ideas, about the true nature of the multiverse or the future of humanity, the format should be as standard and dry as possible. Conversely, if one is discussing settled science like genetics, one should spice it up with little parables, stories, unexpected topics and applications, etc.
Does this predict success of existing writings? Well, let's take Eliezer as an example, since he has a very particular style of writing. Three of his longest fictions so far are the Ultra Mega Crossover, "Three Worlds Collide", and MoR. Keeping in mind that the former were targeted at OB and the last at a general audience on FF.net, they seem to fit well: the Crossover was confusing in format, introduced many obscure characters or allusions, in service of a computationally-oriented multiverse that only really made sense if you had already read Permutation City, and so is highly novel in form & content, so naturally no one ever mentions it or recommends it to other people; "Three Worlds Collide" took a standard SF opera short-story style with stock archetypes like "the Captain", and saved its novelty for its meta-ethical content and world-building, and accordingly, I see it linked and discussed both on LW and off; MoR, as fanfiction, adapts a world wholesale, reducing its novelty considerably for millions of people, and inside this almost-"boring" framework introduces its audience to a panoply of cognitive biases, transhuman tropes like anti-deathism, existential risks, the scientific method, Bayesian-style reasoning, etc, and MoR has been tremendously successful on and off LW (I saw someone recommend it yesterday on HN).
Of course this is just 3 examples, but it does match the vibe I get reading why people dislike Eliezer or LW: they seem to have little trouble with his casual informal style when it's being applied to topics like cognitive biases or evolution where the topic is familiar to relatively large numbers of people, but then are horribly put off by the same style or novel forms when applied to obscurer topics like subjective Bayesianism (like the Bayesian Conspiracy short stories - actually, especially the Conspiracy-verse stories) or cryonics. Of course, I suppose this could just reflect that more popular topics tend to be less controversial and what I'm actually noticing is people disliking marginal minority theories, but things like global warming are quite controversial and I suspect Eliezer blogging about global warming would not trigger the same reaction as to, say, his "you're a bad parent if you don't sign kids up for cryonics" post that a lot of people hate.
Have I seen this "golden mean" effect in my own writing? I'm not sure. Unfortunately, my stuff seems to generally adopt a vaguely academic format or tone in proportion to how mainstream a topic is, and a great deal of traffic is driven by interest in the topic and not my work specifically; so for example, my Silk Road page is not in any particularly boring format but interest in the topic is too high for that to matter either way. It's certainly something for me to keep in mind, though, when I write about stranger topics.
Useful enough to be a discussion post.
Some more discussion:
Idiosyncrasy credit
(But the cited research in the Examples section seem weak, and social psychology isn't the most reliable area of psychology in the first place.)
(From the standard errors & shuffled results, the decline in revenue from 0.8 to 1.0 happens very fast, so one probably wants to undershoot novelty and avoid the catastrophic risk of overshoot.)
"The Shazam Effect: Record companies are tracking download and search data to predict which new songs will be hits. This has been good for business—but is it bad for music?"
Were they a LW user? Every once in a while I'll be surprised when someone links a LW article, only to see that it's loup-valliant.
I don't remember. It might've been a LW user.
Why is that so? The end of the world is a strong element in major religions and is a popular theme in literature and movies. The global warming meme made the idea that human activity can have significant planet-wide consequences be universally accepted.
Existential risk due to astronomical or technological causes, as opposed to divine intervention, is pretty novel. No one thinks global warming will end humanity.
If you're well familiar with the idea of the world ending, the precise mechanism doesn't seem to be that important.
I think what's novel is the idea that humans can meaningfully affect that existential risk. However that's a lower bar / closer jump than the novelty of the whole idea of existential risk.
"If you're familiar with the idea of Christians being resurrected on Judgment Day, the precise mechanism of cryonics doesn't seem to be that important."
"If you're familiar with the idea of angels, the precise mechanism of airplanes doesn't seem to be that important."
For the purpose of figuring out whether an idea is so novel that people have trouble comprehending it, yes, familiarity with the concept of resurrection is useful.
People are familiar with birds and bats. And yes, the existence of those was a major factor in accepting the possibility of heavier-than-air flight and trying to develop various flying contraptions.
Katja offers 8 models of weirdness budgets in "The economy of weirdness"; #1 seems to fit best the psychology and other research.
Some anecdotal discussion of the dislike of (too much) creativity:
See also Schank's Law.