You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

The Up-Goer Five Game: Explaining hard ideas with simple words

29 RobbBB 05 September 2013 05:54AM

xkcd's Up-Goer Five comic gave technical specifications for the Saturn V rocket using only the 1,000 most common words in the English language.

This seemed to me and Briénne to be a really fun exercise, both for tabooing one's words and for communicating difficult concepts to laypeople. So why not make a game out of it? Pick any tough, important, or interesting argument or idea, and use this text editor to try to describe what you have in mind with extremely common words only.

This is challenging, so if you almost succeed and want to share your results, you can mark words where you had to cheat in *italics*. Bonus points if your explanation is actually useful for gaining a deeper understanding of the idea, or for teaching it, in the spirit of Gödel's Second Incompleteness Theorem Explained in Words of One Syllable.

As an example, here's my attempt to capture the five theses using only top-thousand words:

  • Intelligence explosion: If we make a computer that is good at doing hard things in lots of different situations without using much stuff up, it may be able to help us build better computers. Since computers are faster than humans, pretty soon the computer would probably be doing most of the work of making new and better computers. We would have a hard time controlling or understanding what was happening as the new computers got faster and grew more and more parts. By the time these computers ran out of ways to quickly and easily make better computers, the best computers would have already become much much better than humans at controlling what happens.
  • Orthogonality: Different computers, and different minds as a whole, can want very different things. They can want things that are very good for humans, or very bad, or anything in between. We can be pretty sure that strong computers won't think like humans, and most possible computers won't try to change the world in the way a human would.
  • Convergent instrumental goals: Although most possible minds want different things, they need a lot of the same things to get what they want. A computer and a human might want things that in the long run have nothing to do with each other, but have to fight for the same share of stuff first to get those different things.
  • Complexity of value: It would take a huge number of parts, all put together in just the right way, to build a computer that does all the things humans want it to (and none of the things humans don't want it to).
  • Fragility of value: If we get a few of those parts a little bit wrong, the computer will probably make only bad things happen from then on. We need almost everything we want to happen, or we won't have any fun.

If you make a really strong computer and it is not very nice, you will not go to space today.

Other ideas to start with: agent, akrasia, Bayes' theorem, Bayesianism, CFAR, cognitive bias, consequentialism, deontology, effective altruism, Everett-style ('Many Worlds') interpretations of quantum mechanics, entropy, evolution, the Great Reductionist Thesis, halting problem, humanism, law of nature, LessWrong, logic, mathematics, the measurement problem, MIRI, Newcomb's problem, Newton's laws of motion, optimization, Pascal's wager, philosophy, preference, proof, rationality, religion, science, Shannon information, signaling, the simulation argument, singularity, sociopathy, the supernatural, superposition, time, timeless decision theory, transfinite numbers, Turing machine, utilitarianism, validity and soundness, virtue ethics, VNM-utility

What truths are actually taboo?

5 sunflowers 16 April 2013 11:40PM

LessWrong has been having fun lately with posts about sexism, racism, and academic openness.   And here just like everywhere else, somebody inevitably claims taboo status for any number of entirely obvious truths, e.g. "top level mathematicians and physicists are almost invariably male," "black people have lower IQ scores than white people," and "black people are statistically more criminal than whites."  In my experience, these are not actually taboo, and I think my experience is generalizable.  I'll illustrate.

You're at a bar and you meet a fellow named Bill.  Bill's a nice guy, but somehow the conversation strayed Hitler-game style to World War II.  Bill thinks the war was avoidable.  Bill thinks the Holocaust would not have happened were it not for the war, and that some of the Holocaust was a reaction to actual Jewish subterfuge and abuse.  Bill thinks that the Holocaust was not an essential, early plan of the Nazis, because it only happened after the war began.  Bill thinks that the number of casualties has been overestimated.  Bill claims that Allied abuses, e.g. the bombing of Dresden, have been glossed over and ignored, while fantastic lies about Jews being systematically turned into soap have propagated.  Bill thinks that the Holocaust has become a sort of national religion, abused by self-interested Jews and defenders of Zionist foreign policy, and that the freedom of those who doubt it is under serious attack. Bill starts listing other things he's not allowed to say. Bill doesn't think that the end of slavery was all that good for "the blacks," and that the negatives of busing and forced integration have often outweighed the positives.  Bill has personally been the victim of black-on-white crimes and racism.  Bill is a hereditarian.  Bill doesn't think that dropping an n-bomb should ruin a public career.

Here's the problem:  everything Bill has said is either true, a matter of serious debate, or otherwise a matter of high likelihood and reasonableness.  Yet you feel nervous.  Perhaps you're upset.  That's the power of taboo, right?  Society is punishing truth-telling!  First they came for the realists... Rationalists, to arms!

Or.

We can recognize that statements like these correlate with certain false beliefs and nasty sentiments of the sort that actually are taboo.  It's just like when somebody says, "well science doesn't know everything."  To this, I think, "duh, and you're probably a creationist or medical quack or something similarly credible."  Or when somebody says, "the government lies to us."  To this, I think, "obviously, and you're likely a Truther or something."  Bill is probably an anti-Semite, but Bill doesn't just say, "I'm an anti-Semite," because that really is taboo.  He might even believe that he shouldn't be considered something awful like an anti-Semite.  Bill probably doesn't think Bill so unpleasant.

That's the paradox:  "taboo" statements like black crime statistics are to some extent "taboo" for sound, rationalist reasons. But "taboo" is not taboo:  it's about context.  People who think that such statements are taboo are probably bad at communicating, and people often think they're racists and misogynists because they probably are on good rationalist grounds.  If you want to talk about statistical representatives on the topic of race, be ready to understand that those who are listening will have background knowledge about the other views you might hold.

All this is the leadup to my question:  what highly probable or effectively certain truths are genuinely taboo?  I'm trying to avoid answers like "there are fewer women in mathematics" or "the size of my penis," since these are context sensitive, but not really taboo within a reasonable range of circumstances.  I'm also not particularly interested in value commitments or ideologies.  Yes, employers will punish labor organizers and radical political views can get you filtered.  But these aren't clear matters of fact.  I also don't mean sensitive topics like abortion or religion, nor do I mean "taboo within a political party."

Is there really anything true that we simply cannot say?  I have the US in mind especially, but I'm interested in other countries as well.  I'm sure there are things that deserve the label, but I've found that the most frequently given examples don't hold water.  I think hereditarianism is a close contender, but it's not an "obvious truth."  Rather, my understanding is that it is a serious position.  It's also only contextually taboo.  If it were a definitive finding, it could perhaps become taboo, though I think it more likely that it would be somewhat reluctantly accepted.

Any suggestions?  If we find some really serious examples, we might figure out a way to talk about them.