LESSWRONG
LW

Comment Permalink
satt40

A disclaimer on Wolfram's A New Kind of Science: quite a few of the scientists who reviewed it weren't particularly enthusiastic. See for example Cosma Shalizi's review (of special interest to Less Wrong readers, perhaps, for the side comment on Jaynes towards the end! Edit: or maybe not; Shalizi's linked arXiv paper is probably wrong as p4wnc6 explains below). This webpage collects a lot of other reviews of the book as well.

Reply
[anonymous]30

It seems Shalizi's comments on Jaynes have been somewhat refuted. The paper claiming that subjective Bayes induces a backward arrow of time fails to account for the entropy generation inside the mind of the agent forming beliefs about the world. It requires energy to convert observations into states of belief, and hence increases entropy. Shalizi's argument does not account for this and (like many puffed-up "rebuttals" of Jaynes) fails for an essentially trivial reason. Shalizi is a great writer and thoughtful researcher, but just got things very very wrong on that occasion.

Reply
0[anonymous]
Thanks, I read it does a good job on cellular automata. And since that topic is mentioned quite often on LW I thought it would be a good addition to a extensive list capturing all background knowledge you might ever need for LW. ETA Updated
See in context
by cousin_it
1 min read
16

26

I just got a PM with this question: "What would be the minimum intellectual investment necessary to be able to fruitfully take part in the discussion of decision theory on LW?" This is not the first time I've been asked that. Our new discussion section looks like the perfect place to post my answer:

1) Learn enough game theory to correctly find Nash equilibria in 2x2 games all by yourself.

2) Learn enough probability theory to correctly solve Monty Hall, Monty Fall, Monty Crawl all by yourself.

3) Learn enough programming to write a working quine (in any language of your choice) all by yourself.

4) Learn enough logic to correctly solve the closing puzzle from Eliezer's cartoon guide.

Then you're all set. Should take you a few days if you've studied math before, a few weeks if you haven't. No special texts needed beyond Wikipedia and Google.

Logic & Mathematics Scholarship & Learning
Personal Blog

26

Mentioned in
Math prerequisites for understanding LW stuff
New Comment
16 comments, sorted by
top scoring
Click to highlight new comments since:
[-]XiXiDu280

A list capturing all background knowledge you might ever need for LW.

(Updated: 2010-10-08)

This list assumes a previous level of education above elementary schooling but less than secondary school. If you start with Khan Academy followed by BetterExplained then with the help of Google and Wikipedia you should be able to reach a level of education that allows you to start reading the LessWrong Sequences.

Nevertheless, before you start off you should read and memorize the Twelve Virtues of Rationality. Not only is scholarship just one virtue but you'll also be given a list of important fields of knowledge that anyone who takes LessWrong seriously should study:

It is especially important to eat math and science which impinges upon rationality: Evolutionary psychology, heuristics and biases, social psychology, probability theory, decision theory.

Mathematics:

Basics

Logic

Game Theory

Foundations

Programming:

Programming knowledge is not mandatory for LessWrong but you should however be able to interpret the most basic pseudo code as you will come across various snippets of code in discussions and top-level posts outside of the main sequences.

Python

Haskell

General

Computer sciences (General Introduction):

One of the fundamental premises on LessWrong is that a universal computing device can simulate every physical process and that we therefore should be able to reverse engineer the human brain as it is fundamentally computable. That is, intelligence and consciousness are substrate independent.

Machine Learning:

Not essential but an valuable addition for anyone who's more than superficially interested in AI and machine learning.

Miscellaneous:

Not essential but a good preliminary to reading LessWrong and in some cases mandatory to be able to make valuable contributions in the comments. Many of the concepts in the following works are often mentioned on LessWrong or the subject of frequent discussions.

Keywords:

Concepts and other fields of knowledge you should at least have a rough grasp of to be able to follow subsequent discussions in the comments on LessWrong.

The Quantum Physics Sequence

Complex Numbers:

Complex Numbers @ Khan Academy:

Note: This list is a work in progress. I will try to constantly update and refine it.

Reply
[-]satt40

A disclaimer on Wolfram's A New Kind of Science: quite a few of the scientists who reviewed it weren't particularly enthusiastic. See for example Cosma Shalizi's review (of special interest to Less Wrong readers, perhaps, for the side comment on Jaynes towards the end! Edit: or maybe not; Shalizi's linked arXiv paper is probably wrong as p4wnc6 explains below). This webpage collects a lot of other reviews of the book as well.

Reply
[-][anonymous]30

It seems Shalizi's comments on Jaynes have been somewhat refuted. The paper claiming that subjective Bayes induces a backward arrow of time fails to account for the entropy generation inside the mind of the agent forming beliefs about the world. It requires energy to convert observations into states of belief, and hence increases entropy. Shalizi's argument does not account for this and (like many puffed-up "rebuttals" of Jaynes) fails for an essentially trivial reason. Shalizi is a great writer and thoughtful researcher, but just got things very very wrong on that occasion.

Reply
[-][anonymous]00

Thanks, I read it does a good job on cellular automata. And since that topic is mentioned quite often on LW I thought it would be a good addition to a extensive list capturing all background knowledge you might ever need for LW.

ETA Updated

Reply
[-][anonymous]30

Add a backslash before the closing paren in the last link, Markdown choked on it. I'll delete my comment afterward.

Reply
[-][anonymous]20

I added a logic section now. For what I have no links is Game Theory. At least I don't know of any introductory works, free or else...but do you really need that for LW? What I noticed that is missing from the OP is knowledge of complex numbers since you'll need that to understand the The Quantum Physics Sequence.

Complex Numbers:

Complex Numbers @ Khan Academy:

Reply
[-]Vladimir_M130

Should take you a few days if you've studied math before, a few weeks if you haven't.

Do you seriously believe that someone who has never studied math before can understand Loeb's theorem and start solving puzzles in mathematical logic after a few weeks of study?! I can imagine that someone very smart could figure out (1)-(3) from scratch fairly quickly, but (4) strikes me as a much harder step. Also, mathy LW discussions often touch on quantum mechanics, various things in computability theory, and sundry other stuff where I don't see any easy way up (especially for QM).

In any case, here's a neat test for those who'd like to tackle step (1):
http://www.rasmusen.org/GI/_stest1/selftest1.htm

Reply
[-]cousin_it00

I don't think (4) is much harder than (3). Someone who's never programmed before will find (3) very hard. Still, a few weeks of dedicated work should do it. From my experience teaching math to kids, I think it's actually more difficult to go from zero to (1) and (2) than to go from those to (4), because the hard part is learning how to think rigorously at all.

There is no serious descussion of quantum mechanics (or physics in general) on LW. I'd be glad if there was. Likewise, there's almost no serious discussion of statistical inference (frequentism, Bayesianism and related topics), though we do have a handful of people who understand it.

Reply
[-]Vladimir_M60

cousin_it:

From my experience teaching math to kids, I think it's actually more difficult to go from zero to (1) and (2) than to go from those to (4), because the hard part is learning how to think rigorously at all.

That sure depends on what we consider to be "zero"!

I do know some very smart people for whom (1)-(3) would be a breeze, but who couldn't prove a theorem if their lives depended on it. (In my experience, lots of such people can be found among programmers and engineers.) I have the impression that quite a few people on LW are in a not too dissimilar position, in the sense that they could easily harness their general intelligence to develop the right intuitions for solving problems of the sorts (1)-(3) reliably, but training themselves for formal math would be a much harder step.

Maybe I'm also biased due to my own position. I can easily pass the tests (1)-(3) (out of curiosity, I just tried writing a quine in C -- I thought of the basic idea in about 5 minutes, and it took me 10-15 min. more to sort out the mess with the escape characters). But although I had a decent knowledge of the basics of math foundations some years ago (to the point where I was proving theorems in exams in graduate courses), scraping the rust off of it to the point where I could constructively contribute to the discussions here would require a significant time investment (which I still hope to do as time permits).

There is no serious descussion of quantum mechanics (or physics in general) on LW. I'd be glad if there was.

Lots of discussions here touch on MWI and make MWI-related assumptions. While one can grasp the basic idea of MWI without knowing the actual math of the quantum theory, such knowledge is pretty pointless, since it basically involves taking a controversial view on pure faith. (I am familiar with the basics of QM, but I don't think my knowledge is still anywhere near the level where it would make sense to stick my head out with judgments about such things.)

By the way, there is an interesting ongoing physics discussion, just in case you missed it:
http://lesswrong.com/lw/2sl/the_irrationality_game/2qiu

Reply
[-]cousin_it00

Thanks for the link! Of course, I can't understand any of it :-)

Reply
[-]XiXiDu-10

While one can grasp the basic idea of MWI without knowing the actual math of the quantum theory, such knowledge is pretty pointless, since it basically involves taking a controversial view on pure faith.

Are you going to claim that you believe into AI going FOOM based on the actual math? Why would you care about how founded MWI is if you accept the basic premise of risk from AI to an extent that you donate to some institute with Singularity in its name when not even gravitational singularities are proven beyond the point that people would ground a movement around them...

Reply
[-]Vladimir_M90

Also, here are some excellent online resources for those wiling to plunge into mathematical logic, math foundations, and computability theory:

  • A two-part online text by Karlis Podnieks: Introduction to Mathematical Logic and What is Mathematics: Gödel's Theorem and Around. Written in ugly plain text, and with some bits still incomplete, but on the upside, extremely well-written and probably as readable as a rigorous text on this topic could ever hope to be. (The text is also peppered with the author's philosophical opinions, but you can skip those if you don't like them.)

  • Stephen Cook's lecture notes in computability and logic. A rigorous build-up to Goedel's incompleteness theorems with minimal background knowledge assumed, which introduces the basics of mathematical logic and computability theory on the way. The text is very readable and surprisingly short considering the whole range of topics covered.

This could take a while to go through, but despite cousin_it's optimistic estimates, I would say that working through at least one of these texts would be necessary before you can discuss topics such as Loeb's theorem with any real understanding. If you've never studied math, or if you've studied it only in a very applied and non-theoretical way, the greatest problem will be getting used to the necessary way of thinking.

Reply
[-]cousin_it30

I usually recommend Gödel Without Tears. At least one person has used it to learn logic by my suggestion. Took them a couple weeks.

Reply
[-]Stuart_Armstrong00

Thanks for this list, it's most useful.

But one tricky thing about

4) Learn enough logic to correctly solve the closing puzzle from Eliezer's cartoon guide. is that he is asking one to find a flaw in a proof of a true statement. The proof is indeed flawed (one of the derivability conditions doesn't have the required properties), but statements such as "there is no proof of X" imply "PA is consistent" and hence "X".

Reply
[-]xamdam00

Good post, would be nice to know which posts/sequences each topic is related to, so they can be read after

Reply
Moderation Log
16Comments