You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

TylerJay comments on Self-Study Questions Thread - Less Wrong Discussion

12 Post author: TylerJay 29 January 2014 01:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (66)

You are viewing a single comment's thread.

Comment author: TylerJay 29 January 2014 01:45:37AM 4 points [-]

A few questions that I've had recently:

  1. Do you really need multivariable calculus for probability theory?
  2. Would taking a traditional statistics course be a good place to start learning statistics and probability theory, or do they tend to teach a "bad frequentist mindset" that later has to be unlearned?
  3. Is Cormen et al. suitable as an introductory algorithms text?

I've seen differing opinions on this one, so I wanted to make it a poll:

Is Jaynes suitable as an introductory probability theory textbook?

Submitting...

Comment author: Qiaochu_Yuan 29 January 2014 03:45:06AM 4 points [-]
  1. "Probability theory" is an extremely broad term. You don't need any calculus to understand discrete random variables (and if your motivation is directed towards MIRI research, this is mostly the kind of probability that's relevant). You'll want to know some one-variable calculus to understand continuous random variables (so you can manipulate probability density functions and maybe characteristic functions). It would be helpful to be comfortable with some multivariable integral calculus for the purpose of understanding collections of continuous random variables, but something like Stokes' theorem won't be particularly relevant.

  2. My impression is that most traditional statistics courses are very bad (not even because of anything to do with frequentism, they're just very bad). Don't take one.

  3. Can you clarify what you mean by this?

Comment author: TylerJay 29 January 2014 04:22:30AM 1 point [-]

Thanks, that's really helpful.

For #3, I was basically looking for some feedback on this text. It was recommended in the best textbooks on every subject thread, but I've heard mixed reviews about it. The top rated review on amazon claims

Students will need a very strong mathematical background and a strong arm to even think about picking up this book because the it is heavy (both physically and metaphorically). Mastery of discrete math is a must, graph theory, programming, and, combinatorics will also help.

and another review by a Comp Sci professor calls it "Magisterial, and Impenetrable".

These are not things you see written about something like Sedgewick's book. Interestingly enough, the reviews on this one all similarly praise Sedgewick's book over Cormen.

So I guess my question was "Is Cormen et al. actually a good introductory text on algorithms for someone who has not taken an algorithms course before?"

Comment author: Anatoly_Vorobey 29 January 2014 08:29:48AM 3 points [-]

The answer is "probably not". Cormen is too comprehensive and dry for self-study; it's best used as the textbook to back an algorithms course or as a reference to consult later on.

A very good book is Skiena, The Algorithm Design Manual. I usually recommend it to people who want to brush up on their algorithms before programming interviews, but I think it's accessible enough to a novice as well. Its strengths are an intelligent selection of topics and an emphasis on teaching how to select an algorithm in a real-life situation.

Comment author: Qiaochu_Yuan 29 January 2014 05:28:04AM 1 point [-]

Ah, sorry, I was referring to your question about Jaynes (that question was meant to be numbered with a 4). What are you looking to get out of an introductory probability textbook?

Comment author: gjm 29 January 2014 10:03:57AM 0 points [-]

How much of a mathematician are you? I would recommend Cormen et al on its own only to people with a strong mathematical background and plenty of talent. I like the idea of Cormen et al + Skiena together (and I'm pretty sure I said so in that thread) but don't have actual evidence on how well that works in practice.

Comment author: ThrustVectoring 29 January 2014 03:53:04AM 0 points [-]

My impression is that most traditional statistics courses are very bad (not even because of anything to do with frequentism, they're just very bad). Don't take one.

That's my impression as well. I've had to take a statistics course, and I wound up memorizing procedures enough to vomit it up on tests on homework. There wasn't really a coherent framework, so the least work method of passing the course was memorizing the teacher's passwords.

If you have to take a traditional statistics course, don't expect to get a solid understanding of statistics out of it. Perhaps you'll know how to use certain orthodox analysis methods.

Comment author: Stabilizer 29 January 2014 02:42:14AM 2 points [-]
  1. No.
  2. I don't know.
  3. Yes.
Comment author: solipsist 29 January 2014 03:35:56AM *  1 point [-]

Traditional statistics classes teach procedures, but not the math needed to understand them. Being told to use maths without being told how the maths work is infuriating to certain sorts of people, and those sorts of people are abnormally concentrated on LessWrong. Jaynes builds up procedures from first principles, which appeals to some but is pointlessly abstract for others.

Different minds learn differently. The answer to this poll entirely depends on who you are.

Comment author: AspiringRationalist 29 January 2014 04:38:27AM 0 points [-]

It is worth pointing out that probability and statistics are generally considered to be separate, although closely related topics. Because statistics is built on probability, you are probably better off learning probability first, and then statistics.