XiXiDu comments on What math is essential to the art of rationality? - Less Wrong

16 Post author: Capla 15 October 2014 02:44AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread.

Comment author: XiXiDu 15 October 2014 09:27:13AM *  9 points [-]

I am not sure about the prerequisites you need for "rationality" but take a look at the following courses:

(1) Schaum's Outline of Probability, Random Variables, and Random Processes:

The background required to study the book is one year calculus, elementary differential equations, matrix analysis...

(2) udacity's Intro to Artificial Intelligence:

Some of the topics in Introduction to Artificial Intelligence will build on probability theory and linear algebra.

(3) udacity's Machine Learning: Supervised Learning :

A strong familiarity with Probability Theory, Linear Algebra and Statistics is required.

My suggestion is to use khanacademy.org in the following order: Precalculus->Differential calculus->Integral calculus->Linear Algebra->Multivariable calculus->Differential equations->Probability->Statistics.

If you prefer books:

  1. Free precalculus book
  2. The Calculus Lifesaver
  3. A First Course in Linear Algebra (is free and also teaches proof techniques)
  4. Calculus On Manifolds: A Modern Approach To Classical Theorems Of Advanced Calculus
  5. Ordinary Differential Equations (Dover Books on Mathematics)
  6. Schaum's Outline of Probability, Random Variables, and Random Processes
  7. Discovering Statistics Using R

Statistics comes last, here is why. Take for example the proof of minimizing squared error to regression line. You will at least need to understand how to solve partial derivatives and systems of equations.

(Note: Books 4-7 are based on my personal research on what to read. I haven't personally read those particular books yet. But they are praised a lot and relatively cheap and concise.)

Comment author: buybuydandavis 16 October 2014 12:12:15AM *  4 points [-]

Jaynes Draft of "Probability Theory:The Logic of Science". http://www-biba.inrialpes.fr/Jaynes/prob.html

Bretthorst's slightly edited version. http://thiqaruni.org/mathpdf9/(86).pdf

EDIT: If anyone knows how to fix that link, please ping me with a solution.

Comment author: 9eB1 17 October 2014 07:06:02PM *  1 point [-]

Although the link is broken, the file doesn't exist anymore. According to comments here Jaynes' publishers took the book down. For your edification, one would normally escape parentheses with "URL encoding" by replacing the opening parenthesis with %28 and the closing parenthesis with %29.

Comment author: 9eB1 19 October 2014 05:14:40AM 0 points [-]
Comment author: buybuydandavis 18 October 2014 06:29:11PM *  -1 points [-]

That seems rather tedious for blog comments.

Why doesn't \ work as an escape character here?

This section in the FAQ about escapes and links just doesn't seem to work as advertised: http://wiki.lesswrong.com/wiki/FAQ#How_do_I_make_a_comment.3F

Links: [link text](link URL)
Note that URLs with parentheses often come out wrong - type a backslash ("\") before each close-paren to fix these.

http://thiqaruni.org/mathpdf9/\(86\).pdf

http://thiqaruni.org/mathpdf9/(86\).pdf

[http://thiqaruni.org/mathpdf9/(86\).pdf] ( http://thiqaruni.org/mathpdf9/(86\).pdf)

Maybe if I put some text in between? The first one below is the same as the previous one above, where the text and url have a carriage return between them. The second removes the carriage return so it is all on one line. The third removes the backslash in the url portion.

[http://thiqaruni.org/mathpdf9/(86\).pdf] ( http://thiqaruni.org/mathpdf9/(86\).pdf)

<http://thiqaruni.org/mathpdf9/(86\>).pdf.pdf)

<http://thiqaruni.org/mathpdf9/(86>).pdf.pdf)

Comment author: 9eB1 19 October 2014 05:15:28AM *  0 points [-]

Yes, that does seem to work for me. I think you must be typing it wrong somehow. Or it's some crazy bug.

Edit: I see, the problem is when it looks for links to automatically promote them if you don't use Markdown syntax. I guess escaping the parenthesis doesn't work there.

Should look like this:

[http://thiqaruni.org/mathpdf9/(86\).pdf](http://thiqaruni.org/mathpdf9/(86\).pdf)

http://thiqaruni.org/mathpdf9/(86).pdf

You don't actually have to escape the close parenthesis in the "link text" park of the Markdown (in square brackets), only in the URL part (in parentheses).

Comment author: Capla 16 October 2014 10:38:14PM *  2 points [-]

Thank you. Having a ready made "course sequence" that I can then adapt, is really helpful.

I appreciate having Khan academy for looking up math concept that on which I need a refresher, but I've heard (or maybe just assumed?) that the higher level teaching was a bit mediocre. You disagree? I'm fully prepared to update on the estimates of people here.

What's the value of taking classes in math vs. teaching myself (or maybe teaching myself with the occasional help of a tutor)?

Comment author: XiXiDu 17 October 2014 08:54:53AM *  3 points [-]

I appreciate having Khan academy for looking up math concept that on which I need a refresher, but I've herd (or maybe just assumed?) that the higher level teaching was a bit mediocre. You disagree?

Comparing Khan Academy's linear algebra course to the free book that I recommended, I believe that Khan Academy will be more difficult to understand if you don't already have some background knowledge of linear algebra. This is not true for the calculus course though. Comparing both calculus and linear algebra to the books I recommend, I believe that Khan Academy only provides a rough sketch of the topics with much less rigor than can be found in books.

Regarding the quality of Khan Academy. I believe it is varying between excellent and mediocre. But I haven't read enough rigorous material to judge this confidently.

The advantage of Khan Academy is that you get a quick and useful overview. There are books that are also concise and provide an overview, often in the form of so called lecture notes. But they are incredible difficult to understand (assume a lot of prerequisites).

As a more rigorous alternative to Khan Academy try coursera.org.

What's the value of taking classes in math vs. teaching myself (or maybe teaching myself with the occasional help of a tutor)?

I've never visited a class or got the help of a tutor. I think you can do just fine without one if you use Google and test your knowledge by buying solved problem books. There are a lot of such books:

Some massive open online courses now offer personal tutors if you pay a monthly fee. udacity.com is one example here.

I also want to add the following recommendations to my original sequence, since you specifically asked about Bayesian statistics:

  1. Bayes' Rule: A Tutorial Introduction to Bayesian Analysis
  2. Doing Bayesian Data Analysis: A Tutorial with R and BUGS (new version will be released in November)
Comment author: Capla 18 October 2014 03:57:20PM 0 points [-]

Thanks!