timtyler comments on LW is to rationality as AIXI is to intelligence - Less Wrong

2 Post author: XiXiDu 06 March 2011 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 08 March 2011 09:41:11PM *  0 points [-]

Right, well, the link between forecasting and compression was gone over in this previously-supplied link. See also, the other introductory material on that site:

http://matchingpennies.com/machine_forecasting/

http://matchingpennies.com/introduction/

http://matchingpennies.com/sequence_prediction/

If you want to hear something similar from someone else, perhaps try:

http://www.mattmahoney.net/dc/rationale.html

Comment author: Pavitra 08 March 2011 09:58:00PM 1 point [-]

I understand the theoretical connection. I want a real-world example of how this theoretical result could be applied.

Comment author: timtyler 08 March 2011 10:36:21PM *  0 points [-]

An example of prediction using compression?

E.g. see Dasher. It uses prediction by partial matching.

Comment author: gwern 09 March 2011 02:36:37AM 0 points [-]

I also found this thesis, 'Statistical Inference through Data Compression', using gzip of all things, quite interesting. (Some half-related background.)

Comment author: Pavitra 08 March 2011 11:18:01PM 0 points [-]

That is indeed a correct answer to a reasonable interpretation of the question I asked. I thereby realize that I should have asked differently.

Where examples of rationality usage are given on LW, they tend to be of the straightforward decision-theoretic kind, such as solving the trolley problem; that is, rationality and studied and taught here is mostly about helping humans better make the kinds of decisions that tend to be made by humans.

Suppose I want to take an umbrella to work with me if and only if it will rain this afternoon. How might I go about deciding whether to take my umbrella? And, in particular, is running my own statistical analysis on the weather patterns in my local area over the past hundred years really a better choice than just turning on the weather channel?

Comment author: gwern 09 March 2011 02:33:13AM 0 points [-]

And, in particular, is running my own statistical analysis on the weather patterns in my local area over the past hundred years really a better choice than just turning on the weather channel?

Perhaps I am missing something, but the answer is obviously no. This follows from the usual humility and outside view arguments, and from more detailed inside view considerations like the following: the weather station has access to far more data than you over that time period, and has detailed recent data you do not, and can hire a weather statistics expert (or draw on such expertise) who will crush your predictions because they specialize in such problems.

Comment author: Pavitra 09 March 2011 03:52:45AM 0 points [-]

The answer was intended to be obviously no. I wished to refute the idea that esoteric mathematical models like prediction-as-data-compression translated directly into useful advice for the real world outside of a few highly technical cases.