You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

timtyler comments on LW is to rationality as AIXI is to intelligence - Less Wrong Discussion

2 Post author: XiXiDu 06 March 2011 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (44)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 08 March 2011 08:26:06AM *  0 points [-]

Making a computable approximation Solomonoff induction that can be used repeatedly is essentially the same problem as building a stream compressor.

There is quite a bit of existing work on that problem - and it is one of my current projects.

Comment author: Pavitra 08 March 2011 05:55:02PM 1 point [-]
Comment author: timtyler 08 March 2011 09:23:48PM 0 points [-]

I don't understand the question. Can you explain what was wrong with the answer I just gave?

Comment author: Pavitra 08 March 2011 09:27:26PM 2 points [-]

The question is: please recommend a model of rationality that a human can actually use in the real world. It's not clear to me in practice how I would use, say, gzip to help make predictions.

Comment author: timtyler 08 March 2011 09:41:11PM *  0 points [-]

Right, well, the link between forecasting and compression was gone over in this previously-supplied link. See also, the other introductory material on that site:

http://matchingpennies.com/machine_forecasting/

http://matchingpennies.com/introduction/

http://matchingpennies.com/sequence_prediction/

If you want to hear something similar from someone else, perhaps try:

http://www.mattmahoney.net/dc/rationale.html

Comment author: Pavitra 08 March 2011 09:58:00PM 1 point [-]

I understand the theoretical connection. I want a real-world example of how this theoretical result could be applied.

Comment author: timtyler 08 March 2011 10:36:21PM *  0 points [-]

An example of prediction using compression?

E.g. see Dasher. It uses prediction by partial matching.

Comment author: gwern 09 March 2011 02:36:37AM 0 points [-]

I also found this thesis, 'Statistical Inference through Data Compression', using gzip of all things, quite interesting. (Some half-related background.)

Comment author: Pavitra 08 March 2011 11:18:01PM 0 points [-]

That is indeed a correct answer to a reasonable interpretation of the question I asked. I thereby realize that I should have asked differently.

Where examples of rationality usage are given on LW, they tend to be of the straightforward decision-theoretic kind, such as solving the trolley problem; that is, rationality and studied and taught here is mostly about helping humans better make the kinds of decisions that tend to be made by humans.

Suppose I want to take an umbrella to work with me if and only if it will rain this afternoon. How might I go about deciding whether to take my umbrella? And, in particular, is running my own statistical analysis on the weather patterns in my local area over the past hundred years really a better choice than just turning on the weather channel?

Comment author: gwern 09 March 2011 02:33:13AM 0 points [-]

And, in particular, is running my own statistical analysis on the weather patterns in my local area over the past hundred years really a better choice than just turning on the weather channel?

Perhaps I am missing something, but the answer is obviously no. This follows from the usual humility and outside view arguments, and from more detailed inside view considerations like the following: the weather station has access to far more data than you over that time period, and has detailed recent data you do not, and can hire a weather statistics expert (or draw on such expertise) who will crush your predictions because they specialize in such problems.

Comment author: Pavitra 09 March 2011 03:52:45AM 0 points [-]

The answer was intended to be obviously no. I wished to refute the idea that esoteric mathematical models like prediction-as-data-compression translated directly into useful advice for the real world outside of a few highly technical cases.