You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

rwallace comments on Efficient Induction - Less Wrong Discussion

3 Post author: paulfchristiano 27 December 2010 10:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (25)

You are viewing a single comment's thread. Show more comments above.

Comment author: rwallace 29 December 2010 01:22:20AM 1 point [-]

An infinite sequence of algorithms converging on arbitrarily good polynomial error reduction? Fair enough, I certainly can't rule that out at this stage.

But I don't understand your last point: how can you pay only logarithmically for using a finer grid?

Comment author: paulfchristiano 29 December 2010 01:41:54AM 2 points [-]

The post had a concrete complexity measure, which pays logarithmically for a finer grid (that is, doubling the size of the universe is the same as adding one more bit of complexity). The point is, you can only afford to pay logarithmically in the size of the universe (if you want known physical theories to have good complexity as compared to stupid explanations for our observations). Making the grid twice as fine is just making the universe twice as large, so you only pay 1 more bit: the extra bit needed to describe the larger size of the universe. If you disagree with this then you probably disagree fundamentally with my approach. That is obviously valid; I don't really like my approach that much. But alternative approaches, like the speed prior, seem much worse to me.

Comment author: rwallace 29 December 2010 05:15:09AM 0 points [-]

Oh, sorry, yes, when your cost measure is complexity, then a finer grid incurs at most a logarithmic penalty, I agree. I also agreed the speed prior is a much worse approach -- I would go so far as to say it is flat-out falsified by the observed extreme computational cost of physics.