You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Manfred comments on Thought experiments on simplicity in logical probability - Less Wrong Discussion

5 Post author: Manfred 20 August 2014 05:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 22 August 2014 12:43:18AM *  1 point [-]

Thanks for linking to your own proposal! I'm posting this before actually digesting it, so I may reply again later.

I agree that I'm tunneling on the mutually exclusive and exhaustive case, and the characterization "simpler sentences have probabilities closer to 1/2" is an accurate characterization of Abram's scheme. I'm not so sure about Paul's - I'm pretty sure it's not minimizing a weighted entropy, but a cross-entropy, which tries to make the probability proportional to the pre-prior.

As for other examples, there are a variety of more dilletantish cases (though I'm not really one to talk, of course) of people just trying to port Solomonoff induction on sentences or on models, and similar proposals of things like decreasing probability as a function of logical depth (example).

I'd defend my focus on mutually exclusive and exhaustive sets by saying that they show up everywhere and are always a basis we can use to represent knowledge. For example, if I had a list of 7 sentences and knew that exactly 5 were true, I can completely characterize my knowledge by probabilities of the 7 choose 5 mutually exclusive and exhaustive possibilities.

That said, it's certainly possible there are things I'm missing because of this focus.