David_Chapman comments on Probability and radical uncertainty - Less Wrong

11 Post author: David_Chapman 23 November 2013 10:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: David_Chapman 24 November 2013 06:44:56PM 2 points [-]

Yes, I'm not at all committed to the metaprobability approach. In fact, I concocted the black box example specifically to show its limitations!

Solomonoff induction is extraordinarily unhelpful, I think... that it is uncomputable is only one reason.

I think there's a fairly simple and straightforward strategy to address the black box problem, which has not been mentioned so far...

Comment author: [deleted] 24 November 2013 11:34:10PM *  2 points [-]

Solomonoff induction is extraordinarily unhelpful, I think... that it is uncomputable is only one reason.

Because it's output is not human-readable being the other?

I mean, even if I've got a TARDIS to use as a halting oracle, an Inductive Turing Machine isn't going to output something I can actually use to make predictions about specific events such as "The black box gives you money under X, Y, and Z circumstances."

Comment author: David_Chapman 25 November 2013 12:13:14AM *  2 points [-]

Well, the problem I was thinking of is "the universe is not a bit string." And any unbiased representation we can make of the universe as a bit string is going to be extremely large—much too large to do even sane sorts of computation with, never mind Solomonoff.

Maybe that's saying the same thing you did? I'm not sure...

Comment author: torekp 26 November 2013 05:56:43PM 4 points [-]

Can you please give us a top level post at some point, be it in Discussion or Main, arguing that "the universe is not a bit string"? I find that very interesting, relevant, and plausible.

Comment author: David_Chapman 26 November 2013 08:08:49PM 1 point [-]

Thanks for the encouragement! I have way too many half-completed writing projects, but this does seem an important point.

Comment author: RichardKennaway 24 November 2013 11:20:58PM *  2 points [-]

Going back to the basic question about the black box:

What is the probability of its giving you $2?

Too small to be worth considering. I might as well ask, what's the probability that I'll find $2 hidden half way up the nearest tree? Nothing has been claimed about the black box to specifically draw "it will pay you $2 for $1" out of hypothesis space.

Comment author: David_Chapman 25 November 2013 12:01:29AM 3 points [-]

Hmm... given that the previous several boxes have either paid $2 or done nothing, it seems like that primes the hypothesis that the next in the series also pays $2 or does nothing. (I'm not actually disagreeing, but doesn't that argument seem reasonable?)

Comment author: RichardKennaway 25 November 2013 12:22:52PM 0 points [-]

it seems like that primes the hypothesis that the next in the series also pays $2 or does nothing

Priming a hypothesis merely draws it to attention; it does not make it more likely. Every piece of spam, every con game, "primes the hypothesis" that it is genuine. It also "primes the hypothesis" that it is not. "Priming the hypothesis" is no more evidence than a purple giraffe is evidence of the blackness of crows.

Explicltly avoiding saying that it does pay $2, and saying instead that it is "interesting", well, that pretty much stomps the "priming" into a stain on the sidewalk.

Comment author: linkhyrule5 25 November 2013 04:56:08PM 1 point [-]

.... purple giraffes are evidence of the blackness of crows, though. Just, really really terrible evidence.

Comment author: RichardKennaway 25 November 2013 05:13:52PM *  1 point [-]

Well, yes. As is the mere presence of the idea of $2 for $1 terrible evidence that the black box will do any such thing.

Eliezer speaks in the Twelve Virtues of letting oneself be as light as a leaf, blown unresistingly by the wind of evidence, but evidence of this sort is on the level of the individual molecules and Brownian motion of that leaf.

Comment author: Watercressed 25 November 2013 06:29:13PM 0 points [-]

It depends on your priors