Michaelos comments on Causal Universes - LessWrong

60 Post author: Eliezer_Yudkowsky 29 November 2012 04:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (385)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 28 November 2012 06:11:44AM 4 points [-]

Meditation:

Suppose you needed to assign non-zero probability to any way things could conceivably turn out to be, given humanity's rather young and confused state - enumerate all the hypotheses a superintelligent AI should ever be able to arrive at, based on any sort of strange world it might find by observation of Time-Turners or stranger things. How would you enumerate the hypothesis space of all the coherently-thinkable worlds we could remotely maybe possibly be living in, including worlds with Stable Time Loops and even stranger features?

Comment author: [deleted] 28 November 2012 08:37:31PM *  1 point [-]

Well, I appear to be somewhat confused. Here is the logic that I'm using so far:

If:

1: A hypothesis space can contain mathematical constants,

2: Those mathematical constants can be irrational numbers,

3: The hypothesis space allows those mathematical constants to set to any irrational number,

4: And the set of irrational numbers cannot be ennumerated.

Then:

5: A list of hypothesis spaces is impossible to enumerate.

So If I assume 5 is incorrect (and that it is possible to enumerate the list) I seem to either have put together something logically invalid or one of my premises is wrong. I would suspect it is premise 3 because it seems to be a bit less justifiable then the others.

On the other hand, it's possible premise 3 is correct, my logic is valid, and this is a rhetorical question where the answer is intended to be "That's impossible to enumerate."

I think the reason that I am confused is likely because I'm having a hard time figuring out where to proceed from here.

Comment author: Qiaochu_Yuan 29 November 2012 12:40:52AM *  2 points [-]

If you ever plan on talking about your hypothesis, you need to be able to describe it in a language with a finite alphabet (such as English or a programming language). There are only countably many things you can say in a language with a finite alphabet, so there are only countably many hypotheses you can even talk about (unambiguously).

This means that if there are constants floating around which can have arbitrary real values, then you can't talk about all but countably many of those values. (What you can do instead is, for example, specify them to arbitrary but finite precision.)

Comment author: Eugine_Nier 29 November 2012 05:56:35AM 3 points [-]

If you ever plan on talking about your hypothesis, you need to be able to describe it in a language with a finite alphabet (such as English or a programming language). There are only countably many things you can say in a language with a finite alphabet, so there are only countably many hypotheses you can even talk about (unambiguously).

Only if you live in a universe where you're limited to writing finitely many symbols in finite space and time.

Comment author: Qiaochu_Yuan 29 November 2012 06:25:26AM 3 points [-]

Point.

If I lived in such a universe, then it seems like I could potentially entertain uncountably many disjoint hypotheses about something, all of which I could potentially write down and potentially distinguish from one another. But I wouldn't be able to assign more than countably many of them nonzero probability (because otherwise they couldn't add to 1) as long as I stuck to real numbers. So it seems like I would have to revisit that particular hypothesis in Cox's theorem...

Comment author: AlexMennen 04 December 2012 06:28:14PM 1 point [-]

It looks like you're right, but let's not give up there. How could we parametrize the hypothesis space, given that the parameters may be real numbers (or maybe even higher precision than that).