Will_Newsome comments on [Link] A superintelligent solution to the Fermi paradox - Less Wrong

-1 Post author: Will_Newsome 30 May 2012 08:08PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (75)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 30 May 2012 11:59:54PM 1 point [-]

I guess you're distantly alluding to the old discussion of 'what would AIXI do if it ran into a hypercomputing oracle?' in modern guise. I'm afraid I know too little about TDT or UDT to appreciate the point. It just seems a little far-fetched - so not only are we thinking about hypercomputation, which I believe is generally regarded as being orders of magnitude less likely than say P=NP, we're also thinking about a superintelligent and superpowerful agent with a decision theory that just happens to be broken in the right way?

If we were being mined for our computational potential, I can't help but feel human lives ought to be less repetitive than they are.

Comment author: Will_Newsome 31 May 2012 12:10:02AM *  3 points [-]

I believe is generally regarded as being orders of magnitude less likely than say P=NP

Haven't seen any surveys, but I don't think so. I think hypercomputation is considered by some important people to be more likely than P=NP. I believe very few people have really considered it, so you shouldn't take anyone's off-the-cuff impressions as meaning very much unless you know they've thought a lot about the limitations of theoretical computer science. I don't really have any ax to grind on the matter, but I think hypercomputation is neglected.

we're also thinking about a superintelligent and superpowerful agent with a decision theory that just happens to be broken in the right way?

I think my points were supposed to be disjunctive, not conjunctive. A broken decision theory or a limited theory of computation can both result in humans outcompeting superintelligences on certain very specific decision problems or (pseudo-)computations. Wei Dai's "Metaphilosophical Mysteries" is relevant.

If we were being mined for our computational potential, I can't help but feel human lives ought to be less repetitive than they are.

Given some models, yes. Given other models, the AI might not be able to locate what parts of the system have the special sauce and what parts don't, so it's more likely to let humans be.

Comment author: gwern 31 May 2012 02:00:50AM 0 points [-]

Your link isn't a stupid person, but to some extent, the lack of interest in hypercomputation says what the field thinks of it. Compare it to quantum computation, where people were avidly researching it and coming up with algorithms decades before even toy quantum computers showed up in cutting-edge labs.

Wei Dai's link is pretty controversial.

Comment author: Eugine_Nier 31 May 2012 04:52:59AM 1 point [-]

Compare it to quantum computation, where people were avidly researching it and coming up with algorithms decades before even toy quantum computers showed up in cutting-edge labs.

But only after it was discovered that the theory of quantum mechanics implied it was theoretically possible.

Comment author: Eugine_Nier 31 May 2012 03:24:49AM 1 point [-]

Compare it to quantum computation, where people were avidly researching it and coming up with algorithms decades before even toy quantum computers showed up in cutting-edge labs.

My understanding of the history is that everyone believed the extended Church-Turing thesis until someone noticed that the (already established) theory of quantum mechanics contradicted it.

Comment author: gwern 31 May 2012 03:33:07AM 0 points [-]

I don't think I've ever seen anyone invoke the extended Church-Turing thesis by either name or substance before quantum computing came around.

Comment author: Eugine_Nier 31 May 2012 03:55:28AM 1 point [-]

People were talking about P-time before quantum computing and implicitly assuming that it applied to any computer they could build.

Comment author: gwern 31 May 2012 04:00:52AM 0 points [-]

I don't see how one would apply "P-time" to "any computer they could build".

Comment author: Eugine_Nier 31 May 2012 04:46:24AM 1 point [-]

I meant "apply" in the sense that one applies a mathematical model to a phenomenon. Specifically, it was implicitly assumed the the notion of polynomial time captured what was actually possible to compute in polynomial time.

Comment author: Will_Newsome 31 May 2012 02:18:11AM 1 point [-]

Not sure, but it seems that whenever I get into discussions with you it's usually about some potentially-important edge case or something. Strange.

But anyway, yeah. I just want to flag hypercomputation as a speculative thing that it might be worth taking an interest in, much like mirror matter. One or two of my default models are probably very similar to yours when it comes down to betting odds.