Eugine_Nier comments on Feed the spinoff heuristic! - Less Wrong

49 Post author: CarlShulman 09 February 2012 07:41AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (85)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eugine_Nier 12 February 2012 09:56:19PM *  1 point [-]

How about trying to leave a line of retreat and imagine what the world would be like if the theory Will is proposing were correct?

Comment author: FeepingCreature 12 February 2012 10:08:37PM *  2 points [-]

That's my point, I don't expect to be able to make consistently differing observations! If his theory is correct, we still wouldn't be able to reliably exploit that feature.

I'm not saying it's wrong, I'm saying even if it's right it's useless to believe.

I mean if there is some form of reliable Psi I'll have a party because that'd be awesome.

Comment author: Will_Newsome 13 February 2012 01:48:12PM 4 points [-]

I think you should look more closely at the arguments I made above: my hypothesis makes testable predictions, but if verified the evidence isn't reliably communicable to other people. By my hypothesis psi is perhaps "exploitable" but I cringe at the thought of trying to "exploit" a little-understood agentic process in the case that it actually exists.

Comment author: Desrtopa 13 February 2012 01:50:25PM 0 points [-]

but I cringe at the thought of trying to "exploit" a little-understood agentic process in the case that it actually exists.

Why?

Comment author: Will_Newsome 13 February 2012 02:05:28PM 5 points [-]

A safety heuristic. Just say no to demons, for the same reason you should say no to drugs until you figure out what they are, what they do, and the intentions of the agent offering them to you.

Comment author: Will_Newsome 13 February 2012 01:58:38PM *  5 points [-]

(E.g., imagine a transhumanly intelligent agent who only hangs out with you when it knows that no one will believe that it hung out with you. This means that when it hangs out with you it can do arbitrarily magical things, but you'll never be able to tell anyone about it, because the agent went out of its way to keep that from happening, and it's freakin' transhumanly intelligent so you know that any apparent chance of convincing others of its visit is probably not actually a chance. Is this theory improbable? Absolutely. But supposing that the agent actually does hang out with you and does arbitrarily magical stuff, you don't have any way of convincing others that the theory is a posterior probable, and you'll probably just end up making a fool out of yourself if you try, as the agent predicted.

I think a problem might be when people think of psi they think 'ability to shoot fireballs' rather than 'convincing superintelligences to act on your behalf' (note that that's just one possible mechanism of many and we shouldn't privilege any hypotheses yet). If people thought they were dealing with intelligent agents then they'd use the parts of their brain designed for dealing with agents, and those parts are pretty good at what they do. Note we only want to use those parts because, at least in my opinion, psi as a relatively passive phenomenon seems to be a falsified hypothesis, or at the very least it doesn't explain a ton of things that seem just as real as passive psi phenomena.)

Comment author: thomblake 13 February 2012 04:35:26PM 3 points [-]

Oh, you mean Bill Murray.