RichardKennaway comments on Can we create a function that provably predicts the optimization power of intelligences? - Less Wrong

-7 Post author: whpearson 28 May 2009 11:35AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (17)

You are viewing a single comment's thread. Show more comments above.

Comment author: RichardKennaway 28 May 2009 04:06:35PM 0 points [-]

I design a system p that has high optimising power, but which o is not smart enough to prove does so. Actually, I might get away with obfuscating p enough to confuse not o, but Mu's simulation of o, but my simulation of Mu simulating o might be imperfect.

Mu wrongly concludes that p is a poor optimiser, and performs the optimisation it thinks p incapable of. Meanwhile, I have bet against the verdict of o and win.

But I agree with Psychohistorian's comment and am not clear what the point of all this is.