cousin_it comments on Building Phenomenological Bridges - Less Wrong

56 Post author: RobbBB 23 December 2013 07:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (116)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 25 December 2013 09:13:04PM *  1 point [-]

maybe a sufficiently advanced general intelligence should be able to recognize itself given some incomplete knowledge of itself

Yeah, that would be good, but we have no idea how to do it mathematically yet. Humans have intuitions that approximate that, but evolution probably didn't give us a mechanism that's correct in general, we'll have to come up with the right math ourselves.

Let F be a function which takes m in M and phi in the set of formulas of L as inputs and outputs the interpretation of phi in M

The big problem is defining F. If you squint the right way, you can view Paul's idea as a way of asking the AI to figure out F.