Eugine_Nier comments on How to avoid dying in a car crash - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (288)
Well, one could make a computational complexity argument that there is no way to " Identify the thing that is an AI after it has been taught to think" other then actually interacting with it.
Sure, but once you do so, then you can build another that you didn't interact with.
On the other hand, how much variation do you need to introduce before you can declare that the second copy is a different intelligence than the one that you copied it from? And how sure can you be that it's still an AI after this variation? So there's an argument to be made there, although I'm far from convinced for now.