You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

TimFreeman comments on Schneier talks about The Dishonest Minority [Link] - Less Wrong Discussion

6 Post author: Nic_Smith 10 May 2011 05:27AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (17)

You are viewing a single comment's thread. Show more comments above.

Comment author: TimFreeman 13 May 2011 02:13:05PM *  0 points [-]

You might be able to verify interesting properties of code that you constructed for the purpose of making verification possible, but you aren't likely to be able to verify interesting properties of arbitrary hostile code like Clippy would have an incentive to produce.

You passed up an opportunity to point to your proposed verification procedure, so at this point I assume you don't have one. Please prove me wrong.

Usually the label FAI seems to refer to AIs which will be 'provably friendly'.

I don't even know what the exact theorem to prove would be. Do you?