jimrandomh comments on What can you do with an Unfriendly AI? - Less Wrong

16 Post author: paulfchristiano 20 December 2010 08:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (127)

You are viewing a single comment's thread. Show more comments above.

Comment author: ewbrownv 21 December 2010 09:42:16PM 0 points [-]

I often see formal verification enthusiasts make such claims, but as far as I can tell that's like saying AIXI solves the problem of AI design. If you could do this kind of thing on real programs under realistic conditions we'd all be using formal proof tools instead of testing departments. Instead large companies spend billions of dollars a year on testing we all know is inadequate, largely because efforts to actually apply formal techniques to these systems have failed.

Comment author: jimrandomh 21 December 2010 09:46:45PM 1 point [-]

These real-world programs that no one is willing to use formal proof tools on are 2-5 orders of magnitude more complicated than the hypothetical proof checker under consideration would be.