Blueberry comments on AI cooperation in practice - Less Wrong

26 Post author: cousin_it 30 July 2010 04:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (157)

You are viewing a single comment's thread. Show more comments above.

Comment author: rwallace 30 July 2010 08:15:10PM 1 point [-]

The most obvious implementation for the easy version will return 0 (or, if the length limit is lifted, fail to return at all).

It's important, however, to be clear on just what constitutes a valid proof. Consider the following implementation:

main() {return 1;}

Not valid because it didn't find a proof, you say? On the contrary, assuming we are dealing with idealized mathematical computers that are perfectly deterministic and have no outside inputs, the fact that a program returns a given value on this run does indeed constitute a proof that it will do so on every run.

The point being that, while you can use concepts like proof to draw rigorous conclusions, in the face of counterintuitive things like self reference, you need some experience actually nailing things down before you can be sure you've closed all the loopholes.

Comment author: rwallace 30 July 2010 11:01:09PM 1 point [-]

I'm curious, can the downvoters give any reasons for disagreeing with me?

Comment author: Blueberry 31 July 2010 12:06:34AM 0 points [-]

I upvoted the grandparent and parent, because what you said seems right to me. I wish people wouldn't downvote someone asking why e was downvoted.

Comment author: Cameron_Taylor 31 July 2010 01:39:14AM 0 points [-]

Upvoted entire ancestor tree, for similar reasons.