Jonathan_Graehl comments on An Alternative Approach to AI Cooperation - Less Wrong

6 Post author: Wei_Dai 31 July 2009 12:14PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (25)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 31 July 2009 01:05:42PM *  1 point [-]

When two AIs merge this way, you can consider them pre-merge as already being a single distributed process. Then, the process of merging is just some dynamic that happens to the distributed process of both AIs. What did actually happen in this dynamic?

Comment author: Jonathan_Graehl 31 July 2009 06:37:17PM 0 points [-]

Consider any method for committing to run published source code that isn't vulnerable to deception (Freeman's works, I think).

If you are saying that physically supervised joint reincarnation is just (if it works) another type of enforceable mutual source code promise, and otherwise changes nothing, I agree.