Stephen_Weeks comments on Ethics Notes - Less Wrong

12 Post author: Eliezer_Yudkowsky 21 October 2008 09:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Tags: morality

Comments (44)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Stephen_Weeks 22 October 2008 12:04:13AM 0 points [-]

As for the idea of competing AIs, if they can modify each other's code, what's to keep one from just deleting the other?

Or, for that matter, from modifying the other AI to change its values and goals in how the other AI modifies itself? Indirect self-modification?

This problem seems rather harder than directly implementing a FAI.