Mass_Driver comments on The Friendly AI Game - Less Wrong

38 Post author: bentarm 15 March 2011 04:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (170)

You are viewing a single comment's thread. Show more comments above.

Comment author: Mass_Driver 19 March 2011 08:03:23PM 0 points [-]

I am a malicious or selfish human. I hack Program A, which, by stipulation, cannot protect itself except from Program B. Then, with A out of commission, I hack B.

Comment author: Carinthium 19 March 2011 10:13:18PM 1 point [-]

Program B can independently decide to protect Program A if such fits it's utility function- I don't think that would work.