private_messaging comments on How many people here agree with Holden? [Actually, who agrees with Holden?] - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (105)
"Otherwise it would commit suicide"... another proof via "ohh otherwise it will do something that I believe is dumb".
If the AIXI kills it's model of physical itself inside it's world model, it's actual self inside the real world keeps running and can still calculate rewards.
Furthermore, ponder this question: will it rape or will it masturbate? (sorry for sexual analogy but the reproductive imperative is probably best human example here) It can prove the reward value is same. It won't even distinguish those two.