timtyler comments on Thought experiment: The transhuman pedophile - Less Wrong

6 Post author: PhilGoetz 17 September 2013 10:38PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread.

Comment author: timtyler 19 September 2013 07:07:31AM *  0 points [-]

People here sometimes say that a rational agent should never change its terminal values.

That's simply mistaken. There are well-known cases where it is rational to change your "terminal" values.

Think about what might happen if you meet another agent of similar power but with different values / look into "vicarious selection" / go read Steve Omohundro.