Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

J_Thomas comments on Terminal Values and Instrumental Values - Less Wrong

54 Post author: Eliezer_Yudkowsky 15 November 2007 07:56AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

Sort By: Old

You are viewing a single comment's thread.

Comment author: J_Thomas 17 November 2007 04:13:21AM 0 points [-]

Me: "in *principle* you ought to consider the entire state of the future universe when you set a terminal value."

Douglas: 'Yes, and in practice we don't. But as I look further into the future to see the consequences of my terminal value(s), that's when the trouble begins.'

Me: Doctor, it hurts when I do this.

Doctor: Then don't do that.