Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Nick_Tarleton comments on Free to Optimize - Less Wrong

25 Post author: Eliezer_Yudkowsky 02 January 2009 01:41AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Nick_Tarleton 02 January 2009 03:32:21AM 4 points [-]

You're making your utility function path-dependent on the detailed cognition of the Friendly AI trying to help you!

Wouldn't it be a lot clearer to say that it's dependent on, not the FAI's algorithm, but the FAI's actions in the counterfactual cases where you worked more or less hard?