V_V comments on The Useful Idea of Truth - Less Wrong

77 Post author: Eliezer_Yudkowsky 02 October 2012 06:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (513)

You are viewing a single comment's thread. Show more comments above.

Comment author: V_V 03 October 2012 02:57:41PM *  0 points [-]

I think you are conflating two different types of "should" statements: moral injunctions and decision-theoretical injunctions.

The statement "You should two-box in Newcomb's problem" is normally interpreted as a decision-theoretical injunction. As such, it can be rephrased epistemically as "If you two-box in Newcomb's problem then you will maximize your expected utility".

But you could also interpret the statement "You should two-box in Newcomb's problem" as the moral injunction "It is morally right for you to two-box in Newcomb's problem". Moral injunctions can't be rephrased epistemically, at least unless you assume a priori that there exist some external moral truths that can't be further rephrased.

The utilitarianist of your comment is doing that. His actual rephrasing is "If you two-box in Newcomb's problem then you will maximize the expected universe cumulative utility". This assumes that:

  • This universe cumulative utility exists as an external entity

  • The statement "It is morally right for you to maximize the expected universe cumulative utility" exists as an external moral truth.