You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

NihilCredo comments on Yet Another "Rational Approach To Morality & Friendly AI Sequence" - Less Wrong Discussion

-6 Post author: mwaser 06 November 2010 04:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (59)

You are viewing a single comment's thread. Show more comments above.

Comment author: NihilCredo 07 November 2010 02:48:10PM 0 points [-]

A community has certain expectations when you join it and is likely to take punitive action if you violate those expectations.

That consequence should factor into your reasoning of "what is in my best interest?", in the same way why you don't usually want to perform petty crimes IRL.

As a hint, how is 5 different from 2? Is 2 not rational or not in your best interest?

I read 2 as "I will perform the most rational actions among the subset of those that lead to a net positive for the community", whereas 5 takes away everything from 'among' onwards.