wedrifid comments on SMBC comic: poorly programmed average-utility-maximizing AI - Less Wrong

9 Post author: Jonathan_Graehl 06 April 2012 07:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 06 April 2012 09:54:14AM 5 points [-]

What is then the torture of all the Humanity, against the super happy Felix with 3^^^3 pyramids. Nothing. By the same line of reasoning.

It's hedonistic total-utilitarianism vs preference based consequentialism. That's a big difference. Not only would the 'sequence' you reject not advocate preferring to torture humanity for the sake of making Felix superhappy, even in the absence of negative externalities it would still consider that sort of 'happiness' production a bad thing even for Felix.