You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

wedrifid comments on Ben Goertzel on Charity - Less Wrong Discussion

1 Post author: XiXiDu 09 March 2011 04:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 11 March 2011 12:14:17AM 1 point [-]

I would like to see more posts about reasoning and fewer, despite my transhumanist sympathies, about boxed AIs, hypothetical torture scenarios, and the optimality of donating to the Friendly AI cause

One of these things is not like the others. One of these things is not about the topic which historically could not be named. One of them is just a building block that can be sometimes useful when discussing reasoning that involves decision making.

Comment author: Nornagest 11 March 2011 12:28:35AM *  1 point [-]

My objection to that one is slightly different, yes. But I think it does derive from the same considerations of vast utility/disutility that drive the historically forbidden topic, and is subject to some of the same pitfalls (as well as some others less relevant here).

There are also a few specific torture scenarios which are much more closely linked to the historically forbidden topic, and which come up, however obliquely, with remarkable frequency.

Comment author: wedrifid 11 March 2011 12:51:50AM 0 points [-]

There are also a few specific torture scenarios which are much more closely linked to the historically forbidden topic, and which come up, however obliquely, with remarkable frequency.

Hmm...

  • Roko's Basilisk
  • Boxed AI trying to extort you
  • The 'People Are Jerks" failure mode of CEV

I can't think of any other possible examples off the top of my head. were these the ones you were thinking of?

Comment author: Nornagest 11 March 2011 01:07:07AM *  0 points [-]

Also Pascal's mugging (though I suppose how closely related that is to the HFT depends on where you place the emphasis) and a few rarer variations, but you've hit the main ones.