You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Atreides comments on Would a FAI reward us for helping create it? - Less Wrong Discussion

-8 Post author: TwistingFingers 30 December 2011 07:33AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread.

Comment author: [deleted] 30 December 2011 08:49:56AM 2 points [-]

You're getting into basilisk territory here. It probably makes no difference, at least at this point in time, when nobody has any clue what the most probable superintelligences will look like, and what their exact policies will be on this sort of thing. Although I guess we can assume that a superintelligence will use whatever policy has the highest likelihood of making itself come into existence, which as far as I can tell, is not necessarily the same as whatever policy has the highest likelihood of getting you to contribute to its creation.

Be thankful for that and pre-commit to always refuse extortion, before anyone does figure this out.

Comment deleted 30 December 2011 09:34:02AM [-]
Comment deleted 30 December 2011 10:23:25AM [-]
Comment author: ArisKatsaris 30 December 2011 07:53:50PM *  2 points [-]

So you decided to bring it up yourself, seriously what the hell? Isn't that like pushing someone over a cliff while saying "Careful, you were getting near the edge"?