Atreides comments on Would a FAI reward us for helping create it? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (24)
You're getting into basilisk territory here. It probably makes no difference, at least at this point in time, when nobody has any clue what the most probable superintelligences will look like, and what their exact policies will be on this sort of thing. Although I guess we can assume that a superintelligence will use whatever policy has the highest likelihood of making itself come into existence, which as far as I can tell, is not necessarily the same as whatever policy has the highest likelihood of getting you to contribute to its creation.
Be thankful for that and pre-commit to always refuse extortion, before anyone does figure this out.
So you decided to bring it up yourself, seriously what the hell? Isn't that like pushing someone over a cliff while saying "Careful, you were getting near the edge"?