Larks comments on Superintelligence 17: Multipolar scenarios - Less Wrong

4 Post author: KatjaGrace 06 January 2015 06:44AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (38)

You are viewing a single comment's thread.

Comment author: Larks 08 January 2015 04:36:06AM 1 point [-]

Bostrom makes an interesting point that multipolar scenarios are likely to be extremely high variance: either very good or (assuming you believe in additivity of value) or very bad. Unfortunately it seems unlikely that any oversight could remain in such a scenario that could enable us to exercise or not this option in a utility-maximizing way.

Comment author: KatjaGrace 09 January 2015 03:03:16AM 1 point [-]

Which 'option' do you mean?

Comment author: Larks 12 January 2015 04:44:24AM 0 points [-]

'option' in the sense of a financial derivative - the right to buy an underlying security for a certain strike price in the future. In this case, it would be the chance to continue humanity if the future was bright, or commit racial-suicide if the future was dim. In general the asymmetrical payoff function means that options become more valuable the more volatile the underlying is. However, it seems that in a bad multipolar future we would not actually be able to (choose not to buy the security because it was below the strike price / choose to destroy the world) so we don't benefit from the option value.