Konkvistador comments on Against Cryonics & For Cost-Effective Charity - Less Wrong

10 Post author: multifoliaterose 10 August 2010 03:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (180)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 11 August 2010 09:59:06AM 0 points [-]

I don't quite see how one is supposed to limit FAI<CEV<Group smaller than Humanity>> without the race for AI turning into a war of all against all for not just power but survival.

If anything I would like to expand the group not just to currently living humans but all other possible cultures biologically modern humans did or could have developed.

But again this is purely because I value a diverse future. Part of my paperclip is to make sure other people get a share of the mass of the universe to paperclip.

Comment author: wedrifid 11 August 2010 10:23:05AM 2 points [-]

I don't quite see how one is supposed to limit FAI<CEV<Group smaller than Humanity>> without the race for AI turning into a war of all against all for not just power but survival.

By winning the war before it starts or solving cooperation problems.

The competition you refer to isn't prevented by proposing an especially egalitarian. Being included in part of the Coherent Extrapolated Volition equation is not sufficient reason to stand down in a fight for FAI creation.

But again this is purely because I value a diverse future. Part of my paperclip is to make sure other people get a share of the mass of the universe to paperclip.

CEV<Konkvistador> would give that result. The 'coherence' thing isn't about sharing. CEV<A, B> may well decide to give all the mass of the universe to C purely because they can't stand each other while if C was included in the same evaluation CEV<A, B, C> they may well decide to do something entirely different. Sure, at least one of those agents is clearly insane but the point is being 'included' is not intrinsically important.