Sebastian_Hagen comments on Superintelligence 18: Life in an algorithmic economy - Less Wrong

4 Post author: KatjaGrace 13 January 2015 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (51)

You are viewing a single comment's thread. Show more comments above.

Comment author: Sebastian_Hagen 14 January 2015 10:39:01PM *  1 point [-]

This scenario is rather different than the one suggested by TedHowardNZ, and has a better chance of working. However:

Is there some reason to expect that this model of personhood will not prevail?

One of the issues is that less efficient CUs have to defend their resources against more efficient CUs (who spend more of their resources on work/competition). Depending on the precise structure of your society, those attacks may e.g. be military, algorithmic (information security), memetic or political. You'd need a setup that allows the less efficient CUs to maintain their resource share indefinitely. I question that we know how to set this up.

If it does, then what is the danger of a general Malthusian scenario?

The word "general" is tricky here. Note that CUs that spend most of their resources on instantiating busy EMs will probably end up with more human-like population per CU, and so (counting in human-like entities) may end up dominating the population of their society unless they are rare compared to low-population, high-subjective-wealth CUs. This society may end up not unlike the current one in wealth distribution, where a very few human-scale entities are extremely wealthy, but the vast majority of them are not.

Comment author: Capla 14 January 2015 11:08:17PM *  0 points [-]

One of the issues is that less efficient CUs have to defend their resources against more efficient CUs (who spend more of their resources on work/competition)

I am assuming (for now), a monopoly of power that enforces law and order and prevents crimes between C.U.s.

Note that CUs that spend most of their resources on instantiating busy EMs will probably end up with more human-like population per CU, and so (counting in human-like entities) may end up dominating the population of their society unless they are rare compared to low-population, high-subjective-wealth CUs.

I don't follow this. Can you elaborate?

Comment author: alienist 20 January 2015 09:48:33AM 6 points [-]

I am assuming (for now), a monopoly of power that enforces law and order and prevents crimes between C.U.s.

Any system becomes feasible once you assume a monopoly on power able to enforce an arbitrary law code. Of course, if you think about where the monopoly comes from you're back to a singleton scenario.

Comment author: Sebastian_Hagen 17 January 2015 10:38:15PM *  1 point [-]

To the extent that CUs are made up of human-like entities (as opposed to e.g. more flexible intelligences that can scale to effectively use all their resources), one of the choices they need to make is how large an internal population to keep, where higher populations imply less resources per person (since the amount of resources per CU is constant).

Therefore, unless the high-internal-population CUs are rare, most of the human-level population will be in them, and won't have resources of the same level as the smaller numbers of people in low-population CUs.