= 27d567bc2d48d9f40e9ccc20ea370b15)
Coscott comments on Dark Arts 101: Winning via destruction and dualism - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (53)
Fine, maybe there are some non-computable minds in concept space, but that is okay. I think that all the minds that we could potentially simulate should be counted as players. Usually in game theory, you don't talk about new players being added, so I think that the correct model is that these potential players choose a strategy which only has an effect if their minds are simulated.
Further, I think this is a very important ethical question. I think clearly we should not give equal rights to all potential minds that are not simulated, because many of them cancel each other out. I feel like my morals only care about the actually realized minds (i.e. those that at some point gain some kind of power), which makes me wonder if maybe I should care about minds with an amount proportional the amount of power that that mind has over the world.
It's not just non-computable minds, there are minds that require too much computing power. Anyway, the zero-sum game where you give equal weight to agents that actually exist and agents that have almost no chance of existing is not the same game PhilGoetz was modeling reality with when he originally called it zero-sum.
Okay, but even with minds that could be simulated, the same argument works.
And you are right, while I think this is an important question, it has nothing to do with with the fact this PhilGoetz's model.