linkhyrule5 comments on Torture vs. Dust Specks - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (596)
I'm not sure why surreal/hyperreal numbers result in, essentially, monofocus.
Consider this scale on the surreals:
Let's say you're a perfectly rational human (*cough cough*). You naturally start on the Omega^2 scale, with a certain finite amount of resources. Clearly, the worth of an omega of human lives is worth more than your own, so you do not repeat do not promptly donate them all to MIRI.
At least, not until you first calculate the approximate probability that your independent existence will make it more likely that someone somewhere will finally defeat death. Even if you have not the intelligence to do it yourself, or the social skills to keep someone else stable while they attack it, there's still the fact that you can give more to MIRI, over the long run, if you live on just enough to keep yourself psychologically and physiologically sound and then donate the rest to MIRI.
This is, essentially, the "sanity" term. Most of the calculation is done at this step, but because your life, across your lifespan, has some chance of solving death, you are not morally obligated to have yourself processed into Soylent Green.
This step interrupts for one of three reasons. One, you have reached a point where spending further resources, either on yourself or some existential-risk organization, does not predictably affect an existential risk. Two, all existential risks are dealt with, and death itself has died. (Yay!) Three, part of ensuring your own psychological soundness requires it - really, this just represents the fact that sometimes, a dollar (approx. one utilon) or a speck (epsilon utilons) can result in your death or significant misery, but nevertheless such concerns should still be resolved in order of decreasing utility.
At this point, we break to the Omega step, which works much the same way, balancing charity donations against your own life and QoL. Situations where spending money can save lives - say, a hospital or a charity - should be evaluated at this step.
Then we break to the unitary step, which is essentially entirely QoL for yourself or others.
Hypothetically, we might then break to the epsilon step - in practice, since even in a post-scarcity society you will never finish optimizing your unitaries, this step is only evaluated when it or something in it is promoted by causal dependence to a higher step.
So, returning to the original problem: Barring all other considerations, 3^^^3*epsilon is still an epsilon, while 50 years of torture is probably something like 3/4 Omega. With two tiers of difference, the result is obvious, and has been resolved with intuition.
I'm going to conclude with something Hermione says in MoR, that I think applies here.