I would politely, but urgently suggest that if you're thinking a lot about scenarios where you could justify suicide, you might not be as interested in the scenarios as the permission you think they might give you. And you might not realize that! Motivated reasoning is a powerful force for folks who are feeling some mental troubles.
This is the sort of thing where checking in with a loved one generally about how they perceive your general affect and mood is a really good idea. I urge you to do that. You're probably fine and just playing with some abstract ideas, but why not check in with a loved one just in case?
I appreciate the concern. I’m actually very averse to committing suicide and any motivated reasoning on my part will be on the side of trying to justify staying alive. (To be clear, I think I have ample reasons to stay alive, atleast for the time being). My concern is that there might be good reasons to commit suicide (at some point) in which case I would rather know of them than be ignorant.
I have a (vague) intuition that this is a bad idea in expectation.
And I have a (vague) intuition that one should focus on working to make things better (in particular, in a situation of inevitable technological singularity, to focus on trying to make it better and on trying to make one's own trajectory in it better).
The epistemological weakness of my position here is that I am transferring my intuition from more conventional situations to something which is very much outside our distribution, so we might find ourselves not really prepared to think about this adequately.
Let me try again, from a more abstract epistemological position.
If it is a bad singularity and it really wants to hurt you, it probably can resurrect you and such, so it's not clear how much of a defense this is.
But if it is a good singularity, it would probably respect your wish to die, and then you'll miss all the potential of ending up in a good singularity (the chances of that are, of course, subject to a rather intense debate these days, but even Eliezer does not put those chances at exact zero).
This does seem to point towards dying being negative in expectation. (But in truth it might depend on your estimates of chances of various scenarios. My estimates of chances for positive singularity might be higher than your estimates, and this might color my judgement.)
(It is such an unusual situation that it is difficult to be sure. Speaking for myself, my own curiosity is sufficiently insatiable that if it is going to happen I want to see it and to experience it in any case, and to put efforts to make it better, if it's at all possible.)
From the point of view of trying to reduce personal risk of s-risks, trying to improve the worlds prospects seems like a way to convince yourself you’re doing something helpful, without meaningfully reducing personal s-risk. I have significant uncertainty about even the order of magnitude I could reduce personal s-risk through activism, research, etc, but I’d imagine it would be less than 1%. To be clear, this does not mean that I think doing these things are a waste of time, in fact it’s probably some of the highest expected utility things anyone can do,...
I'm not convinced you can get any utility from measure-reducing actions unless you can parley the advantage they give you into making more copies of yourself in the branch in which you survive. I am not happy about the situation, but it seems I will be forced endure whatever comes and there will never, ever be any escape.
Are you implying that all of the copies of yourself should meaningfully be thought of as the same person? Why would making more copies of yourself increase your utility?
Also, I take it from “never, ever be any escape” that you believe quantum immortality is true?
For a while I’ve thought to myself that if AI starts to obviously end the world I would just commit suicide, mainly to avoid any potential s-riskiness. But I’ve become far less certain recently that that would be a good idea.
Between the possibility of resurrection, quantum immortality, and weird acausal shenanigans, I’m not sure what my plan is for if the nano-factories starting popping up and whatnot.
This uncertainty about what I should do in such a situation causes me more discomfort than having a plan, even if it’s grim.
What do you think is the right thing to do if it becomes obvious that the world is ending due to AI?