The two failure modes I observe most often are not exclusive to rationality, but might still be helpful to consider.
The decision was generated by my intuition since I've done the math on this question before, but it did not draw from a specific "gut feeling" beyond me querying the heavily-programmed intuition for a response with the appropriate inputs.
Your question has raised to mind some specific deviations of my perspective I have not explicitly mentioned yet:
Ok. So remember, your choices are:
- Lock away the technology for some time
- Release it now
You are choosing to kill every living person because you hope that the next generation of humans is more moral/ethical/deserving of immortality than the present, but you get no ability to affect the outcome.
Even with this context, my calculations come out the same. It appears that our estimations of the value (and possibly sacred-ness) of lives are different, as well as our allocations of relative weights for such things. I don't know that I have anything further worth mentioning, and am satisfied with my presentation of the paths my process follows.
I'm not sure your position is coherent. You, as a SWE, know that you can keep producing turing complete emulations and keep any possible software from the past working, with slight patches. (for example, early game console games depended on UDB to work at all).
Source code and binary files would qualify as "immortal" by most definitions, but my experience using Linux and assisting in software rehosts has made me very dubious of the "immortality" of the software's usability.
Here's a brief summary of factors that contribute to that doubt:
It's irrelevant if it isn't economically feasible to do so.
I do not consider economic infeasibility irrelevant when a problem can approach the scope of "a major corporation or government dogpiling the problem might have a 30% chance of solving it, and your reward will be nowhere near the price tag". It is possible that I am overestimating the feasibility of such rehosts after suffering through some painful rehost efforts, but that is an estimate from my intuition and thus there is little that discussion can achieve.
While I found your careful thought process here inspiring, the normal hypothetical assumption is to assume you have the authority to make the decision without any consequences or duty, and are immortal. Meaning that none of these apply.
First, I make a point of asking those questions even in such a simplified context. I have spent a fair amount of time training my "option generator" and "decision processor" to embed such checklists to minimize the chances of easily-avoided outcomes slipping through. The answer to the first bullet point would easily calculate as "your role has no obligations either way", but the other two questions would still be relevant.
But, to specifically answer within your clarified framing and with the idea of my choice being the governing choice in all resulting timelines, I would currently choose to withhold the information/technology, and very likely would make use of my ability to "lock away" memories to properly control the information.
The rest of your response seems reasonable enough when using the assumption that software is immortal, so I have nothing worth saying about it beyond that.
Do you think that some future generation of humans (or AI replacements) will become immortal, with the treatments being widely available?
I do not estimate the probability to be zero, but other than that my estimation metrics do not have any meaningful data to report.
Assuming they do - remember, every software system humans have ever built already is immortal, so AIs will all have that property - what bounds the awfulness of future people but not the people alive right now?
First, I'm not sure I agree that software systems are immortal. I've encountered quite a few tools and programs that are nigh-impossible to use on modern computers without extensive layers of emulation, and I expect that problem to get worse over time.
Second, I mainly track three primary limitations on somebody's "maximum awfulness":
If immortality enters the picture, the latter two bullet points will still apply, but I estimate that they would not be nearly as effective on their own. Given infinite time, awful people can spread their influence and create awful organizations, especially given that people I consider "awful" tend to more easily acquire influence than people I consider "good" (since they have fewer inhibitions and more willingness to disrespect boundaries), so that would suggest a strong indication towards imbalance in the long term.
Why do you think future people will be better people?
I don't necessarily think future people will be better people. I don't feel confident estimating how their "awfulness rating" would compare to current people, but if held at gunpoint I would estimate little to no change. I am curious what made you think that I held such an expectation, but you don't have to answer.
If you had some authority to affect the outcome - whether or not current people get to be immortal, or you can reserve the treatment for future people who don't exist yet - does your belief that future people will be better people justify this genocide of current people?
There would be several factors in a decision to use such authority:
The first and third factors I feel are self-explanatory, but I will talk a bit more on the second factor.
I would expect others given the same decision to not necessarily make the same choice, so by most statistical distributions even one or two other people facing the same decision would greatly increase my estimation of "likelihood that someone else chooses to hit the 'immortality button'". Therefore, if I expect the chance of "someone else chooses to press the button" to be "likely", I would then have to calculate further on how much I trusted the others I expected to be making such decisions. If I expected awful people to have the opportunity to choose whether to press the button, I would favor pressing it under my own control and circumstances, but if I expected good people to be my "competition", I would likely refrain and let them pursue the matter themselves.
... does your belief that future people will be better people justify this genocide of current people?
I do not currently consider myself to have enough ability to influence the pursuit of immortality, but I have consciously chosen to prioritize other things. I also prefer to frame such matters in the case of "how much change from the expected outcome can you achieve" rather than focusing upon all the perceived badness of the expected outcome. I've found such framing to be more efficient and stabilizing in my work as a software engineer.
As a general note to wrap things up, I prefer to avoid exerting major influence on matters where I do not feel strongly. I find that this tends to reduce "backsplash" from such exertions and shows respect for boundaries of people in general. As the topic of pursuing immortality is clearly a strong interest of many people and it is not a strong interest of mine, I tend to refrain from taking action more overt than being willing to discuss my perspective.
First, a brief summary of my personal stance on immortality:
- Escaping the effects of aging for myself does not currently rate highly on my "satisfying my core desires" metrics at the moment
- Improving my resilience to random chances of dying rates as a medium priority on said metrics, but that puts it in the midst of a decently large group of objectives
- If immortality becomes widely available, we will lose the current guarantee that "awful people will eventually die", which greatly increases the upper bounds of the awfulness they can spread
- Personal growth can achieve a lot, but there's also parts of your "self" that can be near-impossible to get rid of, and I've noticed they tend to accumulate over time. It isn't too hard to extrapolate from there and expect a future where things have changed so much that the life you want to live just isn't possible anymore, and none of the options available are acceptable.
Some final notes:
- There are other maybe-impossible-maybe-not objectives I personally care more about that can be pursued (I am not ready to speak publicly on most of them)
- I place a decent amount of prioritization pressure to objectives that support a "duty" or "role" that I take up, when relevant, and according to my estimations my stance would change if I somehow took up a role where personal freedom from aging was required to fulfill the duty
- I do not care strongly enough to oppose non-"awful" (by my own definitions) people from pursuing immortality; my priorities mostly affect my own allocations of resources
- I mentioned in several places things I'm not willing to fight over, but I am somewhat willing to explain some aspects of my trains of thought. Note, however, that I am a somewhat private person and often elect silence over even acknowledging a boundary was approached.
1:15 with the use of some distraction and breathing techniques. Mid-20s male in decent health but asthma.
I remember pushing to 90 seconds at one point when experimenting with some body control techniques, but that was a couple years ago and I'd probably have to take some unhealthy measures to repeat that nowadays.
(source epistemic status: mostly experiential and anecdotal from a lay lucid dreamer who knows a few other lucid dreamers)
The common negative effects from my lucid dreaming experiences:
- If I'm not careful with how I exert the "influence" I have in the dream, I can "crash" the dream, usually resulting in me waking up and having trouble getting back to sleep for a bit
- When I use a lot of influence in a lucid dream, especially to extend the length of a dream, I find that I end up seeming way less rested than normal (but that has proven hard to try and quantify beyond "when in the day do I hit a point of exhaustion")
A somewhat less common negative effect I keep in mind:
- Some people I know have had issues where their nightmares became far more unpleasant after trying to learn lucid dreaming to "fight back"