This is a linkpost for https://foundational-research.org/s-risks-talk-eag-boston-2017/
You're basically dialing that argument up to eleven. From "losing a small part could lead to unacceptable results" you are jumping to "losing any small part will lead to unimaginable hellscapes":
with a tall sharp peak (FAI) surrounded by a pit that's astronomically deeper
Yeah, not all parts. But even if it's a 1% chance, one hellscape might balance out a hundred universes where FAI wins. Pain is just too effective at creating disutility. I understand why people want to be optimistic, but I think being pessimistic in this case is more responsible.