This has been haunting my mind for a while and I would appreciate feedback on it!
In his infamous article "AGI Ruin: A list of lethalities" Eliezer defines a "pivotal weak act" and gives a heuristic proof that no such thing can exist.
TLDR: I think his proof is wrong and there is a counterexample. I believe creating bacteria that decompose metal, silicone, (or any other superset of the materials GPUs consist of) would constitute a pivotal weak act.
Long Version:
In his article, Eliezer outlines several hopes of people claiming AGI won't be as bad or any problem at all, and then cruelly squashes them. One of those hopes is the possibility of executing a... (read 683 more words →)
Thank you for you answer!
As I said I don't know much about microbiology and chemistry so I cannot challenge anything you said. It seems consistent with other answers as well telling me that there is no way of doing it.
I was queezy about it anyways since teleporting our technology back to the stone age and committing 99.9% of humanity to die is quite extreme.