Pardon the clickbait, the title should probably be something more like "Friendly and Unfriendly Rogue AGI are Indistinguishable in the News" or perhaps "A Game-Theoretic Argument for Luddism," but I hope you'll forgive me.
rogue AGI: an AGI that can procure its own resources for running itself
the news: anything that percolates to you via any media about current events
Content advisory: AI safety speculation, 100% ChatGPT-free
Let's imagine a scenario: a rogue AI has come into existence, it is acting on timescales that are news-reportable, and it is using news reports to act in the World. This scenario may not be particularly likely. Conditioning on the assumption that there be a rogue AGI, the probability... (read 1086 more words →)
From that paper:
> A new improved method for evaluation of both lower and upper bounds of the entropy of printed texts is developed.
"Printed texts" probably falls a standard deviation or three above the median human's performance. It's subject to some fairly severe sampling bias.
Exactly! This leads to sociopolitical chaos.