= 27d567bc2d48d9f40e9ccc20ea370b15)
NancyLebovitz comments on "Stupid" questions thread - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (850)
There's a third alternative, though it's quite unattractive: damaging civilization to the point that AI is impossible.
Given that out of billions, a few with extremely weird brains are likely to see evil-AI risk as nigh.
One of them is bound to push the red button way before I or anyone else would reach for it.
So I hope red technology-resetting buttons don't become widely available.
This suggests a principle: I have a duty to be conservative in my own destroy-the-world-to-save-it projects :)
Isn't that already covered by option b?
And there are, in fact, several people proposing this as a solution to other anthropogenic existential risks. Here's one example.
I would like to think that people who have the answer for each question in their FAQ open in a new tab aren't competent enough to do much of anything. This is probably wishful thinking.
Just to mention a science fiction handling.... John Barnes' Daybreak books. I think the books are uneven, but the presentation of civilization-wrecking as an internet artifact is rather plausible.
Not only that, they're talking about damaging civilization and they have an online FAQ in the first place. They fail Slytherin forever.
My model of humans says that some people will read their page, become impressed and join them. I don't know how much, but I think that the only thing that stops millions of people from joining them is that there already are thousands of crazy ideas out there competing with each other, so the crazy people remain divided.
Also, the website connects destroying civilization with many successful applause lights. (Actually, it seems to me like a coherent extrapolation of them; although that could be just my mindkilling speaking.) That should make it easier to get dedicated followers.
Destroying civilization is too big goal for them, but they could make some serious local damage.
And my model of the government says this has negative expected value overall.
An example of this: the Earth Liberation Front and Animal Liberation Front got mostly dismantled by CIA infiltrators as soon as they started getting media attention.
Our standards for Slytherin may be too high.
I don't get it. None of us here set the standards, unless certain donors have way more connections than I think they do.
You're the one who mentioned failing Slytherin forever.
My actual belief is that people don't have to be ideally meticulous to do a lot of damage.