Gurkenglas comments on [link] Large Social Networks can be Targeted for Viral Marketing with Small Seed Sets - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (12)
You don't beat an UFAI by enumerating the exploits it could use. That kind of argument is found by trying to find arguments for your particular cause.
Disagree. This line of thinking leads to the fragile "provably safe" design strategy.
History of engineering tells us that provably safe, provably secure systems aren't, because even if your proof is mathematically correct, you most likely forgot to include some relevant aspect in your model, which leads to an exploit.
In real-world safety and security engineering, you don't want to rely on a single-point-of-failure design, you want to think about exploits and faults, both to provide defence in depth and to use them to stimulate your intuition about the mathematical models you use, reducing the chances that you miss something important.