You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Gurkenglas comments on [link] Large Social Networks can be Targeted for Viral Marketing with Small Seed Sets - Less Wrong Discussion

3 Post author: Gunnar_Zarncke 01 September 2014 10:03AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (12)

You are viewing a single comment's thread.

Comment author: Gurkenglas 01 September 2014 01:36:45PM 5 points [-]

You don't beat an UFAI by enumerating the exploits it could use. That kind of argument is found by trying to find arguments for your particular cause.

Comment author: V_V 03 September 2014 03:03:09PM *  4 points [-]

Disagree. This line of thinking leads to the fragile "provably safe" design strategy.

History of engineering tells us that provably safe, provably secure systems aren't, because even if your proof is mathematically correct, you most likely forgot to include some relevant aspect in your model, which leads to an exploit.
In real-world safety and security engineering, you don't want to rely on a single-point-of-failure design, you want to think about exploits and faults, both to provide defence in depth and to use them to stimulate your intuition about the mathematical models you use, reducing the chances that you miss something important.