You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on [Stub] The problem with Chesterton's Fence - Less Wrong Discussion

4 Post author: Stuart_Armstrong 05 January 2016 05:10PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 15 January 2016 02:16:18PM 0 points [-]

It's more like saying "look, everyone said pricing sulfur dioxide would cause great problems, but nothing really bad happened, because people and the market adapted naturally to the change".

So the Y2K bug is not an argument for "do nothing if you're heavily involved with computers", but it is an argument for "do nothing if you have no connection with the computer industry (including funding, etc...) because it seems to have a decent track record of sorting out its own problems".

Comment author: entirelyuseless 15 January 2016 04:03:15PM 0 points [-]

I agree that "taking down this fence is going to cause society to collapse" is almost always false, at least when there is any real danger of the fence being taken down.

The same thing likely applies to statements like "programming an AGI without a tremendous amount of care about its exact goals is going to destroy the world."

Comment author: Stuart_Armstrong 19 January 2016 12:17:57PM 0 points [-]

I'd argue we have rather more experience of taking down fences which people cling to, than of programming AGI goals...