You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

chaosmage comments on In order to greatly reduce X-risk, design self-replicating spacecraft without AGI - Less Wrong Discussion

1 Post author: chaosmage 20 September 2014 08:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (36)
Tags: existential x-risk fermi intergalactic spacecraft interstellar space

Comments (36)

You are viewing a single comment's thread. Show more comments above.

Comment author: chaosmage 21 September 2014 07:53:20AM 1 point [-]

A paperclip maximizer decides for itself how to maximize paperclips; it can ignore human instructions. This SRS network can't: It receives instructions and updates and deterministically follows them. Hence the question around secure communication between SRS and colonies: a paperclip maximizer doesn't need that.

What is your distinction between "self-generated" evidence and evidence I can update anthropic reasoning on?

Powered by Reddit Powered by Reddit