You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanielLC comments on Size of the smallest recursively self-improving AI? - Less Wrong Discussion

4 Post author: alexflint 30 March 2011 11:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread. Show more comments above.

Comment author: DanielLC 31 March 2011 06:36:31AM 0 points [-]

But there's no reason for us to be in a universe where they failed as opposed to one where they would eventually succeed. In other words, why are we modern men in an unlikely universe rather than cave men in a likely one?

Comment author: atucker 31 March 2011 10:46:36AM *  1 point [-]

Because we're still around to observe it.

If every universe with unfriendly AI disassembles humans to use them for something else, then the fact that I have a body right now implies that I don't live in one of those universes.

Comment author: DanielLC 31 March 2011 07:46:16PM 1 point [-]

No, there's people with bodies in universes with unfriendly AI. They're just earlier. Since they have to be earlier, there's fewer of them, but not as few as there would be.

The fact that you're this late shows that you're not in a universe which developed unfriendly AI early. The number of late people is a much higher portion of people if unfriendly AI is hard to develop, so the fact that you're a late person suggests unfriendly AI is hard.

I suspect you're taking the current time through the development of civilization as a given. There's no reason to do this.

Comment author: alexflint 31 March 2011 07:52:43AM *  0 points [-]

I think this suggests FOOM is technically difficult to start; or at least that there's a reasonable chance that civilizations of our stage won't have started one.

Comment author: timtyler 31 March 2011 07:22:12AM *  -1 points [-]

there's no reason for us to be in a universe where they failed as opposed to one where they would eventually succeed.

People might "eventually succeed" here - but after that, what if there's 7 billion of us - and only one of them?