You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

ChristianKl comments on Natural selection defeats the orthogonality thesis - Less Wrong Discussion

-13 Post author: aberglas 29 September 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread.

Comment author: ChristianKl 01 October 2014 01:08:05PM 1 point [-]

An AGI presumably would know its own mind having helped program itself, and so would do what it thinks is optimal for its survival. It has no children. There is no real tribe because it can just absorb and merge itself with other AGIs.

Anybody doing a multithreaded program soons discovers that there isn't a single center of control. An AGI with wants to spread over the world might have to replicate itself. Sending signals around the world takes more time then sending signals a meter. Copies of the AGI in different cities might very well be something like children.

Comment author: aberglas 02 October 2014 01:51:42AM 1 point [-]

Indeed, and that is perhaps the most important point. Is it really possible to have just one monolithic AGI? Or would by its nature end up with multiple, slightly different AGIs? The latter would be necessary for natural selection.

As to whether spawned AGIs are "children", that is a good question.