You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

aberglas comments on Open thread, Sept. 1-7, 2014 - Less Wrong Discussion

4 Post author: polymathwannabe 01 September 2014 12:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (162)

You are viewing a single comment's thread.

Comment author: aberglas 02 September 2014 03:08:48AM *  4 points [-]

Reviewers wanted for New Book -- When Computers Can Really Think.

The book aims at a general audience, and does not simply assume that an AGI can be built. It differs from others by considering how natural selection would ultimately shape a AGI's motivations. It argues against the Orthogonality Principal, suggesting instead that there is ultimately only one super goal, namely the need to exist. It also contains a semi-technical overview of artificial intelligent technologies for the non-expert/student.

An overview can be found at

www.ComputersThink.com

Please let me know if you would be interested in reviewing a late draft. Any feedback would be most welcome. Anthony@berglas.org

Comment author: cameroncowan 02 September 2014 07:17:56PM 2 points [-]

I'm totally down, cameron@cameroncowan.net

Comment author: polymathwannabe 02 September 2014 12:17:05PM 2 points [-]

I'm always happy to proofread. PM me with the details.

Comment author: Transfuturist 02 September 2014 08:58:25AM 1 point [-]

It argues against the conjecture that utility function is separate from optimization power? Do you mean that it argues against Omohundro's instrumental AI drives?

Comment author: Manfred 02 September 2014 12:18:01PM 3 points [-]

The whole point of instrumental drives is that they don't have to be in the utility function.

Comment author: Transfuturist 03 September 2014 09:25:10PM 1 point [-]

Yes, I know; they're convergent. I'm questioning what aberglas is arguing against with his Darwinist supergoal. It doesn't make sense to say that such a supergoal is mutually exclusive with the independence of utility and optimization power. It makes more sense to say that the supergoal is an alternative to Omohundro's instrumental drives.

I don't see how what aberglas wrote makes coherent sense.

Comment author: aberglas 29 September 2014 06:07:12AM 0 points [-]

Well, alternative if you like. I will post an elaboration as a full article.