aberglas comments on Open thread, Sept. 1-7, 2014 - Less Wrong

4 Post author: polymathwannabe 01 September 2014 12:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (162)

You are viewing a single comment's thread.

Comment author: aberglas 02 September 2014 03:08:48AM *  4 points [-]

Reviewers wanted for New Book -- When Computers Can Really Think.

The book aims at a general audience, and does not simply assume that an AGI can be built. It differs from others by considering how natural selection would ultimately shape a AGI's motivations. It argues against the Orthogonality Principal, suggesting instead that there is ultimately only one super goal, namely the need to exist. It also contains a semi-technical overview of artificial intelligent technologies for the non-expert/student.

An overview can be found at

www.ComputersThink.com

Please let me know if you would be interested in reviewing a late draft. Any feedback would be most welcome. Anthony@berglas.org

Comment author: cameroncowan 02 September 2014 07:17:56PM 2 points [-]

I'm totally down, cameron@cameroncowan.net

Comment author: polymathwannabe 02 September 2014 12:17:05PM 2 points [-]

I'm always happy to proofread. PM me with the details.

Comment author: Transfuturist 02 September 2014 08:58:25AM 1 point [-]

It argues against the conjecture that utility function is separate from optimization power? Do you mean that it argues against Omohundro's instrumental AI drives?

Comment author: Manfred 02 September 2014 12:18:01PM 3 points [-]

The whole point of instrumental drives is that they don't have to be in the utility function.

Comment author: Transfuturist 03 September 2014 09:25:10PM 1 point [-]

Yes, I know; they're convergent. I'm questioning what aberglas is arguing against with his Darwinist supergoal. It doesn't make sense to say that such a supergoal is mutually exclusive with the independence of utility and optimization power. It makes more sense to say that the supergoal is an alternative to Omohundro's instrumental drives.

I don't see how what aberglas wrote makes coherent sense.

Comment author: aberglas 29 September 2014 06:07:12AM 0 points [-]

Well, alternative if you like. I will post an elaboration as a full article.