timtyler comments on General purpose intelligence: arguing the Orthogonality thesis - Less Wrong

20 Post author: Stuart_Armstrong 15 May 2012 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (156)

You are viewing a single comment's thread. Show more comments above.

Comment author: jacob_cannell 17 May 2012 02:38:47PM 0 points [-]

Attractors are features of evolutionary systems, it'd be wierd if their weren't attractors in goal space. Here's a paper which touches on that (I don't necessarily buy all of it, but the part about morality as an attractor in goal systems of evolving cooperating game theoretic agents is interesting)

Comment author: timtyler 17 May 2012 11:28:39PM *  0 points [-]

Attractors are features of evolutionary systems, it'd be wierd if their weren't attractors in goal space.

Sure. Think about the optimal creature - for instance - and don't anybody tell me that fitness is relative to the environment - we can see the environment.

Another point is that - even if there's no competition (and natural selection) involving alien races, the fear of such competiton is likely produce a similar adaptive effect - moving effective values towards universal instrumental values.