FeepingCreature comments on A Rationalist's Tale - LessWrong

82 Post author: lukeprog 28 September 2011 01:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (305)

You are viewing a single comment's thread. Show more comments above.

Comment author: FeepingCreature 22 November 2011 04:40:06PM 0 points [-]

Belatedly.

"For one thing, it has to make those objectives clear to itself. If its objectives are only implicit in the structure of a complex circuit or program, then future modifications are unlikely to preserve them. Systems will therefore be motivated"

Hold on. Motivated by what? If its objectives are only implicit in the structure, then why would these objectives include their self-preservation?