JGWeissman comments on What I would like the SIAI to publish - Less Wrong

27 Post author: XiXiDu 01 November 2010 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (218)

You are viewing a single comment's thread. Show more comments above.

Comment author: JGWeissman 02 November 2010 06:35:22PM 0 points [-]

It will know what constitutes an error based on some goal-oriented framework against which it can measure its effectiveness.

If the error is in the goal-oriented framework, it could end up "correcting" itself to achieve unintended goals.