ArisKatsaris comments on The genie knows, but doesn't care - Less Wrong

54 Post author: RobbBB 06 September 2013 06:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (515)

You are viewing a single comment's thread. Show more comments above.

Comment author: ArisKatsaris 12 September 2013 05:24:32PM 5 points [-]

Self-correcting software is possible if there's a correct implementation of what "correctness" means, and the module that has the correct implementation has control over the modules that don't have the correct implementation.

Self-improving software are likewise possible if there's a correct implementation of the definition of "improvement".

Right now, I'm guessing that it'd be relatively easy to programmatically define "performance improvement" and difficult to define "moral and ethical improvement".