ShardPhoenix comments on One Medical? Expansion of MIRI? - Less Wrong

9 Post author: rhollerith_dot_com 18 March 2014 02:38PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (8)

You are viewing a single comment's thread. Show more comments above.

Comment author: ShardPhoenix 18 March 2014 11:23:29PM *  9 points [-]

The problem isn't so much that the AI doesn't do what is was designed to do, it's that what you implemented is subtly different from what you designed. This is something that commonly happens in programming, not just a hypothetical concern.