You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

DanArmak comments on Biased AI heuistics - Less Wrong Discussion

4 Post author: Stuart_Armstrong 14 September 2015 02:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread.

Comment author: DanArmak 17 September 2015 10:45:05AM 0 points [-]

An idealized or fully correct agent's behavior is too hard to predict (=implement) in a complex world. That's why you introduce the heuristics: they are easier to calculate. Can't that be used to also make them easier to predict by a third party?

Separately from this, the agent might learn or self-modify to have new heuristics. But what does the word "heuristic" mean here? What's special about it that doesn't apply to all self modifications and all learning models, if you can't predict their behavior without actually running them?

Comment author: Stuart_Armstrong 17 September 2015 11:10:14AM 0 points [-]

Can't that be used to also make them easier to predict by a third party?

Possibly. we need to be closer to the implementation for this.