You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Manfred comments on [Stub] Ontological crisis = out of environment behaviour? - Less Wrong Discussion

8 Post author: Stuart_Armstrong 13 January 2016 03:10PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (4)

You are viewing a single comment's thread.

Comment author: Manfred 13 January 2016 09:55:10PM 2 points [-]

I think they're a little different - ontological crises can (I think) be resolved naturally if an agent keeps a bunch of labeled data (or labeled-data-equivalent) around to define things by. But out-of-environment behavior can reflect fundamental limits on extrapolation, to which the only solution is more data, not better agents.

Which is to say, in the case of an ontological crisis I don't agree that the regular features are missing - they're just different computations than before.