Nominull comments on AI ontology crises: an informal typology - Less Wrong

6 Post author: Stuart_Armstrong 13 October 2011 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (12)

You are viewing a single comment's thread.

Comment author: Nominull 15 October 2011 01:25:43AM 0 points [-]

Why don't we see these crises happening in humans when they shift ontological models? Is there some way we can use the human intelligence case as a model to guide artificial intelligence safeguards?

Comment author: Eugine_Nier 15 October 2011 03:03:23AM *  4 points [-]

Why don't we see these crises happening in humans when they shift ontological models?

We do. It's just that:

1) Human minds aren't as malleable as a self-improving AI's so the effect is smaller,

2) After the fact, the ontological shift is perceived as a good thing, from the perspective of the new ontology's moral system. This makes the shifts hard to notice unless one is especially conservative.