endoself comments on A taxonomy of Oracle AIs - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (51)
The important difficulty is not in making an AGI realize that humans can get bored, it is in making it realize that this is undesirable. Also, it would have to be able to figure out whether it is desirable to remove humans' boredom, effectively wireheading them in order to make them willing to enjoy repetitive activities.
I do agree that this could be less of a problem for an Oracle non-AI than for a goal-directed system, depending on other details of the design.