John_Maxwell_IV comments on A taxonomy of Oracle AIs - Less Wrong

13 Post author: lukeprog 08 March 2012 11:14PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (51)

You are viewing a single comment's thread. Show more comments above.

Comment author: John_Maxwell_IV 09 March 2012 06:31:54AM *  0 points [-]

Don't worry, I haven't thought about it much either. I hope I'm not doing anything to pollute discussion of this topic. I figure in the worst-case a more serious researcher can skim through our discussion to see if we thought of anything they didn't. (Maybe we should have a separate discussion thread about reading one should definitely do before commenting on these topics, or about what we can do to explore the problem as thoroughly as possible before proposing solutions?)

The auditor would be able to see the oracle's reasoning behind obscuring future chains of reasoning.

Ideally the Oracle wouldn't have much awareness of the details of how things were logged or how the auditor worked. There's no reason why there couldn't be more than one auditor, btw, each using a different scheme for auditing.