roystgnr comments on The germ of an idea - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (11)
This sounds like an idea from Wei Dai 2 years ago. The specific concern I had then was that the larger the Oracle's benefit to humanity, the less relevant predictions of the form "what would happen if nobody could read the Oracle's prediction" become.
The general concern is the same as with other Oracle AIs: a combination of an Oracle and the wrong human(s) looks an awful lot like an unfriendly AI.