= 27d567bc2d48d9f40e9ccc20ea370b15)
Strange7 comments on Fake Utility Functions - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (54)
"Bootstrap the FAI by first building a neutral obedient AI(OAI) that is constrained in such a way that it doesn't act besides giving answers to questions."
As long as we be sure not to feed it too hard questions, specifically, questions that it is hard to answer a priori without actually doing something. (eg, an AI that tried to plan the economy would likely find it impossible to define and thus solve the relevant equations without being able to adjust some parameters)
If you have to avoid asking the AI too hard a question to stop it from taking over the world, you've already done something wrong. The important part is to design the oracle AI such that it is capable of admitting that it can't figure out an adequate answer with it's currently available resources, and then moving on to the next question.