= 27d567bc2d48d9f40e9ccc20ea370b15)
DanielLC comments on The idiot savant AI isn't an idiot - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (133)
If your goal is to create paperclips, and you have the option to change your goal to creating staples, it's pretty clear that taking advantage of this option would not result in more paperclips, so you would ignore the option.
How well, do you think, this logic works for humans?
Humans tend towards being adaptation-executers rather than utility-maximizers. It does make them less dangerous, in that it makes them less intelligent. If you programmed a self-modifying AI like that, it would still be at least as dangerous as a human who is capable of programming an AI. There's also the simple fact that you can't tell before-hand if it's leaning too far on the utility-miximization side.
Isn't that circular reasoning? I have a feeling that in this context "intelligent" is defined as "maximizing utility".
And what is an "adaptation-executer"?
Pretty much.
If you just want to create a virtuous AI for some sort of deontological reason, then it being less intelligent isn't a problem. If you want to get things done, then it is. The AI being subject to dutch book betting only helps you insomuch as the AI's goals differ from yours and you don't want it to be successful.
See Adaptation-Executors, not Fitness-Maximizers.