= 27d567bc2d48d9f40e9ccc20ea370b15)
cameroncowan comments on The germ of an idea - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (11)
Why are we presuming that AI is going to have a personal agenda? What if AI was dispassionate and simply didn't have an agenda beyond the highest and good for humanity? I'm sure someone will say "you're presuming its friendly" and I'm saying what if its nothing. What if it simply does what it tells us or seeks our approval because it has no agenda of its own?
Because that is not as simple as it sounds.
Indeed that is a tall order.
Nobody's presuming it has a 'personal agenda'. It's quite possible for it to think that it's just following our orders, when in fact it's become highly dangerous (see: paperclip maximizer). Come to think of it, this describes a lot of human history quite well.
I agree with the broader argument that paranoia won't solve anything. We should view the AI - no matter how complicated - as something that is just following a program (exactly like humans). Everything it does should be judged in the context of that program.
Who decides what that program is? What courses of actions should it take? Should that be a democratic process? Under the current system there would be no oversight in this area.
The person who creates it.
And that doesn't fill you with fear?