Kai-o-logos comments on Ben Goertzel interviews Michael Anissimov regarding existential risk [link] - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (16)
This doesn't seem to be a part of standard Christian or Jewish theology, so blaming that attitude on this seems misguided. His last sentence is also problematic- how does he know that with a sample size of one?
Seems to understate the case. Mindspace is large. The problem isn't an AI that acts like Hitler. That's not such a bad failure as things go. The worst case scenario more resembles Cthulhu than Hitler.
Anissimov correctly calls out Goertzel on his claim that he's sure he could design a properly functioning nanny AI.
Goertzel does correctly point out that it seems likely that a nanny AI would take less understanding than a full Friendly AI with stable goals under self-modification.
"This doesn't seem to be a part of standard Christian or Jewish theology,"
~Actually even if there is no outright statement in the Bible, through the years, it is commonly accepted that human supremacy is stated in Genesis 1:26 - "Then God said, 'Let us make mankind in our image'". Man is created in God's image - making him superior to all. Also in Gen. 3:22 - “The man has now become like one of us, knowing good and evil". Man is like a God - the only difference is that they are not immortal.
Not necessarily my opinion, just what I believe the theology says, and what I have heard from theist friends that the theology says.
But both religions also have angels which are depicted often as in some ways superior to humans. (Incidentally, I suspect that Gen 1:26 was originally intended to be more literal, with a host of deities of roughly human-looking deities creating creatures that looked like themselves.)
Though people may think of it as an optimum for non-supernatural beings.