= 27d567bc2d48d9f40e9ccc20ea370b15)
Jack comments on Open Thread: January 2010 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (725)
Oh! More Asimov, "I, Robot". Here the guy was talking about Friendly AI in 1942.
Not really; they're not decision theory stories. The Three Laws are adversarial injunctions that hide huge amounts of complexity under short English words like harm. It wouldn't actually work. It didn't even work in the story.
The whole point of the stories is that it doesn't work in the end, it is a case study in how not to do it. How it can go wrong. Obviously he didn't solve the problem. The first digital computer had just been constructed, what would you expect?
The FAI problem has nothing to do with digital computers. It's a math problem. You'd only need digital computers after you've solved the problem, to implement the solution.
Not that they weren't good stories, and not that I expect fiction authors to do their own basic research, but I wouldn't say they're about the Friendly AI problem.
It is most certainly not an academic look at the concept, but that doesn't mean he didn't play a role in bringing the concept to the public eye. It doesn't have to be a scientific paper to have a real influence on the idea.
Along those lines, I'd recommend the Metamorphosis of Prime Intellect. It's a short-novel length expression of an AI that gains control of all matter and energy in the universe while being constrained by Asimov's Three Laws.
It's available free online under copyright. http://www.kuro5hin.org/prime-intellect/