Nate, I know that you're saying something deep, maybe even intelligent, but I'm having trouble parsing your post.
Okay, so here's a dryad. You cut her open, and see white stuff. You take a sample, put it under a microscope, and still see white stuff. You use a scanning tunneling microscope, and still see white stuff. You build an AI and tell it to analyze the sample. The AI converts galaxies into computronium and microscopium, conducts every experiment it can think of, and after a trillion years reports: "The dryad is made of white stuff, and that's all I know. Screw this runaround, what's for dinner?"
But using an outside view of sorts (observed behavior), you can still predict what the dryad will do next. Just like with quarks and with Occam's razor and with prime numbers. And things you haven't reduced yet, but think you can, like people or the LHC.
So, what would you call this dryad?
@denis bider: I call them "vegetarians" and "environmentalists". Maybe I'm confused.
@Russell Wallace:
Arr... Erm... Anthropomorphism!
@Caledonian:
What happens if you try walking to work?
If the answer is NOT "my legs would fall off", you have choices. Otherwise, you can drive or you can drive.
Just great. I wrote four paragraphs about my wonderful safe AI. And then I saw Tim Tyler's post, and realized that, in fact, a safe AI would be dangerous because it's safe... If there is technology to build AI, the thing to do is to build one and hand the world to it, so somebody meaner or dumber than you can't do it.
That's actually a scary thought. It turns out you have to rush just when it's more important than ever to think twice.
Aron: """Whereas the plausible reality IMO seems to be more like an ecosystem of groups of intelligences of varying degrees all of which will likely have survival rationale for disallowing a peer to hit nutso escape velocity."""
What can an infrahuman AI do to a superhuman AI?
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
My fears:
1. Paperclip AI 2. People I know IRL catching me reading something embarrassing on the Internet 3. Nuclear war 4. The zombie under my bed