timtyler comments on What I would like the SIAI to publish - Less Wrong

27 Post author: XiXiDu 01 November 2010 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (218)
Tags: siai artificial intelligence existential risks

Comments (218)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 01 November 2010 08:44:08PM 2 points [-]

A recent update from Hugo here. He has retired - but says he has one more book on machine intelligence to go.

Comment author: Perplexed 01 November 2010 11:24:52PM 0 points [-]

Thx. From that interview:

Interviewer: So what's your take on Ben Goertzel's Cosmism, as expressed in "A Cosmist Manifesto"?

de Garis: Ben and I have essentially the same vision, i.e. that it’s the destiny of humanity to serve as the stepping-stone towards the creation of artilects. Where we differ is on the political front. I don’t share his optimism that the rise of the artilects will be peaceful. I think it will be extremely violent — an artilect war, killing billions of people.

Hmmm. I'm afraid I don't share Goertzel's optimism either. But then I don't buy into that "destiny" stuff, either. We don't have to destroy ourselves and the planet in this way. It is definitely not impossible, but super-human AGI is also not inevitable.

I'd be curious to hear from EY, and the rest of the "anti-death" brigade here, what they think of de Garis's prognosis and whether and how they think an "artilect war" can be avoided.

Comment author: ata 02 November 2010 12:57:54AM 5 points [-]

I'd be curious to hear from EY, and the rest of the "anti-death" brigade here, what they think of de Garis's prognosis and whether and how they think an "artilect war" can be avoided.

I'm not sure that's where the burden of proof should fall. Has de Garis justified his claim? It sounds more like storytelling than inferential forecasting to me.

Comment author: MichaelVassar 03 November 2010 10:11:48PM 3 points [-]

I really like your comments and wish you would make some top level posts and also contact me online. Could you please do so?

Comment author: ata 03 November 2010 11:11:22PM 0 points [-]

Where shall I contact you?

Comment author: Perplexed 02 November 2010 02:01:30AM 1 point [-]

I haven't read his book, etc., but I suspect that "storytelling" might be a reasonable characterization. On the other hand, my "I'd be curious" was hardly an attempt to create a burden of proof.

I do personally believe that convincing mankind that an FAI singularity is desirable will be a difficult task, and that many sane individuals might consider a unilateral and secret decision to FOOM as a casus belli. What would you do as Israeli PM if you received intelligence that an Iranian AI project would likely go FOOM sometime within the next two months?

Comment author: timtyler 02 November 2010 08:43:52AM *  0 points [-]

It's just silly. Luddites have never had much power - and aren't usually very war like.

Instead, we will see expanded environmental and green movements, more anti-GM activism - demands to tax the techno-rich more - and so on.

Degaris was just doing much the same thing that SIAI is doing now - making a song-and-dance about THE END OF THE WORLD - in order to attract attention to himself - and so attract funding - so he could afford to get on with building his machines.

Powered by Reddit Powered by Reddit