Bongo comments on Take heed, for it is a trap - Less Wrong

47 Post author: Zed 14 August 2011 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (187)

You are viewing a single comment's thread.

Comment author: Bongo 14 August 2011 12:14:28PM *  2 points [-]

science is wrong

No. Something like "Bayesian reasoning is better than science" would work.

Every fraction of a second you split into thousands of copies of yourself.

Not "thousands". "Astronomically many" would work.

Computers will soon become so fast that AI researchers will be able to create an artificial intelligence that's smarter than any human

That's the accelerating change, not the intelligence explosion school of singularity. Only the latter is popular around here.

Also, we sometimes prefer torture to dust-specs.

Add "for sufficiently many dust-specks".

I also agree with lessdazed's first three criticisms.

--

Other than these, it's not a half-bad summary!

Comment author: Zed 14 August 2011 12:45:44PM *  6 points [-]

No. Something like "Bayesian reasoning is better than science" would work.

In http://lesswrong.com/lw/qa/the_dilemma_science_or_bayes/ Yudkowsky argues that you have to choose and that sometimes science is just plainly wrong. I find his arguments persuasive.

Not "thousands". "Astronomically many" would work.

Geez, I said "fraction of a second" for a reason.

That's the accelerating change, not the intelligence explosion school of singularity. Only the latter is popular around here.

Of course. And the accelerating change school of singularity provides the deadline. Friendly AI has to be solved BEFORE computers become so fast moderately intelligent people can brute force an AI.

Comment author: Vladimir_Nesov 14 August 2011 12:55:40PM *  1 point [-]

sometimes science is just plainly wrong.

Even Omega is sometimes wrong. You failed to argue for your claim.

I said "fraction of a second" for a reason.

"Fraction" has wrong connotations for this to fix the problem.