Nick_Beckstead comments on Thoughts on the Singularity Institute (SI) - Less Wrong

256 Post author: HoldenKarnofsky 11 May 2012 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1270)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Beckstead 11 May 2012 03:56:21AM 51 points [-]

While I have sympathy with the complaint that SI's critics are inarticulate and often say wrong things, Eliezer's comment does seem to be indicative of the mistake Holden and Wei Dai are describing. Most extant presentations of SIAI's views leave much to be desired in terms of clarity, completeness, concision, accessibility, and credibility signals. This makes it harder to make high quality objections. I think it would be more appropriate to react to poor critical engagement more along the lines of "We haven't gotten great critics. That probably means that we need to work on our arguments and their presentation," and less along the lines of "We haven't gotten great critics. That probably means that there's something wrong with the rest of the world."

Comment author: ChrisHallquist 11 May 2012 04:04:08AM 27 points [-]

This. I've been trying to write something about Eliezer's debate with Robin Hanson, but the problem I keep running up against is that Eliezer's points are not clearly articulated at all. Even making my best educated guesses about what's supposed to go in the gaps in his arguments, I still ended up with very little.

Comment author: jacob_cannell 17 May 2012 09:04:05AM 4 points [-]

Have the key points of that 'debate' subsequently been summarized or clarified on LW? I found that debate exasperating in that Hanson and EY were mainly talking past each other and couldn't seem to hone in on their core disagreements.

I know it generally has to do with hard takeoff / recursive self-improvement vs more gradual EM revolution, but that's not saying all that much.

Comment author: Kaj_Sotala 17 May 2012 07:13:22PM 13 points [-]

I'm in the process of writing a summary and analysis of the key arguments and points in that debate.

The most recent version runs at 28 pages - and that's just an outline.

Comment author: somervta 17 January 2013 09:02:44AM 0 points [-]

If you need help with grunt work, please send me a message. If (as I suspect is the case) not, then good luck!

Comment author: Kaj_Sotala 18 January 2013 07:29:27AM 0 points [-]

Thanks, I'm fine. I posted a half-finished version here, and expect to do some further refinements soon.

Comment author: jacob_cannell 17 May 2012 11:14:36PM 0 points [-]

Awesome, look forward to it. I'd offer to help but I suspect that wouldn't really help. I'll just wax enthusiastic.

Comment author: private_messaging 17 May 2012 07:08:08AM *  1 point [-]

This. Well, the issue is the probability that it's just gaps. Ultimately, its the sort of thing that would only constitute a weak argument from authority iff the speaker had very very impressive accomplishments. Otherwise you're left assuming simplest explanation which doesn't involve presence of unarticulated points of any importance.

A gapless argument, like math proof, could trump authority if valid... an argument with gaps, on the other hand, is the one that is very prone to being trumped.

Comment author: Nick_Beckstead 11 May 2012 05:11:05AM 5 points [-]

In fairness I should add that I think Luke M agrees with this assessment and is working on improving these arguments/communications.

Comment author: lukeprog 11 May 2012 07:21:31PM 8 points [-]

Agree with all this.