Wei_Dai comments on Thoughts on the Singularity Institute (SI) - Less Wrong

256 Post author: HoldenKarnofsky 11 May 2012 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1270)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 11 May 2012 12:36:02AM 5 points [-]

Holden must believe some additional relevant statements, because A-D (with "existential risk" suitably replaced) could be applied to every other charity, as presumably no charity is perfect.

I guess what I most want to know is what Holden thinks are the reasons SI hasn't already fixed the problems P. If it's lack of resources or lack of competence, then "withholding ... while pre-committing ..." isn't going to help. If it's wrong beliefs, then arguing seems better than "incentivizing", since that provides a permanent instead of temporary solution, and in the course of arguing you might find out that you're wrong yourself. What does Holden believe that causes him to think that providing explicit incentives to SI is a good thing to do?

Comment author: ciphergoth 11 May 2012 06:44:03AM 2 points [-]

Thanks for making this argument!

AFAICT charities generally have perverse incentives - to do what will bring in donations, rather than what will do the most good. That can usually argue against things like transparency, for example. So I think when Holden usually says "don't donate to X yet" it's as part of an effort to make these incentives saner.

As it happens, I don't think this problem applies especially strongly to SI, but others may differ.

Comment author: [deleted] 11 May 2012 08:47:57AM -1 points [-]
Comment author: Polymeron 20 May 2012 07:38:16PM *  0 points [-]

That is indeed relevant, in that it describes some perverse incentives and weird behaviors of nonprofits, with an interesting example. But knowing this context without having to click the link would have been useful. It is customary to explain what a link is about rather than just drop it.

(Or at least it should be)

Comment author: dspeyer 11 May 2012 02:53:55AM 1 point [-]

But C applies more to some charities than others. And evaluating how much of a charity's potential effectiveness is lost to internal flaws is a big piece of what GiveWell does.

Comment author: TheOtherDave 11 May 2012 01:57:19AM 0 points [-]

Absolutely agreed that if D is false -- for example, if increasing SI's incentive to fix P doesn't in fact increase SI's chances of fixing P, or if a withholding+precommitting strategy doesn't in fact increase SI's incentive to fix P, or some other reason -- then the strategy I describe makes no sense.