Comment Permalink

In the annual report for 01 October 2008 - 30 September 2009 they write: ( at page 23)

"At the present time, approximately half of our budget comes from the Universityʹs James Martin 21st Century School, and approximately half comes from a few visionary philanthropists. The following donations were received during the last academic year: Philanthropist #1: £161,308 Philanthropist #2: £9,392 Philanthropist #3: £13,435 Bright Horizons Foundation: £46,072 Other donations: £780"

So they got around £231,000 from donations. With the budget from the James Martin School this should sum up to approximately £462,000 which equals around $711,000 for 10/2008 - 10/2009.

I don't know the budget for the year 2010. (As a sidenote, the budget of FHI for 11/2005- 11/2006 was £203,665. And for 11/2006 - 11/2007 it was £263,113. (page 77). Maybe we can extrapolate from that data? )

steven046113y70

Comparing two organizations with the same budget isn't necessarily fair. If two organizations both had a budget of $500,000, and achieved the same amount of visible progress, but one of them had to spend $250,000 on fundraising, then (assuming linear returns to money) we should expect marginal donations to the latter organization to be twice as effective, right?

2Kaj_Sotala13y

Great, thanks!

See in context

40 SIAI vs. FHI achievements, 2008-2010

by Kaj_Sotala

25th Sep 2011

5 min read

40

After reading the FHI achievement report for 2008-2010, I thought it might be useful to compare their achievements to those of SIAI during the same time period. Since SIAI does not have an equivalent report, I've mostly pulled the data of their achievements from the SIAI blog.

My intention here is to help figure out which organization makes better use of my donations. For that purpose, I'm only looking at actual concrete outputs, and ignoring achievements such as successful fundraising drives or the hiring of extra staff.

For citation counts, I'm using Google Scholar data as-is. Note that this will include both self-cites and some cites from pages that really shouldn't be counted, since Google Scholar seems to be a bit liberal about what it includes in its database. I'm unsure as to whether or not the citation counts are very meaningful, since there hasn't been much time for anyone to cite papers published in 2010, say. But I'm including them anyway.

Future of Humanity Institute

Publications. The Achievement Report highlights three books and 22 journal articles. In addition, FHI staff has written 34 book chapters for academic volumes, including Companion to Philosophy of Technology; New Waves in Philosophy of Technology; Philosophy: Theoretical and Empirical Explorations; and Oxford Handbook of Neuroethics.

The three are the hardcover and paperback editions of Human Enhancement, as well as a paperback edition of Anthropic Bias: Observation Selection Effects in Science and Philosophy. Human Enhancement has been cited 22 times. Anthropic Bias was originally published in 2002, so I'm not including its citation count.

The highlighted 22 journal articles had been cited 59 times in total. The overwhelmingly most cited article was Cognitive Enhancement: Methods, Ethics, Regulatory Challenges in Science and Engineering Ethics, with 39 cites. The runner-up was Probing the Improbable: Methodological. Challenges for Risks with Low Probabilities and High Stake, with 5 cites. The remaining articles had 0-3 cites. But while Cognitive Enhancement is listed as a 2009 paper, it's worth noting that the first draft version of it was posted on Nick Bostrom's website back in 2006, and it has had time to accumulate cites since then. If we exclude it, FHI's 2008-2010 papers have been cited 20 times.

It's not listed in the Achievement Report, but I also want to include the 2008 Whole Brain Emulation Roadmap, which has been cited 15 times, bringing the total count (excluding Cognitive Enhancement) to 35.

Presentations. FHI members have given a total of 95 invited lectures and conference presentations.

Media appearances. Some 100 media appearances, including print, radio, and television appearances, since January 2009. These include BBC television, New Scientist, National Geographic, The Guardian, ITV, Bloomberg News, Discovery Channel, ABC, Radio Slovenia, Wired Magazine, BBC world service, Volkskrant (German newspaper), Utbildningsradion (Swedish national radio), Mehr News Agency (Iranian), Mladina Weekly (Slovenian magazine), Jyllands-Posten and Weekenavisen (Danish newspapers), Bayerisher Rundfunk (German radio), The History Channel, O Estado de São Paulo (Brazillian newspaper), Euronews, Kvallsposten (Swedish newspaper), City Helsinki (Finnish radio), Focus, Dutch Film and Television Academy, The Smart Manager (Indian magazine), Il Sole 24 Ore (Italian monthly), The Bulletin of the Atomic Sciences, Time Magazine, Astronomy Now, and Radio Bar-Kulan (Kenya).

Visitors. "The Institute receives many requests from students and scholars who wish to visit the Institute, only a few of which are accepted because of capacity limitations. The FHI has hosted a number of distinguished academic visitors over the past two years within its various areas of activity, such as Profs. David Chalmers, Michael Oppenheimer, and Thomas Homer-Dixon."

Policy advice. The Achievement Report highlights 23 groups or events which have received policy advice from either Nick Bostrom or Anders Sandberg. These include the World Economic Forum, the Public Services Offices of the Prime Minister's Office of Singapore, the UK Home Office, If (Stockholm insurance company), Jane Street Capital, IARPA (Intelligence Advanced Research Projects Activity) for US Government, The Swedish Institute for Infectious Disease Control, and setting up a research network, "A differential view of enhancement", within the Volkswagen Foundation.

Organized events. Three organized events. 1: Cognitive Enhancement Workshop. 2: Symposium on cognitive enhancement and related ethical and policy issues. 3: Uncertainty, Lags and Nonlinearity: Challenges to governance in a turbulent world.

Singularity Institute

Publications. The SIAI publications page has 15 papers from the 2008-2010 period, of which 11 are listed under "recent publications", 1 under "software", and 3 under "talks and working papers". Of these, Superintelligence does not imply benevolence has been cited once. The rest all have no citations.

The Sequences were written during this time period. They consist of about a million words, and might very well have a bigger impact than all the other FHI and SIAI articles together - though that's very hard to quantify.

Presentations and Media Appearances. The SIAI blog mentions a number of media appearances and presentations at various venues, but I don't have the energy to go through them all and count. From a quick eyeballing of the blog, though, SIAI has nowhere near as many presentations and media appearances as FHI.

Visitors. The Visiting Fellows page has a list of 27 Visiting Fellows from around the world, who attend or hold degrees from universities including Harvard, Stanford, Yale, Cambridge, Carnegie Mellon, Auckland University, Moscow Institute of Physics and Technology, and the University of California-Santa Barbara

Online communities and tools. Less Wrong was founded in 2009, and Google Analytics says that by the end of 2010, it had had over a million unique visitors.

Note that LW is an interesting case: as an FHI/SIAI collaboration, both organizations claim credit for it. However, since LW is to such a huge extent Eliezer's creation, and I'm not sure of what exactly the FHI contribution to LW is, I'm counting it as an SIAI and not a joint achievement.

SIAI also created the Uncertain Future, a tool for estimating the probability of AI.

Organized events. SIAI held Singularity Summits on all three years. The first Singularity Summit Australia was held in 2010. In 2008, SIAI co-sponsored the Converge unconference.

Ben Goertzel, acting as the SIAI Director of Research at the time, organized the 2008 and 2009 conferences on Artificial General Intelligence. He also co-organized a 2009 workshop on machine consciousness,

Artificial Intelligence projects. SIAI provided initial funding for the OpenCog project, as well as sponsoring Google Summer of Code events relating to the project in 2008 and 2009.

Overall

Based on this data, which organization is more deserving of my money? Hard to say, especially since SIAI has been changing a lot. The general AGI research, for instance, isn't really something that's being pursued anymore, and Ben Goertzel is no longer with the organization. Eliezer is no longer writing the sequences, which were possibly the biggest SIAI achievement of the whole 2008-2010 period.

Still, FHI's accomplishments seem a lot more impressive overall, suggesting that they might be a better target for the money. On the other hand, they are not as tightly focused on AI as SIAI is.

One imporant question is also the amount of funding the two organizations have had: accomplishing a lot is easier if you have more money. If an organization has thrice as much money, they should be expected to achieve thrice as much. SIAI's revenue was $426,000 in 2008 and $628,000 in 2009. FHI's funding was around $711,000 for 10/2008 - 10/2009. I don't know the 2010 figure for either organization. The FHI report also says the following:

To appreciate the significance of what has been accomplished, it should be kept in mind that the FHI has been understaffed for much of this period. One of our James Martin Research Fellows, Dr Rebecca Roache, has been on maternity leave for the past year. Our newest James Martin Research Fellow, Dr Eric Mandelbaum, who was recruited from an extremely strong field of over 170 applicants, has been in post for only two months. Thus, for half of the two-year period, FHI’s research staff has consisted of two persons, Professor Nick Bostrom and Dr Anders Sandberg.

SIAI - An Examination notes that in both 2008 and 2009, SIAI paid salaries to three people, so for a while at least, the amount of full-time staff in the two organizations was roughly comparable.

Future of Humanity Institute (FHI)Machine Intelligence Research Institute (MIRI)

Personal Blog

40

Mentioned in

26Room for more funding at the Future of Humanity Institute

15Kaj Sotala's Posts

New Comment

62 comments, sorted by

top scoring

Click to highlight new comments since: Today at 4:55 PM

[-]lukeprog13y220

I see Singularity Institute and Future of Humanity Institute as quite nicely complementary:

FHI is part of Oxford, and thus can add great credibility and funding to existential risk reduction. Resulting output: lots of peer-reviewed papers, books from OUP like Global Catastrophic Risks, conferences, media appearances, etc.
SI is independent and is less constrained by conservatism or the university system. Resulting output: Foundational works on Friendly AI (e.g., CFAI was just so much more advanced than anything else in machine ethics in 2001 it's not even funny), and the ability to do weird things that are nevertheless quite effective at creating tons of new people interested in rationality and existential risk reduction: (1) The Sequences, the best tool I know for creating rational transhumanists, (2) Harry Potter and the Methods of Rationality, now the most-reviewed fan fiction work of all time on FanFiction.net, (3) Less Wrong in general, a growing online and meatspace community of people who care about rationality and x-risk reduction, (4) Singularity Summit, a mainstream-aimed conference that nevertheless brings in people who end up making significant academic contributions like David Chalmers, along with a broader support base for transhumanism in general, (5) lots of behind-the-scenes work with Giving What We Can and 80,000 Hours that has encouraged the optimal philanthropy community in general to take existential risk reduction seriously.
FHI is in Britain, SI is in the USA.
FHI and SI have different but overlapping goals. FHI investigates a much broader range of transhumanist topics, whereas SI is more focused on AI risks and the rationality skills needed to think correctly about them.

I'm currently glad I work for the org with greater flexibility (SI), but I am quite happy with FHI's rather incredible productivity. I don't know any other philosophy research institute that has published so much original and important work in such a short time, ever.

edit 12/01/2011: Added point (5) in the list above, about optimal philanthropy.

[-]ahartell13y50

Small correction: HP:MoR is the most reviewed Harry Potter fanfiction of all time. I did a quick search for Twilight fanfiction and found a story with 14,822 reviews compared with 14,710 reviews for HP:MoR. I wouldn't be surprised if that were the number to beat (twilight is a very popular fanfiction topic as far as I know) but due to the disorganization of fanfiction.net, it's hard to say.

[-]timtyler13y30

I found these using this search.

[-]gwern12y30

So MoR is now past both Parachutes and Fridays at Noon. Still needs to pass Unexpected Circumstances (now at 24,163). When will it pass? Well:

MoR: 18911 02-28-10; 992 days ago: 18911/992=19.1 reviews per day Status: In Progress
UC: 24163 11-22-10; 725 days ago: 24163/725=33.3 reviews per day Status: Complete

Obviously if UC doesn't see its review rate decline, it'll never be passed by MoR; let's assume it goes to zero (not too unrealistic since UC is finished and MoR is not), how many days will it take MoR to catch up? (24163-18911) / (18911/992) = 275.5.

So barring a major acceleration in MoR reviews, we can't expect MoR to pass UC within much less than a year, but it's not too unlikely to pass in a full year (November 2013) and in 2 years I'd consider it likely to highly-likely to pass.

[-]Shmi12y00

One measure of a multi-chapter fanfic quality is reviews/chapter, and I don't think that HPMOR is likely to catch up to UC in the near future by that metric.

[-]gwern12y00

Well, one can argue that reviews/chapter isn't necessarily the best metric, but you're right: since UC is currently less than half the length of MoR and still has more reviews, it will be a long time before reviews/chapter catches up if ever.

[-]gwern12y00

After substantial additional work ( http://www.gwern.net/hpmor#the-review-race-unexpected-circumstances-versus-mor ), I've concluded that omitting UC's reviews is a drastic simplification and when one takes into account the slow accretion, MoR is more likely to catch up in <5 years than <2 years.

[-]lessdazed13y10

I'm sure Eliezer is writing Twilight fanfiction as we speak. It's an untapped market and would help with the demographics!

Any suggestions for the title?

[-]pedanterrific13y330

...how about Luminosity?

[-]JoshuaFox13y160

FHI is part of a prestigious university. This has signaling value in many areas: Adding credibility to the message, recruitment, and fundraising.
FHI also has raised a lot more money.
You might also compare what they have accomplished given their level of resources--where you get more bang for the buck.
FHI and SIAI have similar but different goals/subgoals. Depending on how one prioritizes these, direct comparisons are not always relevant.
It is also possible, though I am not quite sure of this, that FHI and SIAI are complementary. It may be that FHI uses "establishment" resources like the university affiliation, but is forced to follow a more conservative path; while SIAI is more financially constrained and lacks the prestige, but in exchange is permitted to take radical new directions.

[-]Kaj_Sotala13y90

Do you know where to find the figures for how much money FHI has?

[-]David Althaus13y70

In the annual report for 01 October 2008 - 30 September 2009 they write: ( at page 23)

So they got around £231,000 from donations. With the budget from the James Martin School this should sum up to approximately £462,000 which equals around $711,000 for 10/2008 - 10/2009.

[-]steven046113y70

[-]Kaj_Sotala13y20

Great, thanks!

[-]David Althaus13y120

One slight problem I see is that several FHI staff don't seem to be focused on existential-risk-reduction. Therefore the overall number of citations could be misleading.

FHI consists of 3 regular research staff members: Nick Bostrom, Anders Sandberg and Stuart Armstrong. Bostrom and Sandberg are of course very cool. I don't know much about Armstrong.

But furthermore FHI employs 5 research associates, who apparently aren't that interested in existential risk reduction:

Former research associate Eric Mandelbaum is mainly interested in philosophy of mind and writes papers like: Locke's Answer to Molyneux's Thought Experiment. Other publications of Mandelbaum are also rather ivory-tower.

Similar things can be said for former research associate Rebecca Roache.

The work of Milan Ćirković seems mainly focused on theoretical physics.

But I don't know how much money research associates get and how much money the normal research staff receives, so maybe donating to FHI is the more effective x-risk-reduction-strategy after all. ( E.g. the budget for Rebecca Roache was almost as high as that for Nick Bostrom back in 2005-2007 (page 77). )

[-]steven046113y120

See also this subthread.

[-]Kaj_Sotala13y80

Thanks for the pointer! For those too lazy to click on it, Nick Bostrom comments in that thread:

Much of the dispersion is caused by the lack of unrestricted funds (and lack of future funding guarantees). Since we don't have enough funding from private philanthropists, we have to chase academic funding pots, and that then forces us to do some work that is less relevant to the important problems we would rather be working on. It would be unfortunate if potential private funders then looked at the fact that we've done some less-relevant work as a reason not to give.

and

A high fraction. "A dollar's worth of research" is not a well-defined quantity - that is, the worth of the research produced by a dollar varies a lot depending on whom the dollar is given to. I like to think FHI is good at converting dollars into research. The kind of research I'd prefer to do with unrestricted funds at the moment probably coincides pretty well with what a person with SIAI-typical estimates would prefer, though what can be researched also depends on the capabilities and interests of the research staff one can recruit. (There are various tradeoffs here - e.g. a weaker researcher who has a long record of working in this area or taking a chance with a slighly stronger researcher and risk that she will do irrelevant work? headhunting somebody who is already actively contributing to the area or attempt to involve a new mind who would otherwise not have contributed? etc.)

There are also indirect effects, which might lead to the fraction being larger than one - for example, if discussions, conferences, and various kinds of influence encourage external researchers to enter the field. FHI does some of that, as does the SIAI.

There are also several informative comments from Carl Shulman, who mentions a cost of about $200k per 2 year postdoc, and estimates FHI getting something like 1 Sandberg or Ord equivalent per 2-3 hires.

[-]Kaj_Sotala13y60

Page 4 of the 2008-2009 annual report says that research associates are unsalaried.

[-]David Althaus13y30

Thanks!

But then how did FHI spend £460,000 in 2008-2009 ? ( See this comment ) The salary for James Martin research fellows and is around £45,000, and for Director Nick Bostrom around £50,000 according to the page 77 of this document.. And for James Martin project officers it's around £20,000. Thus the overall salary budget is approximately £180,000. So there remain around £280,000.

Is it possible that FHI just doesn't spend it's whole budget? E.g. in 2006- 2007 their budget was £263,113 but their actual expenditure was only £135,815! And who gets the surplus? Can FHI effectively use that much more money?

[-]CarlShulman13y160

FHI must pay for:

"taxes" to the university and the department for use of facilities, perhaps including high rent for the office space in the philosophy building (they also get a cut of many grants)
substantial costs for conferences and workshops
travel costs for staff and perhaps visitors
non-salary compensation (pension contributions, perhaps employer payroll taxes, etc for staff

[-]Kaj_Sotala13y20

Odd.

FHI not spending all its budjet seems unlikely, since the comments in the subthread steven0461 linked are saying that FHI would hire more staff if only it had the money.

[-]David Althaus13y20

It's really odd, maybe I'm misreading the budget tables.

[-]CarlShulman13y30

The research associate positions are not paid, as far as I know (e.g. Robin draws his salary from GMU, Toby from an Oxford college where he taught, etc). In some cases, in fact, the financial flow goes the other way.

However, Eric Mandelbaum was a paid postdoc at FHI before he left for a regular philosophy job.

[-]AlexMennen13y120

Another thing to consider is what each organization plans to do with more money. SIAI's list of things they want more money for (last two pages of this) looked pretty good. No idea whether FHI has published something similar.

[-]CarlShulman13y90

They want to hire more research staff. Last I heard $200,000 buys a 2 year appointment for a postdoc, including all salary and benefits, office space and support services, travel costs, etc. You can get a sense of the marginal hire by looking at past folk like Rafaela, Rebecca, Stuart, and Eric. From an existential risk point of view, some hits and some misses.

[-]SilasBarta13y100

Visitors. The Visiting Fellows page has a list of 27 Visiting Fellows from around the world, who attend or hold degrees from universities including Harvard, Stanford, Yale, Cambridge, Carnegie Mellon, Auckland University, Moscow Institute of Physics and Technology, and the University of California-Santa Barbara

This is more of an input than an output (achievement). I mean, you would have just as much an achievement if all the people there twiddled their thumbs all day.

[-]JoshuaZ13y60

This analysis seems accurate. One thing to note regarding organized events is that the Singularity Summits seem to be a lot more successful than the FHI's comparatively small conferences.

[-]JoshuaFox13y160

They are different things completely. The former are for spreading a message widely to a popular audience, and the latter are academic conferences.

[-]JoshuaZ13y10

That's a good point. They aren't necessarily comparable.

[-]hankx778713y50

Surely HPMOR counts, too?

[-][anonymous]13y110

The advantage of academic papers over HPMoR and the sequences is that other people can cite academic papers and be taken seriously.

EDIT: Again, the influence of HPMoR and the sequences is horrifically terrible to quantify. Perhaps there's some availability bias going on here in that citations are easier to count than converts.

[-]gwern13y80

No MoR than the Sequences, I'd guess.

[-]shokwave13y40

It's interesting: FHI appears to have started with academic respect and moved towards existential risk problems, whereas SIAI seems to have started with existential risk problems and is moving towards academic respect. Time will tell which method is more effective overall - but one idea that occurs out of this analysis is when SIAI spin off the rationality training, perhaps they should also spin off the existential risk work to the FHI.

Fanciful, but I could see a Singularity Institute Rationality College feeding bright researchers into a SI+FHI collaboration on the field of existential risk and similar, and feeding bright mathematics types into the SIAI's work on friendly AI theory. The work on FAI gets done, more of the students of the rationality dojo have success (improving the status of the rationality dojo), and more papers and citations come SI's way (improving the academic status of the Institute). This also allows the Singularity Institute's AI-focused researchers to contribute to existential risk papers and get their names in journals without taking large amounts of their time.

[-]CarlShulman13y40

and I'm not sure of what exactly the FHI contribution to LW is,

Primarily endorsement, a link, and Robin Hanson's writing on Overcoming Bias (and he is an unpaid Research Associate).

[-]EStokes13y40

Does it say anything about funding in here? If one has significantly more funding than the other this isn't really helpful.

[-]Kaj_Sotala13y50

I just added a bit about the finances at the end. I'm not sure of where to find information about FHI's funding.

[-]gwern13y40

I'm not sure where to get it either. England doesn't seem to have the same non-profit disclosure requirements as America, so I couldn't find any Form 990s or equivalents thereof back when I looked.

[-]PhilGoetz13y30

If you're trying to choose which charity to donate to, and you don't donate to other charities, I suggest not even making this decision, and dividing your donations between them, to avoid the problem described in a recent post.

[-]steven046113y80

I'm confused: what do you think stops the standard argument against multiple charities from working here?

[-]XiXiDu13y30

...what do you think stops the standard argument against multiple charities from working here?

If the cognitive dissonance caused by having to decide between two charities is too big you might end up not donating at all or much later. In that case it is better to split your money as to donate anything at all until you are able to resolve which charity is best.

[-][anonymous]13y00

I thought I might send some to FHI, but found out that the only direct method of doing so seemed to be limited to people in Great Britain, and that in the US, I would have to donate to a separate organization and do a "write-in" to have it assigned, which did not leave me confident my funds would reach them. At the time, I called it a trivial inconvenience allowing me to easily leave my current donation plans in place.

[This comment is no longer endorsed by its author]Reply

[-][anonymous]13y30

So much for "what currently appears to be the world's leading transhumanist organization."

I really would like people closer to the SIAI to think before they make claims like that.

[-]lukeprog13y50

Of course I'm aware of FHI. When I made that statement I was thinking of independent organizations, not university branches. In any case, I'm happy to clarify the wording in the original post.

[-][anonymous]13y20

Of course I'm aware you're aware of the FHI.

I'm grateful that this didn't devolve into a drama festival. A portion of my faith in LW has been restored.

[-]KPier13y20

This analysis would seem to indicate that SIAI is at least in a tie for the world's leading transhumanist organization. What's your objection to the claim?

[-]Vladimir_Nesov13y150

Even without contesting your framing, it doesn't support the claim that SingInst "appears to be the leading organization". Notice when you are primarily defending a position without paying sufficient attention to details of the argument.

[-][anonymous]13y50

"At least in a tie" by what metric? Which metrics matter? That's a tarpit I'm not interested in pursuing, because it doesn't sound productive to engage in it.

My objection is the same fork that we fell into before during the "rationality mini-camp was a success" fiasco: if there exists evidence, give it; otherwise, if only weak evidence exists, one ought to favor precision over self-aggrandizement.

[-]KPier13y30

Well, there are two major (EDIT: x-risk related; see discussion below) transhumanist organizations. This article provides a bunch of possible metrics for comparing them (cited papers, audience, publicity, achievements per dollar...).

It seems that you routinely post declaring that you are skeptical of SI's claims. That's good - we need loud contrarians sometimes. But I haven't seen you specify what evidence you're looking for that would resolve your skepticism.

Declaring yourself to be skeptical, without explaining what evidence you are looking for, just doesn't seem to contribute to the debate all that much.

Or, in other words: I can't figure out how much to update on your skepticism, because I can't figure out what you're skeptical about! You should consider writing a post like a few of XiXiDu's explaining what you're looking for.

[-]Kaj_Sotala13y150

There are two major x-risk -related transhumanist organizations. If you're counting major transhumanist organizations in general, you definitely need to include the SENS Foundation and the Methuselah Foundation as well.

[-]KPier13y20

Upvoted, and edited to clarify.

For me personally, it seems fairly clear that x-risk oriented organizations are the most important ones in the field of philanthropy. That's why I take the FHI/SI debate so seriously, and that's why I asked why paper_machine felt that the claim was obviously off base. Are the other organizations worth looking into seriously as optimal philanthropy?

[-]JoshuaZ13y70

This article provides a bunch of possible metrics for comparing them (cited papers, audience, publicity, achievements per dollar...).

Yes, and it seems from Kaj's data that by most of the obvious metrics, FHI is beating SI by a lot. One might think that the SI is doing well for publicity but that's primarily through the Summits. The media coverage is clearly much larger for the FHI than the SI. Moreover, the media coverage for the summits frequently focused on Kurzweil style singularities and similar things.

[-]CarlShulman13y90

The media coverage is clearly much larger for the FHI than the SI. Moreover, the media coverage for the summits frequently focused on Kurzweil style singularities and similar things.

The last Summit I was at, the previous NYC one, had an audience of close to a thousand that was relatively savvy and influential (registration records and other info show a lot of VCs, scientists, talented students, entrepreneurs and wealthy individuals) who got to see more substantive talks, even if those were not picked up as much by the media.

Also, one should apply the off-topic correction evenly: a fair amount of FHI media attention is likewise grabbing a quote on some fairly peripheral issue.

[-]JoshuaZ13y00

Interesting. That seems to be a strong argument to update more towards the SI.

[-]KPier13y00

I feel like it's to some extent an apples-to-oranges comparison. FHI is obviously doing better in terms of academic credibility, as measured by citations and their smaller academic conferences; SI seems to be doing much better in mass-audience publicity, as measured by 1 million unique visitors to LessWrong (!) and the Singularity Summit, which is growing each year and has a dramatically larger and wider audience than any FHI conferences. The Visiting Fellows program also stood out as something SI was doing much better.

but that's primarily through the Summits.

I don't really see why that's a "but". Is it because the media focuses on Kurzweilian Singularities?

I would love to see a financial analysis of FHI along the lines of this one, to evaluate the achievements/dollars metric.

But based on the metrics we have, the only one which seems decisively in FHI's favor is citations.

This article caused me to update in favor of "FHI is the best transhumanist charity", but only marginally so. If your interpretation was stronger than that, I'd be interested in hearing why.

[-]JoshuaZ13y20

I'm not I'm thinking in terms of "best transhumanist charity" which seems to be very hard to define. . I'd say more that I'm thinking in terms of something like "which of these two charities is a most efficient use of my resources, especially in regards to reducing existential risk, and encouraging the general improvement of humanity."

If I were attempting to think about this in terms of a very broad set of "transhumanist" goals, then I'd point to the the citations and the large number of media appearances as aspects where the FHI seems to be doing much more productively than the SI. Citations are an obviously important metric- most serious existential risk issues require academics to pay attention otherwise what you do won't matter much. Media attention is more important in getting people to realize that a) things like death really are as bad as they seem and b) that we might be able to really do something about them.

The primary reason I haven't updated that much in the direction of the FHI is that I don't know how much money the FHI is using to get these results, and also how much of this would be work that academics would do anyways. (When academics become affiliated with an institution they often do work they would already do and just tweak it to fit the institutions goals a bit more.) .

[-]XiXiDu13y40

I haven't seen you specify what evidence you're looking for that would resolve your skepticism.

The evidence I am looking for won't be available until it is too late, that's the problem. I have a hard time to swallow that pill. I also don't trust my rationality enough yet to completely overpower my intuition on that subject. Further, I feel that my background knowledge and math skills are not yet sufficient to actually donate larger amounts of money to the Singularity Institute. I am trying to change that right now, I am almost at Calculus over at Khan Academy (after Khan Academy I am going to delve into Bayesian probability).

[-]KPier13y60

I'm curious why you think you need calculus to evaluate which charities to donate to. (Though I wholeheartedly approve of learning it).

Surely there's some evidence that would cause you to update in favor of "SI knows what they're talking about", even if we won't know many things until after a Singularity occurs/fails to occur. For example, I would update pretty dramatically in the direction of "They know what they're doing" if TImeless Decision Theory went mainstream, since that's something which seems to be an important accomplishment which I am not qualified to independently evaluate.

[-]XiXiDu13y90

I'm curious why you think you need calculus to evaluate which charities to donate to.

I don't really know what exactly I will need beforehand so I decided to just acquire a general math education. Regarding calculus in particular, in a recent comment someone wrote that you need it to handle a probability distribution.

Surely there's some evidence that would cause you to update in favor of "SI knows what they're talking about"...

What evidence would cause me to update in favor of "Otto Rössler knows what he's talking about regarding risks associated with particle collision experiments"? I have no idea, I don't even know enough about high energy physics to tell what evidence could convince me one way or the other, let alone judge any evidence. And besides, the math that would be necessary to read papers about high energy physics is ridiculously far above my head. And the same is true for artificial general intelligence, just that it seems orders of magnitude more difficult and that basically nobody knows anything about it.

I would update pretty dramatically in the direction of "They know what they're doing" if TImeless Decision Theory went mainstream...

That says little about their claims regarding risks from AI in my opinion.

[-]KPier13y00

I would imagine that the validity of SI's claims in one area of research is correlated with the validity of their claims in other, related areas (like decision theory and recursively self-improving AI).

[-][anonymous]13y20

Well, there are two major transhumanist organizations.

Depending on what you mean by "major", I suppose. My first Google hit for "transhumanism" is Humanity+, and though I know nothing about them they at least seem to be in the same category. There's also the much maligned Lifeboat Foundation, which could hypothetically count as a transhumanist organization. So there's two more after five minutes of Googling.

It seems that you routinely post declaring that you are skeptical of SI's claims.

That's certainly not my MO for participating in LW. I'm a mathematician, not a loud contrarian. I'm currently working on summarizing Pearl's work on causality so that people can make more sense out of the sequences, and therefore help more when Luke's polyethics project gets off the ground.

Unfortunately, I'm also studying for my prelims, and so progress on Pearl has been a bit slow.

Declaring yourself to be skeptical, without explaining what evidence you are looking for, just doesn't seem to contribute to the debate all that much.

As I explained earlier, any hypothetically available evidence would have to be judged relative to some metric, and it's not worthwhile to sit around and discuss which metrics are optimal, particularly when nobody is in an impartial position to do so.

[-]KPier13y60

My first Google hit for "transhumanism" is Humanity+...

You're right. I guess I'm using the same metric as JoshuaZ (who's the best marginal use of my dollars?) and I'm fairly convinced that's existential risk, so I was discounting several non x-risk focused transhumanist charities, perhaps unfairly.

And apologies for implying you were solely a "loud contrarian". I didn't mean to imply that was your primary purpose for posting on LessWrong, just that I'd noticed many comments by you recently along those lines, and I was having difficulty interpreting your skepticism.

[-]cvichiee13y00

1) If it's hard for you to figure out which organization is making better use of your money what encourages you to continue donating?

2) What can be the reasons that may force you to halt your donations to these organizations in the future ?

3) Are you confidant/sure that each penny of your donations is getting converted into fruitful actions that will bring back substantial positive returns to the organizations in the future ?

4) How much are you currently donating to both organizations and to which organization would you like to increase your donations ?

Moderation Log