Ben Goertzel on Charity

XiXiDu

Artificial general intelligence researcher Ben Goertzel answered my question on charitable giving and gave his permission to publish it here. I think the opinion of highly educated experts who have read most of the available material is important to estimate the public and academic perception of risks from AI and the effectiveness with which the risks are communicated by LessWrong and the SIAI.

Alexander Kruel asked:

What would you do with $100,000 if it were given to you on the condition that you donate it to a charity of your choice?

Ben Goertzel replied:

Unsurprisingly, my answer is that I would donate the $100,000 to the OpenCog project which I co-founded and with which I'm currently heavily involved. This doesn't mean that I think OpenCog should get 100% of everybody's funding; but given my own state of knowledge, I'm very clearly aware that OpenCog could make great use of $100K for research working toward beneficial AGI and a positive Singularity. If I had $100M rather than $100K to give away, I would have to do more research into which other charities were most deserving, rather than giving it all to OpenCog!

What can one learn from this?

The SIAI is not the only option to work towards a positive Singularity
The SIAI should try to cooperate more closely with other AGI projects to potentially have a positive impact.

I'm planning to contact and ask various experts, who are aware of risks from AI, the same question.

Alexander Kruel asked:

What would you do with $100,000 if it were given to you on the condition that you donate it to a charity of your choice?

Ben Goertzel replied:

Unsurprisingly, my answer is that I would donate the $100,000 to the OpenCog project which I co-founded and with which I'm currently heavily involved. This doesn't mean that I think OpenCog should get 100% of everybody's funding; but given my own state of knowledge, I'm very clearly aware that OpenCog could make great use of $100K for research working toward beneficial AGI and a positive Singularity. If I had $100M rather than $100K to give away, I would have to do more research into which other charities were most deserving, rather than giving it all to OpenCog!

What can one learn from this?

The SIAI is not the only option to work towards a positive Singularity
The SIAI should try to cooperate more closely with other AGI projects to potentially have a positive impact.

I'm planning to contact and ask various experts, who are aware of risks from AI, the same question.

We understand both airplanes and Neolithic tools, but we don't understand AGI design. Difficulty in basic understanding doesn't straightforwardly translate into the difficulty of solution.

That is true, but a project like OpenCog can succeed only if: (1) there exists an AGI program simple enough (in terms of both size and messiness) to be doable with today's software technology, and (2) people running the project have the right idea how to build it. I find both these assumptions improbable, especially the latter, and their conjunction vanishingly unlikely.

Perhaps a better analogy would be if someone embarked on a project to find an elementary proof of P != NP or some such problem. We don't know for sure that it's impossible, but given both the apparent difficulty of the problem and the history of the attempts to solve it, such an announcement would be rightfully met with skepticism.

You appealed to inadequacy of "today's software tools and methodologies". Now you make a different argument. I didn't say it's probable that solution will be found (given the various difficulties), I said that you can't be sure that it's Neolithic tools in particular that are inadequate.