jacob_cannell comments on Brainstorming additional AI risk reduction ideas - Less Wrong

12 Post author: John_Maxwell_IV 14 June 2012 07:55AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread.

Comment author: jacob_cannell 14 June 2012 09:55:27PM *  1 point [-]

Create a Direct Friendly AGI Investment Vehicle

Currently most AGI research is primarily sponsored by private angel investors and VCs towards private ends.

I have savings I would like to invest in friendly AGI, and I don't see a clear vehicle to enable that purchase at the moment. I've brought this up before at LW meetings and believe there is a growing market for such a vehicle.

The idea could take the form of a public accessible angel group or community chest type organization that allows investors to get exposure to a large pool of relatively safe AGI designs. The SIAI could take a lead role as a safety rating agency, connecting to John Maxwell's Safety Guideline ideas elsewhere in this thread.

AGI research is taking off regardless, the idea here is to differentially accelerate the safer designs.

Comment author: Manfred 15 June 2012 09:35:42PM *  2 points [-]

What business model using FAI will convince people to invest? Just adding "and it will be FAI" to typical AI pitches?

Comment author: jacob_cannell 16 June 2012 07:13:43AM *  0 points [-]

The specific business models will naturally vary from project to project, but so far the general form still appears to be the boosting approach where a more narrow AI application area is monetized first. For example Deepmind seems to be first pursuing AI for social games, whereas Vicarious is going for vision.

The key figures both gave Singularity Summit talks, Peter Thiel's group invested in both, and Thiel is obviously aware of friendliness issues, so I assume that the pitches involved something more than "and it will be FAI", but beyond that I can only speculate.

Comment author: lukeprog 17 June 2012 07:16:41PM 1 point [-]

Please email me so we can discuss this. luke [at] singularity.org