Strangeattractor comments on Open Thread, Jun. 15 - Jun. 21, 2015 - Less Wrong

5 Post author: Gondolinian 15 June 2015 12:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (302)

You are viewing a single comment's thread. Show more comments above.

Comment author: Strangeattractor 21 June 2015 04:59:18AM 0 points [-]

If the founders did it, they'd have to be careful to retain control so that shutting down the company would be an option, and a decision they had the authority to make. It's easy for investors and VCs to influence or take over running a company, without extraordinary pushback from founders, especially if the company is making money. "Could be aborted if it was excessively speeding-up AI progress, or was otherwise net harmful" sounds glib to me. Making a plan of how to do that, exactly, and under what conditions it would be done, and putting that into contracts right from the start, would be important. Otherwise, it wouldn't get done.

Studying risk analysis, and failure analysis, and the human factors of how people respond to emergencies would be helpful.

Comment author: RyanCarey 21 June 2015 08:23:49PM 0 points [-]

Well one would decide whether it was worth doing partially on the basis that investors interested in AI risk, including Jaan Tallinn and Elon Musk were willing to fund it in the early-mid stages. Of course, if you're soliciting funds from people who are already interested in AI risk, then you can't claim to be influencing AI-investors to become interested in AI risk - you can't have your cake and eat it too.