katydee comments on Singularity Institute now accepts donations via Bitcoin - Less Wrong

14 Post author: Kevin 28 February 2011 04:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (100)

You are viewing a single comment's thread. Show more comments above.

Comment author: katydee 06 March 2011 08:26:32PM 1 point [-]

Generally speaking I don't think the FBI investigates things "just because they look interesting," and since SIAI (to the best of my knowledge) isn't doing anything illegal that's not particularly worrisome anyway.

Comment author: wedrifid 06 March 2011 09:15:08PM 2 points [-]

and since SIAI (to the best of my knowledge) isn't doing anything illegal that's not particularly worrisome anyway.

Unless they are taken seriously, in which case there is most likely a law there somewhere that they could be said to be violating. They are, after all, trying to create a weapon of mass destruction. :)

Comment author: Eugine_Nier 07 March 2011 05:36:44AM 2 points [-]

Well building an AI to take over the world would arguably qualify as plotting violent overthrow of the government.

Comment author: katydee 07 March 2011 10:31:38AM *  1 point [-]

What? No they aren't, they're trying to establish protocols within which a general artificial intelligence can be safely created. Whether a general artificial intelligence should qualify as a weapon of mass destruction is a different argument, but it certainly doesn't qualify as one from a legal point of view, and if the SIAI safety/friendliness plan works, it shouldn't from a practical point of view either!

Comment author: wedrifid 07 March 2011 11:04:50AM *  4 points [-]

but it certainly doesn't qualify as one from a legal point of view

I'm not nearly so confident. The Powers That Be don't need to be all that reasonable about these things. Because of the bit about the Power.

I expect a security oriented government body would be able to come up with as many ways for creating a superintelligence to be illegal as MoR!Harry could find ways to weaponise Hufflepuffs. Calling it a WoMD would just be one of them.

Comment author: katydee 07 March 2011 04:54:33PM 3 points [-]

It's conceivable that, at some point, building design frameworks for friendly artificial intelligences (or, more plausibly, artificial intelligences in general) might be made illegal, but it certainly isn't illegal now.

Comment author: handoflixue 06 May 2011 06:16:17PM *  2 points [-]

http://en.wikipedia.org/wiki/Steve_Jackson_Games,_Inc._v._United_States_Secret_Service

Legality really doesn't seem to be a huge factor in whether the Secret Service can inconvenience you. And if they raided a gaming company, I could see them plausibly raiding an AI development organization.

That said, I don't see anything to suggest it's particularly likely, but a government investigation, all by itself, is incredibly disruptive even if you don't end up guilty of any crimes.

Edit: Fixed from FBI to Secret Service.

Comment author: wedrifid 07 March 2011 10:53:48AM *  0 points [-]

Edit: Response was written to original (brief) version of the parent (quoted below).

No they aren't, they're trying to create an artificial intelligence.

Encryption software has, at times, been legally declared 'munitions', the export of which can be a serious crime. Since an AI actually could be deployed as a weapon - and even a 'Friendly' version will be perceived to be causing massive destruction by at least one interest group - throwing that sort of label around would be comparatively reasonable. Not that I would make that designation. But I'm not a paramilitary organisation with relevant official status.

As for things that are not Weapons of Mass Destruction, try biological and chemical weapons (of the kind that actually exist). If you want to cause mass destruction use a nuke. Don't have one of them? Use conventional explosives. If you want to do serious damage with a chemical weapon... pick a chemical that explodes. That phrase is broken. </tangent>