Bingo. That's exactly what I was concerned about.

You're probably right that there's no practical thing to be done now. I'm sure you're know very quickly if restrictions on independent AI research are being considered.

The more I think about it, the more I think a specialized self-optimizing AI (or several such, competing with each other) could do real damage to the financial markets, but I don't know if there are precautions for that one.