Wiki Contributions
I had a twenty hour drive by myself recently, and binged Otherness in the Age of AGI. It was tremendous. Ambitious to take on the entire thing in one session!
Agree with this. Law is downstream of a particular medium-scale ontology of human agency. A paperclip maximizer, as mythologized, would be working with a different notion of agency, by definition.
Querying check_legality("clippy's plan"), would be like checking the temperature of the number "100". Sure, it might kinda sound like its hot, or illegal, but that's not the kind of input that check_legality() currently takes.
check_legality() can't even handle the agency of nation states ...
Genius. I'm stealing this for use in a professional setting. I'll have lawyers read chapters of "Co-Intelligence" by Ethank Mollick, and get them to focus on the useful parts for their own law firms...
(Also going to use this on "Legal Systems Very Different..." for our ACX group!)
I'm a lawyer (NY licensed) working in Tokyo, and this account of the Japanese penal system is incorrect. Prosecutors in Japan are extremely, extremely hesitant to bring a criminal case into the penal system, and so when cases are brought they are far beyond "a reasonable doubt". As a slightly misleading short summary, this, rather than lack of concern for false positives, is the reason for the notorious 99% conviction rate of criminal cases in Japan.
I've also been unhoused in a few different countries for short periods of time.
I'm certain that my affinity for Japan has its roots in needing this peaceful cultural of public safety.
I wholeheartedly agree, Colin. (I think we're saying the same thing--let me know where we may disagree.)
It's a daily challenge in my work to 'translate' what can sometimes seem like abstract nonsense into scenarios grounded in real context, and the reverse.
I want to add that a grounded, high context decision process is slower (still wearing masks?) but significantly wiser (see the urbanism of Tokyo compared to any given US city).
I’ve a developing a hunch that the abstract framing of arguments for AI Safety are unlikely to ever gain a foothold in Japan. The way forward here is in contextual framing of the same arguments. (Whether in English or Japanese is less and less relevant with machine translation.)
I’ve been a resident of Tokyo for twelve years, half of that as a NY lawyer in a Japanese international law firm. I’m also a founding member working with AI Safety 東京 and the Chair of the Tokyo rationality community. Shoka Kadoi, please express interest in our 勉強会.
As a lawyer engaged with AI safety, I often have conversations with the more abstract-minded members of our groups that reveal an intellectual acceptance but strong aesthetic distaste for the contextual nature of legal systems. (The primitives of legal systems are abstraction-resistant ideas like ‘reasonableness’.)
Aesthetic distaste for contextual primitives leads to abstract framing of problems. Abstract framing of the AI safety issues tends to lead from standard AI premises to narrow conclusions that are often hard for contextual-minded people to follow. Conclusions like, we’ve found a very low-X percent chance of some very specific bad outcome, and so we logically need to take urgent preventative actions.
To generalize, Japan as a whole (and perhaps most of the world) does not approach problems abstractly. Contextual framing of AI safety issues tends to lead from standard AI premises to broad and easily accepted conclusions. Conclusions like, we’ve found a very high-Y chance of social disruption, and we are urgently compelled to take information-gathering actions.
There’s obviously much more support needed for these framing claims. But you can see those essential differences in outcomes in the AI regulatory approaches of the EU and Japan, respectively. (The EU is targeting abstract AI issues like bias, adversarial attacks, and biometrics with specific legislation. Japan is instead attempting to develop an ‘agile governance’ approach to AI in order to keep up with “the speed and complexity of AI innovation”. In this case, Japan's approach seems wiser, to me.)
If the conclusions leading to existential risk are sound, both these framings should converge on similar actions and outcomes. Japan is a tough nut to crack. But having both framings active around the world would mobilize a significantly larger number of brains on the problem. Mobilizing all those brains in Japan is the course to chart now.
1I don't have any terminological suggestions that I love
Following on my prior comment, the actual legal terms used for the (oxymoronic) "purposeless and unknowing mens rea" might provide an opening for the legal-social technologies to provide wisdom on operationizing these ideas - "negligent" at first, and "reckless" when it's reached a tipping point.
Since reading this a few years ago, I've often thought about the Void and Musashi's advice. For the reference of anyone like me, the quote in its full context is comes after a description of the 'five fundamental stances' in 'the Way of the sword'. Here it is from the 2001 Wilson translation of the Five Rings -- I think it's worth thinking about together with the piece above:
The Lesson of Stance/No Stance
What is called Stance/No Stance means that there is no stance that you should take with your sword at all. However, as I place this within the Five Stances, there is a stance here. According to the chances your opponent takes, and according to his position and energy, your sword will be of a mind to cut down your opponent in fine fashion no matter where you place it. According to the moment, if you want to lower your sword a little from the Upper Stance, it will become a Middle Stance; if, according to the situation, you raise your sword a bit from the Middle Stance, it will become the Upper Stance. The Lower Stance, accordingly, may be raised a little to become the Middle Stance as well. This means that the two Side Stances, according to their position, may be moved a little to the center and become the Middle or Lower Stances.
This is the principle in which there is a stance and there is no stance. At its heart, this is first taking up the sword and cutting down your opponent, no matter what is done or how it happens. Whether you parry, slap, strike, hold back or touch your opponent's cutting sword, you must understand that all of these are opportunities to cut him down. To think, "I'll parry," or "I'll slap," or "I'll hit, hold or touch," will be insufficient for cutting him down. It is essential to think that anything at all is an opportunity to cut him down. You should investigate this thoroughly. With martial arts in the larger field, the placement of numbers of people is also a stance. All of these are opportunities to win a battle. It is wrong to be inflexible. You should make great efforts in this.
(The Japanese is here: https://www.koten.net/gorin/yaku/214/)