Laws are useful to prevent behavior where you know what kind of behavior you want to forbid. They are often possible to game and need judging to interpret what happens in edge cases.
Copying laws and contracts might not be the complete solution, but there's a lot of stored experience in the legal system which could be worth studying.
We know some of the behavior we want to forbid-- we definitely don't want the AI to take our atoms. Well, almost definitely.
Would it be a good outcome if the F?AI made really good simulations of us in a well-done simulated environment so that it was possible to have a lot more people?
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.