Reactions:

As far as I can tell Socrates was guilty of "failing to acknowledge the gods that the city acknowledges" though I am not a scholar on these issues. Unless I am badly misunderstanding the situation socrates actions don't make a ton of sense to me. He was unwilling to flee Athens, which most accounts suggest he was somewhat expected to do. Yet he was willing to break the laws about "impeity." I don't quite understand his mindset, unless he didn't mind breaking laws but was opposed to resisting enforcement? Some modern people suggest this ethic, for example viewing killing someone who is abusing your mother/daughter as ok if you then turn yourself in.

This does not seem like a suffient degree of friendliness for an AI. Even if the AI wasn't going to resist when we tried to turn it off it could have done tremendous damage before anyone tries to shut it down. Metaphorically we want the AI to obey all our laws (so no "impeity") not just consent to punishments.

An alternative viewing is that Socrates is friendly to the extent his actions actually helped Athens. Maybe he felt breaking the laws on impeity was helping the city but fleeing would be hurting the city. In this case his actions were friendly. For some defintions of friendly. At least he would be friendly in the sense a genie who can ask "I wish for what I should wish for" is friendly. Though this is problematic. Socrates has human values but its not clear his values are close enough to those of the Athenian population that his actions improve their wellbeing by their values.