I would like to put forth the argument that we already have multiple human-programmed "Strong AI" operating among us, they already exhibits clearly "intelligent", rational, self-modifying goal-seeking behavior, and we should systematically study these entities before engaging in any particularly detailed debates about "designing" AI with particular goals.

What would be the benefit of studying them? Setting aside the question of whether bureaucracies are "Strong AI" (if someone doesn't agree then we can claim that they are "generalized strong AI" or something), what additional information about general laws of intelligence could be gleaned from studying two examples of intelligence rather than only the human one? There are already fields like management or organizational psychology that study the question of designing bureaucracies. Algorithms of corporations are very simple and consist mostly of calls to human black boxes.