Robin, I mentioned hyperbolic discounting above. Why do we have evolved pure time preference rather than just discounting for risk, return on investment, etc? If tweaking motives requires fewer independent changes than a massive improvement in our ability to reason about and predict the future, then evolution will do the former.

"baby/juvenile-AGI that is about to turn mature any month/week/day/hour now.

This calls for an AGI Manhattan Project!"

Probably too late for a Manhattan Project to be the appropriate response at that point. Negotiation or military action seem more feasible.

"This, I suspect, is one of those truths so horrible that you can't talk about it in public."

Charles Murray talked about in "The Bell Curve."

You posted your raw email address needlessly. Yum.