We don't want them to advance quickly; we want them to advance with a low probability of screwing up permanently.
I don't think screwing up permanently becomes a real concern until the invention of nuclear weapons, and that's such a long ways ahead of the starting point for this exercise that I don't think we can influence how it goes.
This thread is for the discussion of Less Wrong topics that have not appeared in recent posts. If a discussion gets unwieldy, celebrate by turning it into a top-level post.