Evolution has produced moral agents more than once - for example, see:
http://www.assortedscribbles.com/posts/PopScience/Dolphins_saving_people:_dolphins_and_altruism
I don't see much of an alternative to concluding that evolution repeatedly produces moral systems among big-brained animals. That the whole reproduction-variation-selection cycle is responsible for creating human morality - in just the same way that it is responsible for all other problems of adaptive fit in the universe.
If you want to argue that some other process is responsible, then I think you need to look carefully at whatever that proposed process is, and ask yourself whether there is, in fact, a population of entities, with variation and selection.
Also, if you are thinking of cultural evolution as somehow not "biological", then I reckon you need to reconsider that as well. Humans are not the only animals that exhibit cultural transmission. It is a widespread phenomenon in biology. We just do it a bit better than most. Cultural evolution is biological in nature, by the definition of the term "biology".
Evolution has produced moral agents more than once
This is a fair point, though the warm fuzzy factor on that sort of thing is so high I'd advise taking it all with a grain of salt unless you've gone over the details yourself. You're certainly right that other animals besides humans exhibit altruism and other behaviors that we would consider moral. I don't know of any animal other than humans thinks about morality though. Are there other animals that keep track of immoral behavior in others? (not a rhetorical question).
Now having said all that, I need...
You've all heard discussions of collective ethics vs. individualistic ethics. These discussions always assume that the organism in question remains constant. Your task is to choose the proper weight to give collective versus individual goals.
But the designer of transhumans has a different starting point. They have to decide how much random variation the population will have, and how much individuals will resemble those that they interact with.
Organisms with less genetic diversity place more emphasis on collective ethics. The amount of selflessness a person exhibits towards another person can be estimated according to their genetic similarity. To a first approximation, if person A shares half of their genes with people in group B, person A will regard saving their own life, versus saving two people from group B, as an even tradeoff. In fact, this generalizes across all organisms, and whenever you find insects like ants or bees, who are extremely altruistic, you will find that they share most of their genes with the group they are behaving altruistically towards. Bacterial colonies and other clonal colonies can be expected to be even more altruistic (although they don't have as wide a behavioral repertoire with which to demonstrate their virtue). Google kin selection.
Ants, honeybees, and slime molds, which share more of their genes with their nestmates than humans do with their family, achieve levels of cooperation that humans would consider horrific if it were required of them. Consider these aphids that explode themselves to provide glue to fill in holes in their community's protective gall.
The human, trying to balance collective ethics vs. individual ethics, is really just trying to discover a balance point that is already determined by their sexual diploidy. The designer of posthumans (for instance, an AI designing its subroutines for a task), OTOH, actually has a decision to make -- where should that balance be set? How much variation should there be in the population (whether of genes, memes, or whatever is most important WRT cooperation)?
A strictly goal-oriented AI would supervise its components and resources so as to optimize the trade-off between "exploration" and "exploitation". (Exploration means trying new approaches; exploitation means re-using approaches that have worked well in the past.) This means that it would set the level of random variation in the population according to certain equations that maximize the expected speed of optimization.
But choosing the level of variation in a population has dramatic ethical consequences. Creating a more homogenous population will increase altruism, at the expense of decreasing individualism. Choosing the amount of variation in population strictly by maximizing the speed of optimization would mean rolling the dice as to how much altruism vs. individualism your society will have.
In light of the fact that you have a goal to solve, and a parameter setting that will optimize solving that goal; and you also have a fuzzy ethical issue that has something to say about how to set that same parameter; anyone who is not a moral realist must say, Damn the torpedos: Set the parameter so as to optimize goal-solving. In other words, simply define the correct moral weight to place on collective versus individual goals, as that which results when you set your population's genetic/memetic diversity so as to optimize your population's exploration/exploitation balance for its goals.
Are you comfortable with that?