I'm unclear on how the probability distribution over utility functions would be implemented. A complete specification of how to evaluate evidence seems hard to do right. Also, why should we expect we can produce a pool of utility functions that includes an adequate one?

Seems to me Dewey and researches in this area could benefit from learning the literature on types of imitation in humans and other primates (procedural imitation, intentional imitation, automatic imitation, and goal-sharing).

This: http://scholar.google.com/scholar?q=intention+imitation&btnG=&hl=en&as_sdt=0%2C5

Evolution had to solve the goal of value learning before, and she always comes up with interesting ways no one would have thought about.