The question of whose rightness gets to go into the AI still arises, and I don't think that the solution you have outlined is really up to the task of producing a notion of rightness that everyone on the planet agrees with.

That's not what CEV is for. It's for not taking over the world, or if you prefer, not being a jerk, to the maximum extent possible. The maximum extent impossible is not really on the table.

I would endorse a more limited effort which focused on recreating the most commonly accepted values our society: namely rational western values.

Then you have very little perspective on your place in history, my dear savage barbarian child.

I would also want to work on capturing the values of our society as a narrow AI problem

That ain't a narrow AI problem and you ain't doin' it with no narrow AI.

I think that there is a lot to be said about realist and objective ethics

My metaethics is real and objective, just not universal. Fixed computations are objective, and at least halfway real.