Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Eliezer_Yudkowsky comments on Inseparably Right; or, Joy in the Merely Good - Less Wrong

22 Post author: Eliezer_Yudkowsky 09 August 2008 01:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (29)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 09 August 2008 05:40:10PM 5 points [-]

The question of whose rightness gets to go into the AI still arises, and I don't think that the solution you have outlined is really up to the task of producing a notion of rightness that everyone on the planet agrees with.

That's not what CEV is for. It's for not taking over the world, or if you prefer, not being a jerk, to the maximum extent possible. The maximum extent impossible is not really on the table.

I would endorse a more limited effort which focused on recreating the most commonly accepted values our society: namely rational western values.

Then you have very little perspective on your place in history, my dear savage barbarian child.

I would also want to work on capturing the values of our society as a narrow AI problem

That ain't a narrow AI problem and you ain't doin' it with no narrow AI.

I think that there is a lot to be said about realist and objective ethics

My metaethics is real and objective, just not universal. Fixed computations are objective, and at least halfway real.