Eliezer_Yudkowsky comments on A Less Wrong singularity article? - Less Wrong

28 Post author: Kaj_Sotala 17 November 2009 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (210)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 18 November 2009 04:33:05AM 3 points [-]

Oh well in that case, we disagree about what reply we would hear if we asked a friendly AI how to talk and think about morality in order to maximize human welfare as construed in most traditional utilitarian senses.

This is phrased as a different observable, but it represents more of a disagreement about impossible possible worlds than possible worlds - we disagree about statements with truth conditions of the type of mathematical truth, i.e. which conclusions are implied by which premises. Though we may also have some degree of empirical disagreement about what sort of talk and thought leads to which personal-hedonic results and which interpersonal-political results.

(It's a good and clever question, though!)

Comment author: SforSingularity 18 November 2009 04:52:41AM 3 points [-]

we disagree about what reply we would hear if we asked a friendly AI how to talk and think about morality in order to maximize human welfare as construed in most traditional utilitarian senses.

Surely you should both have large error bars around the answer to that question in the form of fairly wide probability distributions over the set of possible answers. If you're both well-calibrated rationalists those distributions should overlap a lot. Perhaps you should go talk to Greene? I vote for a bloggingheads.

Comment author: wedrifid 18 November 2009 05:19:28AM 0 points [-]

I vote for a bloggingheads.

Wouldn't that be 'advocate', 'propose' or 'suggest'?

Comment author: bgrah449 18 November 2009 07:38:07PM 1 point [-]

I vote no, it wouldn't be

Comment author: Eliezer_Yudkowsky 18 November 2009 05:11:34AM 1 point [-]

Asked Greene, he was busy.

Yes, it's possible that Greene is correct about what humanity ought to do at this point, but I think I know a bit more about his arguments than he does about mine...

Comment author: SforSingularity 18 November 2009 06:15:44AM 1 point [-]

That is plausible.