ciphergoth comments on BOOK DRAFT: 'Ethics and Superintelligence' (part 1) - Less Wrong

11 Post author: lukeprog 13 February 2011 10:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (107)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 14 February 2011 06:43:09AM 4 points [-]

Roko's original proposed basilisk is not and never was the problem in Roko's post. I don't expect it to be part of CEV, and it would be caught by generic procedures meant to prevent CEV from running if 80% of humanity turns out to be selfish bastards, like the Last Jury procedure (as renamed by Bostrom) or extrapolating a weighted donor CEV with a binary veto over the whole procedure.

EDIT: I affirm all of Nesov's answers (that I've seen so far) in the threads below.

Comment author: ciphergoth 14 February 2011 08:14:27AM 5 points [-]

Is the Last Jury written up anywhere? It's not in the draft manuscript I have.

Comment author: gwern 18 July 2011 03:35:49AM 3 points [-]

I assume Last Jury is just the Last Judge from CEV but with majority voting among n Last Judges.