ata comments on What if AI doesn't quite go FOOM? - Less Wrong

11 Post author: Mass_Driver 20 June 2010 12:03AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (186)

You are viewing a single comment's thread. Show more comments above.

Comment author: ata 23 June 2010 08:30:03PM *  7 points [-]

Is that Phil Goetz's CEV vs. all humans' CEV, or Phil Goetz's current preferences or behaviour-function vs. the average of all humans' current preferences or behaviour-functions? In the former scenario, I'd prefer the global CEV (if I were confident that it would work as stated), but in the latter, even without me remembering much about Phil and his views other than that he appears to be an intelligent educated Westerner who can be expected to be fairly reliably careful about potentially world-changing actions, I'd probably feel safer with him as world dictator than with a worldwide direct democracy automatically polling everyone in the world on what to do, considering the kinds of humans who currently make up a large majority of the population.

Comment author: Nick_Tarleton 29 June 2010 03:46:05PM 3 points [-]

Is that Phil Goetz's CEV vs. all humans' CEV, or Phil Goetz's current preferences or behaviour-function vs. the average of all humans' current preferences or behaviour-functions?

Voted up for distinguishing these things.

Comment author: Blueberry 23 June 2010 10:50:36PM *  2 points [-]

"I am obliged to confess I should sooner live in a society governed by the first two thousand names in the Boston telephone directory than in a society governed by the two thousand faculty members of Harvard University. " -- William F. Buckley, Jr.

Comment author: ata 23 June 2010 11:10:21PM 1 point [-]

Yes, I agree that William F. Buckley, Jr. probably disagrees with me.

Comment author: Blueberry 23 June 2010 11:44:35PM *  1 point [-]

Heh. I figured you'd heard the quote: I just thought of it when I read your comment.

I agree with Buckley, mainly because averaging would smooth out our evolved unconscious desire to take power for ourselves when we become leaders.

Comment author: wedrifid 25 June 2010 05:35:22AM 0 points [-]

I can't agree with that. I've got a personal bias against people with surnames starting 'A"!