Giles comments on Troubles With CEV Part1 - CEV Sequence - Less Wrong

7 Post author: diegocaleiro 28 February 2012 04:15AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (10)

You are viewing a single comment's thread.

Comment author: Giles 03 March 2012 05:49:36PM 0 points [-]

Is this a good summary of the ideas presented here or did I miss something important?

1) We need a correct definition for all the (apparently very fuzzy) concepts that CEV relies upon.

2a) People appear to have multiple "selves"; the preferences of each "self" are more consistent than the aggregation of all of them.

2b) If you strip away all the incoherent preferences, you might strip away most of the stuff you really care about.

3) A much smarter version of me does not resemble me any more. That person's preferences are not my preferences.

4a) We are behavior-executors, not a utility-maximizers. The notion of a "preference" or "goal" exists in the map not the territory. Asking "what is someone's true preference" is like asking whether it's a blegg or a rube. etc.

4b) Our reports of our own preferences are unreliable.

4c) CEV doesn't appear to address "Want to want".

Comment author: diegocaleiro 06 March 2012 08:31:28PM 0 points [-]

You have not considered the failure mode called "Defeated by Evolution"

Other than that, it is a great really short summary. Why don't you do the same to Part2? :)