aeschere comments on Outline of Possible Sources of Values - Less Wrong

14 Post author: Wei_Dai 18 January 2013 12:14AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (28)

You are viewing a single comment's thread.

Comment author: [deleted] 25 January 2013 08:29:36PM *  0 points [-]

Inspired by you, I attempted to answer "Where do we derive values?" and put it in a chart.

  1. via oracle

    genetic (inborn predilection toward altruism)

    revelation (direct)

    prior authority (ignore original vehicle)

  2. via search

    historical evidence

    counterfactuals (simulated behavior)

    behavioral reward/punishment (randomized search with pruning, habits)

  3. via algorithmic computation

    consequentialism (same as counterfactuals?)

    virtue heuristic (anything optimizing on fixed small rule set)

    identity/hero based (intersection of virtue and historical?)

  4. as consequence of lower level (emergence)

    arise out of selfish desires (e.g. need for food, safety)

    arise out of tribal desires (we do group optimize)

Not sure whether your section 4 represents greater subtlety that I'm missing or whether it is straying from the question/answering a different question. Thanks for offering a framework that will allow me to better target my learning.

The community consensus seems to argue that computation is the only legitimate source of values and that we should isolate the influence of other sources. I expect that most people use search methods. Provided a large enough historical record, it would be easier to ask "What has worked well for others facing similar choices?" than to reconstruct a correct choice using a heuristic based method.