wedrifid comments on Yes, a blog. - Less Wrong

88 Post author: Academian 19 November 2010 01:53AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (106)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 19 November 2010 08:18:31PM 4 points [-]

e.g. persistance of values as an instrumental value.

What? Someone disagrees with that? But, but... how?

Comment author: Perplexed 20 November 2010 06:27:25AM *  2 points [-]

If I understand what you are talking about, I have expressed disagreement with it a couple of times. My disagreement has to do with the values expressed by a coalition (which will be some kind of bargained composite of the values of the individual members of that coalition).

But then when the membership in that coalition changes, the 'deal' must be renegotiated, and the coalition's values are no longer perfectly persistent - nor should they be.

This is not just a technical quibble. The CEV of mankind is a composite value representing a coalition with a changing membership.

Comment author: JGWeissman 19 November 2010 08:34:49PM 1 point [-]

What? Someone disagrees with that? But, but... how?

Ask Phil

Comment author: red75 19 November 2010 11:37:01PM 1 point [-]
  1. The case of agents in conflict. Keep your values and be destroyed, or change them and get the world partially optimized for your initial values.

  2. The case of unknown future. You know class of worlds you want to be in. What you don't know yet is that to reach them you must make choices incompatible with your values. And, to make things worse, all choices you can make ultimately lead to worlds you definitely don't want to be in.

Comment author: wedrifid 20 November 2010 05:31:39AM 1 point [-]
  1. Yes. That is the general class that includes 'Omega rewards you if you make your decision irrationally'. It applies whenever the specific state of your cognitive representation interacts significantly with the environment by means independent of your behaviour.

  2. No. You don't need to edit yourself to make unpleasant choices. Whenever you wish you were are different person than who you are so that you could make a different choice you just make that choice.

Comment author: red75 21 November 2010 08:36:39AM 0 points [-]

[...] you just make that choice.

It works for pure consequentialist, but if one's values have a deontology in the mix, then your suggestion effectively requires changing of one's values.

And I doubt than instrumental value that will change terminal values can be called instrumental. Agent that adopts this value (persistence of values) will end up with different terminal values than agent that does not.