prase comments on A funny argument for traditional morality - Less Wrong

15 Post author: cousin_it 12 July 2011 09:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (70)

You are viewing a single comment's thread. Show more comments above.

Comment author: prase 13 July 2011 01:19:56PM 0 points [-]

It certainly seems that valuing V implies valuing valuing V and valuing^3 V and so on. But, if we try to formalise a bit the notion of value, doesn't it produce some unexpected paradoxes? I haven't thought about it in detail, so perhaps there is no problem, but I am not convinced.

I don't understand the relevance of your reply to torekp.

Comment author: cousin_it 13 July 2011 02:36:18PM *  3 points [-]

I don't see how paradoxes could arise. For example, if you have a value V of having value V, that's a perfectly well-defined function on future states of the world and you know what to do to maximize it. (You can remove explicit self-reference by using quining, aka the diagonal lemma.) Likewise for the value W of not having value W. The actions of an agent having such a value will be pretty bizarre, but Bayesian-rational.

I don't understand the relevance of your reply to torekp.

It shows a possible reason why you might want to return to your past values once you approach TDT-ish reflective consistency, even if you don't want that in your current state. I'm not sure it's correct, though.