Wei_Dai comments on Preferences without Existence - Less Wrong

14 Post author: Coscott 08 February 2014 01:34AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (101)

You are viewing a single comment's thread. Show more comments above.

Comment author: Wei_Dai 10 February 2014 06:10:20AM 0 points [-]

Yeah, I think what I said isn't strictly within your system. In your system, where does "the measure that I assign" come from? I mean, if I was already a UDT agent, I would already have such a measure, but I'm not already a UDT agent so I'd have to come up with a measure if I want to become a UDT agent (assuming that's the right thing to do). But what do I based it on, and why? BTW, have you read my post http://lesswrong.com/lw/1iy/what_are_probabilities_anyway/ where option 4 is similar to your system? I wasn't sure option 4 is the right answer back then, and I'm still in the same basic position now.

Comment author: Coscott 10 February 2014 06:21:06AM 0 points [-]

Well in mind space, there will be many agents basing their measures on different things. For me, it is based my intuition about "caring about everyone equally," and looking at programs as infinite binary strings as you describe. That does not feel like a satisfactory answer to me, but it seems just as good as any answer I have seen to the question "Where does your utility function come from?"

I have read that post, and of course, I agree with your reasons to prefer 4.