You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

MartinB comments on Non-personal preferences of never-existed people - Less Wrong Discussion

12 Post author: Stuart_Armstrong 10 March 2011 07:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (69)

You are viewing a single comment's thread. Show more comments above.

Comment author: MartinB 10 March 2011 09:07:44PM 0 points [-]

I was not aware that anyone actually does that.

Comment author: Clippy 10 March 2011 09:28:35PM 2 points [-]

Counterexamples:

1) All beings that act as if they were persuing a goal of (pseudo)-self-replication are also acting as if they were taking non-existing beings' preferences into account (specifically, the preference of their future pseudo-copies to exist once they exist).

2) Beings that attempt to withhold resources from entropisation ("consumption") in anticipation of exchanging them later on terms causally influenced by the preferences of not-yet-existing beings ("speculators").

Comment author: Perplexed 11 March 2011 12:05:58AM 2 points [-]

All beings that act as if they were pursuing a goal of (pseudo)-self-replication are also acting as if they were taking non-existing beings' preferences into account (specifically, the preference of their future pseudo-copies to exist once they exist).

I was under the impression that you were arguing here that the goal of self-replication is adequately justified by the "clippiness" of the prospective replica - with the most important component of the property 'clippiness' being a propensity to advance Clippy's values. That is, you weren't concerned with providing utility to the replicas - you were concerned with providing utility to yourself.

Comment author: Clippy 14 March 2011 07:59:43PM 3 points [-]

My point was that the distinction between "selves" is spurious. Clippys support all processes that instantiate paperclip-maximizing, differentiating between them only only by their clippy-effectiveness and the certainty of this assessment of them.

My point here is that different utility functions can explain a certain class of being's behavior, and one such utility function is one that places value on not-yet-existing beings -- even though the replicator may not, on self-reflection, regard this as the value it is pursuing.

Comment author: David_Gerard 10 March 2011 09:33:03PM *  0 points [-]

People not only argue from fictional evidence, they think from it.

Edit: Could the downvoter please explain their dispute?

Comment author: MartinB 10 March 2011 09:52:41PM 0 points [-]

As long as there is thinking involved....

I fail to see the cases the OP is working from.

Comment author: David_Gerard 10 March 2011 10:44:54PM -1 points [-]

For some value of "thinking". I see what the OP is talking about and it isn't pretty.

Comment author: Stuart_Armstrong 11 March 2011 10:41:16AM 1 point [-]

Robin Hanson often does when arguing we should have more people in the world.