AlephNeil comments on "Ray Kurzweil and Uploading: Just Say No!", Nick Agar - Less Wrong

4 Post author: gwern 02 December 2011 09:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (79)

You are viewing a single comment's thread. Show more comments above.

Comment author: AlephNeil 03 December 2011 04:49:29PM 0 points [-]

The identify of an object is a choice, a way of looking at it. The "right" way of making this choice is the way that best achieves your values.

I think that's really the central point. The metaphysical principles which either allow or deny the "intrinsic philosophical risk" mentioned in the OP are not like theorems or natural laws, which we might hope some day to corroborate or refute - they're more like definitions that a person either adopts or does not.

I don't see either as irrational

I have to part company here - I think it is irrational to attach 'terminal value' to your biological substrate (likewise paperclips), though it's difficult to explain exactly why. Terminal values are inherently irrational, but valuing the continuance of your thought patterns is likely to be instrumentally rational for almost any set of terminal values, whereas placing extra value on your biological substrate seems like it could only make sense as a terminal value (except in a highly artificial setting e.g. Dr Evil has vowed to do something evil unless you preserve your substrate).

Of course this raises the question of why the deferred irrationality of preserving one's thoughts in order to do X is better than the immediate irrationality of preserving one's substrate for its own sake. At this point I don't have an answer.

Comment author: Vladimir_Nesov 03 December 2011 06:33:55PM 0 points [-]

The metaphysical principles which either allow or deny the "intrinsic philosophical risk" mentioned in the OP are not like theorems or natural laws, which we might hope some day to corroborate or refute - they're more like definitions that a person either adopts or does not.

What do the definitions do?

Comment author: AlephNeil 03 December 2011 06:55:39PM *  0 points [-]

I don't understand the question, but perhaps I can clarify a little:

I'm trying to say that (e.g.) analytic functionalism and (e.g.) property dualism are not like inconsistent statements in the same language, one of which might be confirmed or refuted if only we knew a little more, but instead like different choices of language, which alter the set of propositions that might be true or false.

It might very well be that the expanded language of property dualism doesn't "do" anything, in the sense that it doesn't help us make decisions.

Comment author: Vladimir_Nesov 03 December 2011 07:33:55PM 1 point [-]

OK, the problem I was getting at is that adopting a definition usually has consequences that make some definitions better than others, thus not exempting them from criticism, with implication of their usefulness still possible to refute.

Comment author: AlephNeil 03 December 2011 11:23:36PM *  0 points [-]

I agree that definitions (and expansions of the language) can be useful or counterproductive, and hence are not immune from criticism. But still, I don't think it makes sense to play the Bayesian game here and attach probabilities to different definitions/languages being correct. (Rather like how one can't apply Bayesian reasoning in order to decide between 'theory 1' and 'theory 2' in my branching vs probability post.) Therefore, I don't think it makes sense to calculate expected utilities by taking a weighted average over each of the possible stances one can take in the mind-body problem.

Comment author: Vladimir_Nesov 04 December 2011 12:13:07AM *  1 point [-]

Gosh, that's not useful in practice far more widely than that, and not at all what I suggested. I object to exempting any and all decisions from potential to be incorrect, no matter what tools for noticing the errors are available or practical or worth applying.