What do you mean with the term "scientifically" in that sentence? If I put identity into Google Scholar I'm fairly sure I fill find a bunch of papers in respectable scientific journals that use the term.
I mean that if you have two carbon atoms floating around in the universe, and the next instance you swap their locations but keep everything else the same, there is no scientific way in which you could say that anything has changed.
Combine this with humans being just a collection of atoms, and you have no meaningful way to say that an identical copy of you is "not really you". Also, 'continuity of consciousness' is just a specific sensation that this specific clump of atoms has at each point in time, except for all the times when it does not exist because the clump is 'sleeping'. So Quirrel's objection seems to have no merit (could be I'm missing something though).
"Obviously" is a fairly strong word. It makes some sense to label the negation of any emotion a emotionless state. Unfriendly AI doesn't hate humans but is indifferent.
Yes, there is an insight to be had there, I will acknowledge that much.
However, to say that the opposite of a friendly AI is a paper clip maximiser is stupid. The opposite of an AI which wants to help you is very obviously an AI which wants to hurt you. Which is why the whole "AK version 2 riddle" just doesn't work. The Patronus goes from "not thinking about death" (version 1) to "Valuing life over death" (version 2). The killing curse goes from "valuing death over life" (version 1) to "not caring about life" (version 2). You can visualise the whole thing as a line measuring just the one integer, namely "life-death preference":
Value death over life (-1) ---- don't think about it either way (0) ----- Value life over death (+1)
The patronus gets a boost by moving from 0 to +1. The killing curse gets a boost by moving from -1 to 0. That makes no sense. Why would the killing curse, which is powered by the exact opposite of the patronus, receive a boost in power by moving in the same direct as the Patronus which values life over death?
Only fake wisdom can get ridiculous results like this.
Yes you are missing a few things.
1) Saying you can't tell after the fact whether something occured is not the same as saying it never occured. The fact that we can't experimentally determine if two carbon atoms have distinct identity is not, repeat not the same as saying that they don't have separate identity. Maybe they do. You just can't tell.
2) That has nothing to do with continuity of consciousness. Assume the existence of a perfect matter replicator. What do you expect to happen when you make a copy of yourself? Do you expect to suddenly find yourself...
New chapter!
This is a new thread to discuss Eliezer Yudkowsky’s Harry Potter and the Methods of Rationality and anything related to it. This thread is intended for discussing chapter 102.
There is a site dedicated to the story at hpmor.com, which is now the place to go to find the authors notes and all sorts of other goodies. AdeleneDawner has kept an archive of Author’s Notes. (This goes up to the notes for chapter 76, and is now not updating. The authors notes from chapter 77 onwards are on hpmor.com.)
Spoiler Warning: this thread is full of spoilers. With few exceptions, spoilers for MOR and canon are fair game to post, without warning or rot13. More specifically: