If you change that bit back, are you back to one person? I might not be thinking hard enough, but my intuition doesn't accept that.

Here's an intuition for you: you take the number 5 and add 1 to it; then you subtract 1 from it; don't you have what you started with?

With that in mind, I prefer to bite that bullet than talk about degrees of person-hood.

Well, I can't really argue with that. As long as you realize you're biting that bullet, I think we're still in a situation where it's just dueling intuitions. (Your intuition says one thing, mine another.)