I've been thinking about wireheading and the nature of my values. Many people here have defended the importance of external referents or complex desires. My problem is, I can't understand these claims at all.
To clarify, I mean wireheading in the strict "collapsing into orgasmium" sense. A successful implementation would identify all the reward circuitry and directly stimulate it, or do something equivalent. It would essentially be a vastly improved heroin. A good argument for either keeping complex values (e.g. by requiring at least a personal matrix) or external referents (e.g. by showing that a simulation can never suffice) would work for me.
Also, I use "reward" as short-hand for any enjoyable feeling, as "pleasure" tends to be used for a specific one of them, among bliss, excitement and so on, and "it's not about feeling X, but X and Y" is still wireheading after all.
I tried collecting all related arguments I could find. (Roughly sorted from weak to very weak, as I understand them, plus link to example instances. I also searched any literature/other sites I could think of, but didn't find other (not blatantly incoherent) arguments.)
- People do not always optimize their actions based on achieving rewards. (People also are horrible at making predictions and great at rationalizing their failures afterwards.)
- It is possible to enjoy doing something while wanting to stop or vice versa, do something without enjoying it while wanting to continue. (Seriously? I can't remember ever doing either. What makes you think that the action is thus valid, and you aren't just making mistaken predictions about rewards or are being exploited? Also, Mind Projection Fallacy.)
- A wireheaded "me" wouldn't be "me" anymore. (What's this "self" you're talking about? Why does it matter that it's preserved?)
- "I don't want it and that's that." (Why? What's this "wanting" you do? How do you know what you "want"? (see end of post))
- People, if given a hypothetical offer of being wireheaded, tend to refuse. (The exact result depends heavily on the exact question being asked. There are many biases at work here and we normally know better than to trust the majority intuition, so why should we trust it here?)
- Far-mode predictions tend to favor complex, external actions, while near-mode predictions are simpler, more hedonistic. Our true self is the far one, not the near one. (Why? The opposite is equally plausible. Or the falsehood of the near/far model in general.)
- If we imagine a wireheaded future, it feels like something is missing or like we won't really be happy. (Intuition pump.)
- It is not socially acceptable to embrace wireheading. (So what? Also, depends on the phrasing and society in question.)
(There have also been technical arguments against specific implementations of wireheading. I'm not concerned with those, as long as they don't show impossibility.)
Overall, none of this sounds remotely plausible to me. Most of it is outright question-begging or relies on intuition pumps that don't even work for me.
It confuses me that others might be convinced by arguments of this sort, so it seems likely that I have a fundamental misunderstanding or there are implicit assumptions I don't see. I fear that I have a large inferential gap here, so please be explicit and assume I'm a Martian. I genuinely feel like Gamma in A Much Better Life.
To me, all this talk about "valueing something" sounds like someone talking about "feeling the presence of the Holy Ghost". I don't mean this in a derogatory way, but the pattern "sense something funny, therefore some very specific and otherwise unsupported claim" matches. How do you know it's not just, you know, indigestion?
What is this "valuing"? How do you know that something is a "value", terminal or not? How do you know what it's about? How would you know if you were mistaken? What about unconscious hypocrisy or confabulation? Where do these "values" come from (i.e. what process creates them)? Overall, it sounds to me like people are confusing their feelings about (predicted) states of the world with caring about states directly.
To me, it seems like it's all about anticipating and achieving rewards (and avoiding punishments, but for the sake of the wireheading argument, it's equivalent). I make predicitions about what actions will trigger rewards (or instrumentally help me pursue those actions) and then engage in them. If my prediction was wrong, I drop the activity and try something else. If I "wanted" something, but getting it didn't trigger a rewarding feeling, I wouldn't take that as evidence that I "value" the activity for its own sake. I'd assume I suck at predicting or was ripped off.
Can someone give a reason why wireheading would be bad?
I do not mean that Wireheading is metaphorical death. It is not just an emotionally charged statement that means I am really against Wireheading. I mean that Wireheading is literally death.
The cluster of death-space consists of more than just stopping breathing. I am arguing that the important boundary in the definition-space of death is not 'stopped breathing' but 'inability to affect the outside world'. Imagine the following Omega enabled events, rest assured that none of them are reversible once Omega stops toying with you and finishes this experiment. Ask yourself if you consider the following states death:
1 -Omega transforms your body into a corpse! You cannot move or do anything a corpse cannot do.
2-Omega transforms your body into a corpse, but lets you keep moving and taking actions. You return back to work on monday, and thankfully there's no extra smell.
3-Omega teleports you to a dimension of nothingness, and you're stuck there for all eternity.
4-Omega teleports you to a dimension full of nothingness, then brings you back out a year later.
5-Omega turns you into a tree. You're not able to do anything a tree cannot do, like think, move, or anything of the sort.
6-Omega turns you into a tree, but gives you the power to move and think and talk in rhymes.
7-Omega keeps your body the same, but severs your ability to do anything including moving your eyes or blinking. Luckily your autonomic system keeps you breathing and someone puts you a nutrient drip before that 'not eating' thing catches up to you.
8-Omega keeps your body the same, but separates your ability to do anything into a separate non-corporeal facility. IE, you can move things with your mind.
9-Omega replaces your body with a corpse doll and shifts you into a parallel plane where you can view the world but not interact.
10-Omega replaces your body with a corpse doll and shifts you into a parallel plane where you can both view and interact with the world.
All the odd numbers seem straight up death to me. 1 is regular death, 3 is getting sucked into a black hole, 5 is well dieing and having a tree planted on you, 7 is brain death, and 9 is christian death. All the even numbers, even though they're identical except your how much you can effect the world, feel like you're gaining superpowers. Well, except that solitary confinement for a year one. The meaningful divide of death is not if we've stopped breathing or even stopped existing, it's whether or not we can effect the outside world.
Being strapped into the pleasure machine lets us still breath like brain death, but takes away our ability to do anything, just like brain death. Wireheading that takes away our ability to effect the outside world kills us.
(Thanks for the clarification, that makes your comment much clearer.)
How would 2) work? What do you mean, my body becomes a corpse, but goes to work? As a corpse, I won't have blood circulation for example, so how could I walk? Unless Omega magically turns me into an actual zombie, but what's the use of thinking about magic?
Similarly, 6) ain't a tree, but at best a brain stuck in a tree.
Does 3) include myself as separate from the nothingness? So I'm essentially "floating" in nothingness, kinda like a Boltzmann brain?
8) isn't possible in principle... (read more)