Vladimir_Nesov comments on Pain - Less Wrong

32 Post author: Alicorn 02 August 2009 07:12PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (195)

You are viewing a single comment's thread.

Comment author: Vladimir_Nesov 02 August 2009 08:06:00PM *  2 points [-]

The problem with pain is its inherent stupidity in dealing with its goals and inability to even cooperate with reason. It'd get more points if it were like vision, informing but leaving more advanced parts of mind in peace to do the decision-making.

Comment author: Wei_Dai 02 August 2009 09:10:10PM 3 points [-]

I have a counter-example that seems to show that the badness of pain is not necessarily derived from its effect on decision-making. Suppose I tell you that I'm going to make a copy of your brain and keep it in a jar unconnected to any motor nerves/circuits. I'm going to do this no matter what, but unless you pay me X dollars, I'm also going to keep it in excruciating pain. (If you do pay up, I'll give it a neutral experience.) Assuming you're willing to pay more than 0 dollars, doesn't that show that even if pain has no bad effects on decision-making, it would still be bad?

Comment author: Vladimir_Nesov 02 August 2009 09:27:51PM 0 points [-]

I read it as a different question: what is bad about pain vs. what is the nature of pain's badness. The first question is about describing the ways in which pain isn't optimal, how its properties could be changed to improve the result (like a naive suggestion to completely eliminate it, which turns out to be a worse option). The second question is about what features in particular make people characterize pain on the bad side of things. It's a less constructive question, it considers specifically the current implementation rather than how its role could be better played by something else.

Comment author: Wei_Dai 02 August 2009 09:49:36PM 1 point [-]

The second question is about what features in particular make people characterize pain on the bad side of things.

This question seems just as constructive to me, but for a different purpose.

Suppose we want to outlaw people building brains (or running brain simulations or AIs) in their basements and forcing them to have bad experiences. We'll probably have to do this sooner or later, so it would be nice to understand what makes a bad experience bad. Since it's commonly agreed that pain is bad, it seems like a good starting point to study the nature of its badness.

Comment author: Vladimir_Nesov 02 August 2009 09:55:57PM *  0 points [-]

And this is a third question, about the nature of badness, for which pain is but a special case, not necessarily anywhere near the most salient one. I suspect pain only registers as an important example of badness because of availability bias, it's a particular incarnation of badness which people actually experience, as opposed to a concept of pure badness derived from an accurate theory of badness. You'd want to study the nature of badness, not the nature of pain.

Comment author: SilasBarta 02 August 2009 09:20:21PM -1 points [-]

The example doesn't show "pain that has no bad effects on decision-making". That excruciating pain you're going to put the brain through will fundamentally alter what decisions that brain will make, via diversion of its cognitive resources.

Perhaps you don't consider that effect on that brain's decision making to be bad. Why wouldn't you? If you're using the brain simulation to do human-level AI, you want it at its best. If you're researching how people respond to pain, then it can be good or bad depending on what the purpose of that research is.

Comment author: Wei_Dai 02 August 2009 09:27:16PM 0 points [-]

That excruciating pain you're going to put the brain through will fundamentally alter what decisions that brain will make, via diversion of its cognitive resources.

But I said that it's not connected to any motor nerves, so it has no decisions to make. Well, I suppose it can still decide what to think about, so let's say I also remove that ability and force its thoughts to drift randomly.

Comment author: SilasBarta 02 August 2009 09:31:02PM *  1 point [-]

But I said that it's not connected to any motor nerves, so it has no decisions to make.

Neither are most supercomputers connected to motor nerves, yet people are quite interested in their output!

Well, I suppose it can still decide what to think about, so let's say I also remove that ability and force its thoughts to drift randomly.

In that case, it's no longer clear if "pain" is even well-defined. Something whose thoughts truly drift randomly and are prevented from attaining any order ... is in a state of entropy; it does not even count as a control system, let alone life.

Comment author: Alicorn 02 August 2009 08:06:54PM 2 points [-]

So you think pain is bad because it is stupid?

Comment author: Vladimir_Nesov 02 August 2009 08:09:58PM 0 points [-]

Not up even to the human standards of sanity, yes.

Comment author: Alicorn 02 August 2009 08:14:31PM 8 points [-]

Is pleasure any less stupid? It's a little less demanding about attention, but arguably that has more to do with the commonly encountered intensity level.

Comment author: brian_jaress 02 August 2009 08:54:13PM 0 points [-]

There's an old saying: "The dose makes the poison."