Comment author: rwallace 13 June 2009 02:50:54PM -2 points [-]

rhollerith:

"Strongly-recursive self-improvement" is a figment of the imagination; among the logical errors involved is confusion between properties of a program and properties of the world.

As for the rest: do you believe humanity can survive permanently as we are now, confined to this planet? If you do, then I will point you to the geological evidence to the contrary. If not, then it follows that without more advanced technology, we are dead. Neither I nor anybody else can know what will be the proximate cause of death for the last individual, or in what century, but certain extinction is certain extinction nonetheless.

Comment author: rhollerith 14 June 2009 12:40:01AM 4 points [-]

Let us briefly review the discussion up to now since many readers use the the comments page which does not provide much context. rwallace has been arguing that AI researchers are too concerned (or will become too concerned) about the existential risk from reimplementing EURISKO and things like that.

You have mentioned two or three times, rwallace, that without more advanced technology, humans will eventually go extinct. (I quote one of those 2 or 3 mentions below.) You mention that to create and to manage that future advanced technology, civilization will need better tools to manage complexity. Well, I see one possible objection to your argument right there, in that better science and better technology might well decrease the complexity of the cultural information humans are required to keep on top of. Consider that once Newton gave our civilization a correct theory of dynamics, almost all of the books written before Newton on dynamics could safely be thrown away (the exceptions being books by Descartes and Galileo that help people understand Newton and put Newton in historical context) which of course constitutes a net reduction in the complexity of the cultural information that our civilization has to keep on top of. (If it does not seem like a reduction, that is because the possession of Newtonian dynamical theory made our civilization more ambitious about what goals to try for.)

do you believe humanity can survive permanently as we are now, confined to this planet? If you do, then I will point you to the geological evidence to the contrary. If not, then it follows that without more advanced technology, we are dead.

But please explain to me what your argument has to do with EURISKO and things like that: is it your position that the complexity of future human culture can be managed only with better AGI software?

And do you maintain that that software cannot be developed fast enough by AGI researchers such as Eliezer who are being very careful about existential risks?

In general, the things you argue are dangerous are slow dangers. You yourself refer to "geological evidence" which suggests that they are dangerous on geological timescales.

In contrast, research into certain areas of AI seems to me genuinely fast dangers: things with a high probability of wiping out our civilization in the next 30, 50 or 100 years. It seems unwise to increase fast dangers to decrease slow dangers. But I suppose you disagree that AGI research if not done very carefully is a fast danger. (I'm still studying your arguments on that.)

Comment author: rwallace 13 June 2009 01:37:22PM 8 points [-]

Basically yes. Civilizations, species and worlds are mortal; there are rare long-lived species whose environment has remained unchanged for long periods of time, but the environment in which we evolved is long gone and our current one is not merely not stable, it is not even in equilibrium. And as long as we remain confined to one little planet running off a dwindling resource base and with everyone in weapon range of everyone else, there is nothing good about our long-term prospects. (For a fictional but eloquent discussion of some of the issues involved, see Permanence by Karl Schroeder.)

To change that, we need more advanced technology, for which we need software tools smart enough to help us deal with complexity. If our best minds start buying into the UFAI meme and turning away from building anything more ambitious than a social networking mashup, we may simply waste whatever chance we had. That is why UFAI belief is not as its proponents would have it the road of safety, but the road of oblivion.

Comment author: rhollerith 13 June 2009 02:30:31PM *  2 points [-]

rwallace has been arguing the position that AI researchers are too concerned (or will become too concerned) about the existential risk from UFAI. He writes that

we need software tools smart enough to help us deal with complexity.

rwallace: can we deal with complexity sufficiently well without new software that engages in strongly-recursive self-improvement?

Without new AGI software?

One part of the risk that rwallace says outweighs the risk of UFAI is that

we remain confined to one little planet . . . with everyone in weapon range of everyone else

The only response rwallace suggests to that risk is

we need more advanced technology, for which we need software tools smart enough to help us deal with complexity

rwallace: please give your reasoning for how more advanced technology decreases the existential risk posed by weapons more than it increases it.

Another part of the risk that rwallace says outweighs the risk of UFAI is that

we remain confined to one little planet running off a dwindling resource base

Please explain how dwindling resources presents a significant existential risk. I can come up with several argument, but I'd like to see the one or two you consider the strongest arguments.

Comment author: MichaelVassar 13 June 2009 12:40:31PM 1 point [-]

I voted that up, because it's an important point, but I want to emphasize that I don't want to encourage the scientistic attitude of rejecting introspection as a valid tool either. Given the community I think that should have been emphasized.

Comment author: rhollerith 13 June 2009 02:01:10PM 0 points [-]

I agree that introspection certainly can be a valid tool.

Comment author: michaelkeenan 13 June 2009 10:44:35AM 1 point [-]

I have a strong pain signal from lost money and from lost time. To the extent that I can introspect on the workings of my insula, I think that this is one impulse for me, rather than two as Yvain describes - one for time and one for money.

If I am correct that my brain processes the loss of time using the same moral hardware as the loss of money, what could explain why some people have one impulse covering both cases, while other people have a separate one for each?

Comment author: rhollerith 13 June 2009 12:35:33PM *  2 points [-]

I have a strong pain signal from lost money and from lost time. To the extent that I can introspect on the workings of my insula, I think that this is one impulse for me, rather than two as Yvain describes - one for time and one for money.

The most parsimonious explanation of what you observe is that it is human nature to be overconfident of the results of introspection.

Comment author: pjeby 05 June 2009 09:18:12PM 3 points [-]

Lots of people offer pointers to somebody else's writings. Most of those people do not know enough about how to produce lasting useful psychological change to know when a document or an author is actually worth the reader's while. IMHO almost all the writings on the net about producing lasting useful psychological change are not worth the reader's while.

You missed the point - I was pointing out there is no financial incentive for me to send somebody to download somebody else's free stuff, when I sell workshops on the same topic.

The fact that you use hypnotic techniques on clients and write a lot about hypnosis raises probability D significantly because hypnotic techniques rely on the natural human machinery for negotiating who is dominant and who is submissive or the natural human machinery for deciding who will be the leader of the hunting party. Putting the client into a submissive or compliant state of mind probably helps a practitioner quite a bit to persuade the client to believe falsely that lasting change has been produced. You have presented no evidence or argument -- nor am I aware of any evidence or argument -- that putting the client into a submissive or compliant state helps a practitioner producing lasting change. Consequently, your reliance on and interest in hypnotic techniques significantly raises probability D.

Holy cow, you're confused. To actually refute the huge chain of fallacies you've just perpetrated seems like it would take me all day. Nonetheless, I shall try to be brief:

  1. I do not use formal hypnosis. I have recently been interested in the similarities between certain effects of hypnosis and my techniques.

  2. I am not aware of any connection between hypnosis, dominance, and hunting parties, and would be very, very surprised if any arose, unless perhaps we're talking about stage hypnotism. The tools I work with are strictly ones of monoidealism and ideodynamics... which are at work whenever you start thinking you're hungry until it becomes enough of an obsession for you to walk to the fridge. That is what monoidealism and ideodynamics are: the absorption of the imagination upon a single thought until it induces emotional, sensory, or physical response.

  3. I do not consider my work to be done until someone is surprised by their behavior or their automatic responses, specifically in order to avoid "false placebo" effects. Sometimes, a person will say they think they changed or that something changed a little bit, and my response to that is always to question it, to find out specifically what is happening. A true success nearly always involves something that the person did not expect -- indicating that their S1 behavior model has changed, relative to their S2 self-modeling.

  4. A state of submission is not useful to my work; I spend a considerable effort getting clients out of such states, because then they will spend ridiculous amounts of time deprecating themselves, instead of actually answering the questions I ask.

Whew. I think that'll do for now.

When you believe for example that you have produced a lasting improvement in a male client's ability to pick up women in bars, have you ever actually accompanied the client to a bar and observed how long it takes the client to achieve some objectively-valid sign of success (such as getting the woman's phone number or getting the woman to follow the client out to his car)?

I do not believe I have produced such an improvement. I have had only one client who asked for anything like this, and it was for alleviation of specific fears in the matter... and the result was what I'd consider a partial success. That is, the alleviation of some of the fears, and not others. The client did not pursue the matter further with me, but has a girlfriend now. I don't know whether he met her in a bar or not, but then, the situation we discussed was talking to a girl on the subway. ;-)

If someone wants to learn to do pickup, they should go to a pickup coach. I don't teach pickup, and I'm not a coach.

In your extensive writings on this site, I can recall no instance where you describe your verifying your impression that you have created a lasting change in a client using reliable means. Rather, you have described only unreliable means, namely, your perceptions of the mental and the social environment and reports from clients about their perceptions of the mental and the social environment. That drastically raises probability D. Of course, you can bring probability D right back down again, and more, by describing instances where you have used reliable means to verify your impression that you have created a lasting change.

Since it is my clients' perceptions that determine their behavior (not to mention their satisfaction), what else is it that I should measure, besides their perceptions? What measurement of the goodness of their lives shall I use? Is there such a thing as a scale for objectively determining how good someone's life is?

I seem to remember someone who said something along the lines of "we pretend to treat people, and if we pretend really well, they will pretend to get better... for the rest of their lives." The point is not about pretending, the point is that virtually all of the measuring tools we have for subjective experience are themselves subjective. (Somatic markers are at least empirical, though still not entirely objective.)

In my book, until I see very strong evidence to the contrary, every mental-health practitioner and self-help practitioner is with high probability deluded except those that constantly remind themselves of how little they know.

I am most curious as to what this evidence would look like. How would you measure it? I would truly love to know about such an absolute measure, if it existed, because even if my methods scored low on it, it would offer me untold opportunity to improve -- provided, of course, it gave relatively fast feedback.

(I use somatic markers for measurement because they give extremely fast feedback, and sometimes fast feedback with modest accuracy can be much more useful than a precise measurement that takes weeks or months.)

I worry that your copious writings on this site will discourage contributions from those who have constructed their causal model of mental and social reality more carefully.

  1. Replying to me with this type of thing is not a good way to discourage me from writing here.

  2. Your models are not nearly as carefully constructed as mine, or you wouldn't be confusing hypnosis with social dominance.

Comment author: rhollerith 05 June 2009 10:23:42PM 1 point [-]

When I wrote that "it is never in the financial self-interest of any [self-help] practitioner to do the hard long work to collect evidence that would sway a non-gullible client," I referred to long hard work many orders of magnitude longer and harder than posting a link to a web page. Consequently, your pointing out that you post links to web pages even when it is not in your financial self-interest to do so does not refute my point. I do not maintain that you should do the long hard work to collect evidence that would sway a non-guillible client: you probably cannot afford to spend the necessary time, attention and money. But I do wish you would stop submitting to this site weak evidence that would sway only a gullible client or a client very desperate for help.

And with that I have exceeded the time I have budgeted for participation on this site for the day, so my response to your other points will have to wait for another day. If I may make a practical suggestion to those readers wanting to follow this thread: subscribe to the feed for my user page till you see my response to pjeby's other points, then unsubscribe.

Comment author: pjeby 05 June 2009 06:09:03PM 5 points [-]

But I fear that PJ Eby has nothing that a strong Bayesian would consider evidence that he can help me transcend this problem. Such is the state of the art in self help: there are enough gullible prospective clients that it is never in the financial self-interest of any practictioner to do the hard long work to collect evidence that would sway a non-guillible client.

I notice you ignored the part where I just gave somebody a pointer to somebody else's work that they could download for free to help with that, and then you indirectly accused me of being more interested in financial incentives than results... while calling nazgulnarsil gullible, too!

If that's an example of your ordinary social demeanor, then it's not in the least bit surprising that people think you hold them in contempt, as it's not even necessary to observe any of your "nonverbal" communication to obtain this impression.

Comment author: rhollerith 05 June 2009 08:01:18PM *  5 points [-]

Previously in this thread I opined as follows on the state of the art in self help: there are enough gullible prospective clients that it is never in the financial self-interest of any practitioner to do the hard long work to collect evidence that would sway a non-guillible client.

PJ Eby took exception as follows:

you ignored the part where I just gave somebody a pointer to somebody else's work that they could download for free

Lots of people offer pointers to somebody else's writings. Most of those people do not know enough about how to produce lasting useful psychological change to know when a document or an author is actually worth the reader's while. IMHO almost all the writings on the net about producing lasting useful psychological change are not worth the reader's while.

In the future, I will write "lasting change" when I mean "lasting useful psychological change".

you indirectly accused me of being more interested in financial incentives than results

The mere fact that you are human makes it much more probable than not that you are more skilled at self-deception and deception than at perceiving correctly the intrapersonal and interpersonal truths necessary to produce lasting change in another human being. Let us call the probability I just referred to "probability D". (The D stands for deception.)

You have written (in a response to Eliezer) that you usually charge clients a couple of hundred dollars an hour.

The financial success of your self-help practice is not significant evidence that you can produce lasting change in clients because again there is a plentiful supply of gullible self-help clients with money.

The fact that you use hypnotic techniques on clients and write a lot about hypnosis raises probability D significantly because hypnotic techniques rely on the natural human machinery for negotiating who is dominant and who is submissive or the natural human machinery for deciding who will be the leader of the hunting party. Putting the client into a submissive or compliant state of mind probably helps a practitioner quite a bit to persuade the client to believe falsely that lasting change has been produced. You have presented no evidence or argument -- nor am I aware of any evidence or argument -- that putting the client into a submissive or compliant state helps a practitioner producing lasting change. Consequently, your reliance on and interest in hypnotic techniques significantly raises probability D.

Parenthetically, I do not claim that I know for sure that you are producing false beliefs rather than producing lasting change. It is just that you have not raised the probability I assign to your being able to produce lasting change high enough to justify my choosing to chase a pointer you gave into the literature or high enough for me to stop wishing that you would stop writing about how to produce lasting change in another human being on this site.

Parenthetically, I do not claim that your deception, if indeed that is what it is, is conscious or intentional. Most self-help and mental-health practitioners deceive because they are self-deceived on the same point.

You believe and are fond of repeating that a major reason for the failure of some of the techniques you use is a refusal by the client to believe that the technique can work. Exhorting the client to refrain from scepticism or pessimism is like hypnosis in that it strongly tends to put the client in a submissive or compliant state of mind, which again significantly raises probability D.

To the best of my knowledge (maybe you can correct me here) you have never described on this site an instance where you used a reliable means to verify that you had produced a lasting change. When you believe for example that you have produced a lasting improvement in a male client's ability to pick up women in bars, have you ever actually accompanied the client to a bar and observed how long it takes the client to achieve some objectively-valid sign of success (such as getting the woman's phone number or getting the woman to follow the client out to his car)?

In your extensive writings on this site, I can recall no instance where you describe your verifying your impression that you have created a lasting change in a client using reliable means. Rather, you have described only unreliable means, namely, your perceptions of the mental and the social environment and reports from clients about their perceptions of the mental and the social environment. That drastically raises probability D. Of course, you can bring probability D right back down again, and more, by describing instances where you have used reliable means to verify your impression that you have created a lasting change.

For readers who want to read more, here are two of Eliezer's sceptical responses to PJ Eby: [001][1], [002][2]

If it makes you feel any better, I am not seeing you any more harshly than I see any other self-help, life-coach or mental-health practitioner, including those with PhDs in psychology and MDs in psychiatry and those with prestigious academic appointments. In my book, until I see very strong evidence to the contrary, every mental-health practitioner and self-help practitioner is with high probability deluded except those that constantly remind themselves of how little they know.

Actually there is one way in which I resent you more than I resent other self-help, life-coach or mental-health practitioners: the other ones do not bring their false beliefs or rather their most-probably-false not-sufficiently-verified beliefs to my favorite place to read about the mental environment and the social environment. I worry that your copious writings on this site will discourage contributions from those who have constructed their causal model of mental and social reality more carefully.

Comment author: nazgulnarsil 05 June 2009 07:38:53AM 4 points [-]

this is my problem. I look great on paper but as soon as you get me in a social situation I can't hide the fact that I feel contempt for the vast majority of the people around me (including desirable partners). I think the problem is that I connect behaviors I see in those around me to larger scale social problems even though this is stupid overgeneralizing. is there anything you could point to since your awareness of it makes me think you've dealt with it yourself.

Comment author: rhollerith 05 June 2009 05:55:01PM *  0 points [-]

Previously in this thread: PJ Eby asserts that the inability to refrain from conveying contempt is a common and severe interpersonal handicap. Nazgulnarsil replies, "This is my problem. . . . I can't hide the fact that I feel contempt for the vast majority of the people around me (including desirable partners)."

I probably have the problem too. Although it is rare that I am aware of feeling contempt for my interlocutor, there is a lot of circumstantial evidence that messages (mostly nonverbal) conveying contempt are present in my face-to-face communication with non-friends (even if I would like the non-friend to become a friend).

I expect that PJ Eby will assure me that he has seen himself and his clients learn how to transcend this problem. Maybe he can even produce written testimonials from clients assuring me that PJ Eby has cured them of this problem. But I fear that PJ Eby has nothing that a strong Bayesian with long experience with self-help practitioners would consider sufficient evidence that he can help me transcend this problem. Such is the state of the art in self help: there are enough gullible prospective clients that it is never in the financial self-interest of any practitioner to do the hard long work to collect evidence that would sway a non-guillible client.

Comment author: JanetKw 05 June 2009 08:50:57AM 6 points [-]

I have been looking at this site everyday for some time. I have to say that the label 'rationalist' has made me suspicious and on guard. I have so far found nothing to confirm my suspicions and many interesting postings. Perhaps I will soon lose the feeling of suspicion. But every single time that the word 'rationalist' is used, I see the ghost of the hated Ayn Rand in the background. If you don't want to be suspected of a Rand sort of philosophy then I think you would be wise to coin another term.

Comment author: rhollerith 05 June 2009 09:36:11AM *  0 points [-]

I changed the title of my post from "Mate selection for the male rationalist" to "Mate selection for the men here".

Comment author: knb 04 June 2009 04:40:16AM 1 point [-]

I agree that rationality is a desirable feature, all else equal. But how much facial symmetry, or sexual compatibility, would male rationalists give up for an extra unit of rationality in their partners?

Perhaps this is just my personal failing, but I find that my answer is not very much.

Comment author: rhollerith 04 June 2009 10:51:17PM 1 point [-]

We differ in that respect, perhaps because I have had more time slowly to shape my emotional responses to women.

Comment author: rhollerith 04 June 2009 09:36:52PM 0 points [-]

BTW it would be great to have all my writings subjected to examination by the community to determine whether the writings use probability distributions, utility functions and the language of causality correctly and sensibly.

View more: Next