All of semianonymous's Comments + Replies

The signal being what exactly?

Outside of politically motivated issues (e.g. global warming), most people tend to generally not disagree with accomplished scientists on the topics within that scientist's area of expertise and accomplishment, and to treat the more accomplished person as source of wisdom rather than as opponent in a debate. It is furthermore my honest opinion that Wang is more intelligent than Luke, and it is also the opinion that most reasonable people would share, and Luke must understand this.

It is not accusation or insult. It is the case though that the people in question (Luke, Eliezer) need to assume the possibility that people they are talking to are more intelligent than they are - something that is clearly more probable than not given available evidence - and they seem not to.

0Polymeron
I don't see how that would be relevant to the issue at hand, and thus, why they "need to assume [this] possibility". Whether they assume the people they talk to can be more intelligent than them or not, so long as they engage them on an even intellectual ground (e.g. trading civil letters of argumentation), is simply irrelevant.
-3ArisKatsaris
Trust me, it's quite easier to disregard an accusation/insult when you do not include an explicit chain of reasoning. It's harder to not respond to, because it mentally tags you as just 'enemy', but for the same reason it's easier to disregard. As for "being obtuse", don't confuse civility with obtuseness. I knew you for what you are. I knew that the trolling and the flamebaiting is what you attempted to do, So I knew that any attempts to direct you towards a more productive means of discussion wouldn't be heeded by you, as they were counterproductive to your true goals. But nonetheless, my suggestion has the benefit of explicitly pinpointing the failure in your postings, to be hopefully heeded by any others that are more honest at seeking to make an actual argument, not just troll people.

It also does not present valid inference. Ideally, you're right but in practice people do not make the inferences they do not like.

3ArisKatsaris
If you wanted to present the inference, then present it as an inference. e.g. "more accomplished (and thus I conclude more intelligent)" would have been vastly better than what you did, which was to just present your conclusion in a manner that would inevitably bait others to dispute it/take offense against it.

I try not to assume narcissist personality disorder. Most people have IQ around 100 and are perfectly comfortable with the notion that accomplished PhD is smarter than they are. Most smart people, also, are perfectly comfortable with the notion that someone significantly more accomplished is probably smarter than they are. Some people have NPD and have operating assumption 'I am the smartest person in the world' but they are a minority across entire spectrum of intelligence. There are also cultural differences.

1ArisKatsaris
How have you measured their level of comfort with the idea? Do you often tell such people that when they disagree with such an accomplished PhD, that the accomplished PhD is smarter than them? And do they tend to be appreciative of you saying that?

I fail to see how the suggestion that Wang is much smarter than Luke is an insult - unless Luke believes that there can't be a person much smarter than him.

2TheOtherDave
If you stand by this statement as written, I'm at a loss for what your starting assumptions about social interactions even look like. Conversely, if you only meant it as rhetorical hyperbole, would you mind glossing it with your actual meaning?

My point is that this bell curve shouldn't be a new argument, it should be the first step in your reasoning and if it was not, you must have been going in the other direction. You seem to be now doing the same with the original social status.

I think I have sufficiently answered your question: I find Wang's writings and accomplishments to require significantly higher intelligence (at minimum) than Luke's, and I started with normal distribution as the prior (as everyone should). In any game of wits with no massive disparity in training in favour of Luke, I would bet on Wang.

Ah, that's what you meant by the other remark. In that case, this isn't backing up claimed prior proxies and is a new argument.

New to you. Not new to me. Should not have been new to you either. Study and train to reduce communication overhead.

Anyone who has read what Luke has to say or interacted with Luke can tell pretty strongly that Luke is on the right side of the Bell curve.

Exercise for you: find formula for distribution of IQ of someone whom you know to have IQ>x . (I mean, find variance and other properties).

There are a lot of Chinese

... (read more)
-3wedrifid
The strength of your position is not commensurate with your level of condescension here. In fact, you seem to be just trying to find excuses to back up your earlier unjustified insults - that isn't something that JoshuaZ training and studying would help you with.
2JoshuaZ
Sorry if my point was unclear. The point is that this is a new argument in this discussion. That means it isn't one of the proxies listed earlier, so bringing it up isn't relevant to the discussion of those proxies. To use an analogy, someone could assert that the moon is made of rock and that their primary reason for thinking so is that Cthulhu said so. If when pressed on this, they point out that this is backed up by other evidence, this doesn't make revelation from Cthulhu turn into a better argument than it already was. This isn't a claim that his IQ as estimated is greater than x+ epsilon, since we can't measure any epsilon > 0. If you prefer, the point is that his writings and work demonstrate an IQ that is on the right end of the Bell curve by a non-trivial amount. That doesn't answer the question in any useful way especially because we don't know where Pei Wang's original social status was. The question is whether his coming to the US for graduate school is strongly indicative of intelligence to the point where you can use it as a proxy that asserts that Wang is "dramatically" more intelligent than Luke. Without more information or specification, this is a weak argument.

I apologise for my unawareness that you call China second world. It is still the case that it is very difficult to move from China to US.

Also, if we go back in time 20 years, so that Pei Wang would be about the same age Luke is now, do you think you'd have an accomplishment list for Pei Wang that was substantially longer than Luke's current one? If so, how does that impact your claim?

If we move back 20 years, it is 1992, and Pei Wang has already been a lecturer in China then moved to Indiana University. Length of the accomplishment list is a poor proxy... (read more)

-1JoshuaZ
Ah, that's what you meant by the other remark. In that case, this isn't backing up claimed prior proxies and is a new argument. Let's be clear on that. So how valid is this? I don't think this is a good argument at all. Anyone who has read what Luke has to say or interacted with Luke can tell pretty strongly that Luke is on the right side of the Bell curve. Sure, if I pick a random person the chance that they are as smart as Pei Wang is tiny, but that's not the case here. There are a lot of Chinese academics who come to the United States. So what do you mean by very difficult? He doesn't have his PhD at that point. He gets that at Indiana. I can't tell precisely from his CV what he means by lecturer, but at least in the US it often means a position primarily given for teaching rather than research. Given that he didn't have a doctorate at the time, it is very likely that it means something similar, what we might call an adjunct here. That it isn't a very good demonstration of intelligence at all. Luke has in his time run a popular blog that has been praised for its clarity and good writing. And you still haven't addressed the issue that Luke was never trying to go into academia.

There is very little data on Luke and that is a proxy for Luke being less intelligent, dramatically so. It is instrumental to Luke's goals to provide such data. On the second world or third world that is irrelevant semantics.

edit: and as rather strong evidence that Luke is approximately as intelligent as the least intelligent version of Luke that can look the same to us, it suffices to cite normal distribution of intelligence.

-1JoshuaZ
Replying in a second comment to the parts you edited in (to keep conversation flow clear and also so you see this remark): I outlined precisely why this wasn't just a semantic issue. China and most Chinese citizens are pretty well off and they have access to a decent education system. This isn't a semantic issue. A moderately smart random Chinese citizen has pretty decent chances at success. I don't understand this comment. I can't parse it in any way that makes sense. Can you expand/clarify on this remark? Also, is this to be understood as a new argument for a dramatic intelligence gap and not an attempt to address the previously listed proxies?
2JoshuaZ
That reply essentially ignores almost every comment I made. I'm particularly curious whether you are in agreement that Pei Wang isn't from a third world country? Does that cause any update at all for your estimates? Also, if we go back in time 20 years, so that Pei Wang would be about the same age Luke is now, do you think you'd have an accomplishment list for Pei Wang that was substantially longer than Luke's current one? If so, how does that impact your claim?

Accomplishments of all kinds, the position, the likelihood that Wang has actually managed to move from effectively lower class (third world) to upper class (but I didn't look up where he's from, yet), etc.

What proxies do you think would indicate Luke is more intelligent? I can't seem to think of any.

7ArisKatsaris
If accomplishments is the only proxy you use to evaluate their relative intelligence, then it would have been all-around better if you had said "more accomplished" rather than "more intelligent", as it's more precise, less controversial, and doesn't confuse fact with inference.
8JoshuaZ
Wang is accomplished to the point where one can immediately see it simply from glancing at his CV. However, accomplishments are only a rough measure of intelligence. By some metrics, Conscientiousness is a better predictor of success than raw intelligence, and by many metrics it is at least as good a predictor. Relying on academic success as a metric of intelligence isn't that reliable unless one is doing something like comparing the very top in a field. This also makes little sense given that Luke isn't a member of academia. The claim about the third world is puzzling- Wang is Chinese (a fact that I would think would be obvious from his name, and took me two seconds to verify by looking at his CV) and China has never been considered third world, but rather was (when the term made more sense) second world. Moreover, this isn't just an argument over the meaning of words- China's GDP per a capita_per_capita), average education level, average literacy level[1], or almost any other metric you choose is far higher than that of most countries classically considered to be in the third world. Wang is also older than Luke. Wang finished his undergraduate degree in 1983, so he's approximately in his early fifties now. Pei Wang has therefore had far more time to accomplish things. So simply lining up their accomplishment levels doesn't work. (Although Wang clearly does have some accomplishments at a fairly young age, such as his thesis being selected for an Outstanding Dissertation Award by his university.) I'm not sure why this question is being asked. I'm not aware of any either but it really doesn't have much to do with the matter at hand. You've claimed not just that Wang is likely to be more intelligent but that "Every single proxy for intelligence indicates a fairly dramatic gap in intelligence"- that requires a lot more than simply not having any obvious pointers for Luke to be smarter. Overall, I'm deeply unconvinced that either one is more intelligent. This isn't a

I'm unsure how you are getting more intelligent.

I'm unsure how you are not. Every single proxy for intelligence indicates a fairly dramatic gap in intelligence in favour of Wang. Of course for politeness sake we assume that they would be at least equally intelligent, and for phyg sake that Luke would be more intelligent, but it is simply very, very, very unlikely.

0JoshuaZ
Can you state explicitly what proxies you are using here that you think indicate a dramatic gap?
2Shmi
Not sure about the real or perceived intelligence level, but speaking the same language as your partner in a discussion certainly helps. Having reasonable credentials, while not essential, does not hurt, either. Oh, and my experience is that arguing with wedrifid is futile, just to warn you.
-2wedrifid
This is both petty and ridiculous - to the extent that Wang's work output can be considered representative of intelligence. Please do not move the discussion to evaluations of pure intelligence. I have no desire to insult the guy but raw intelligence is not the area where you should set up a comparison here.

If you clear away all the noise arising from the fact that this interaction constitutes a clash of tribal factions...

Pei seems to conflate the possibility...

I'm finding these dialogues worthwhile for (so far) lowering my respect for "mainstream" AI researchers...

and so on.

I think it'd be great if SIAI would not lath on the most favourable and least informative interpretation of any disagreement, in precisely the way how e.g. any community around free energy devices does. It'd be also great if Luke allowed for the possibility that Wang (and mos... (read more)

2JoshuaZ
2 of these 3 seems to be clearly the case. I'm unsure how you are getting more intelligent. Your point may be valid completely without the intelligence bit in that intelligent people can easily be deeply mistaken about areas they don't have much education, and one sees that not that infrequently. I'm am however curious how you are making the intelligence determination in question.
3wedrifid
The SIAI hasn't seemed to lath on any interpretations. The quote you make and all the interpretations you disagree with here have been done by commenters from the internet that aren't SIAI affiliated. The main thing Luke does that is a disservice to Wang is to post this conversation publicly, thereby embarrassing the guy and lowering his reputation among anyone who finds the reasoning expressed to be poor. But the conversation was supposed to be public and done with Wang's foreknowledge - presumably the arguments he used he actually wants to be associated with. As Grognor said (in the quote you made) this particular conversation served to significantly lower the perceived likelyhood that those things are correct. And this could become a real problem if it happens too often. Being exposed to too many bad arguments for a position can serve to bias the reader in the opposite direction to what has been argued. We need to find representatives from "mainstream AI researchers" that don't make the kind of simple errors of reasoning that we see here. Presumably they exist?

I think you must first consider simpler possibility that SIAI actually has a very bad argument, and isn't making any positive contribution to saving mankind from anything. When you have very good reasons to think it isn't so (high iq test scores don't suffice), very well verified given all the biases, you can consider possibility that it is miscommunication.

Well, my prior for someone on the internet who's asking for money being scam is no less than 99% (and I do avoid pascal mugging by not taking strings from such sources as proper hypotheses), and I think that is a very common prior, so there better be good evidence that it isn't scam - a panel of accomplished scientists and engineers, working to save the world, etc etc. think something on the scale of IPCC. rather than some weak evidence that it is scam, and something even less convincing than e.g. Steorn's perpetual motion device.

Scamming works best by sel... (read more)

You can eliminate the evidence that you consider double counted, for example grandiose self worth and grandiose plans, though those need to be both present because grandiose self worth without grandiose plans would just indicate some sort of miscommunication (and the self worth metric is more subjective), and are alone much poorer indicators than combined.

In any case accurate estimation of anything of this kind is very difficult. In general one just adopts a strategy such that sociopaths would not have sufficient selfish payoff for cheating it; altruism is... (read more)

I thought about it some more and the relevant question is - how do we guess what are his abilities? And what is his aptitude at those abilities? Is there statistical methods we can use? (e.g. SPR) What would the outcome be? How can we deduce his utility function?

Normally, when one has e.g. high mathematical aptitude, or programming aptitude, or the like, as a teenager one still has to work on it and train (the brain undergoes significant synaptic pruning at about 20 years of age, limiting your opportunity to improve afterwards), and regardless of the final... (read more)

I did understand his point. The issue is that the psychological traits are defined as what is behind the correlation, what ever this may be - brain lesion A, or brain lesion B, or weird childhood, or the like. They are very broad and are defined to include the 'other features'

It is probably better to drop the word 'sociopath' and just say - selfish - but then it is not immediately apparent why e.g. arrogance not backed by achievements is predictive of selfishness, even though it very much is, as it is a case of false signal of capability.

2lavalamp
I don't think it matters how it is defined... One still shouldn't double count the evidence.

The cat is defined outside being a combination of traits of owner; that is the difference between the cat and IQ or any other psychological measure. If we were to say 'pet', the formula would have worked, even better if we had a purely black box qualifier into people who have bunch of traits vs people who don't have bunch of traits, regardless of what is the cause (a pet, a cat, a weird fetish for pet related stuff).

It is however the case that narcissism does match sociopathy, to the point that difference between the two is not very well defined. Anyhow we... (read more)

0othercriteria
Given the asymptotic efficiency of the Bayes decision rule in a broad range of settings, those alternatives would give equivalent or less accurate classifications if enough training data (and computational power) were available. If this argument is not familiar, you might want to consult Chapter 2 of The Elements of Statistical Learning.

He is a high IQ individual, though. That is rare on its own. There are smart people who pretty much maximize their personal utility only.

People don't gain ability to program out of empty air... everyone able to program has long list of various working projects that they trained on. In any case, programming is real work, it is annoying, it takes training, it takes education, it slaps your ego on the nose just about every time you hit compile after writing any interesting code. And the newbies are grossly mistaken about their abilities. You can't trust anyone to measure their skills accurately, let alone report them.

3MixedNuts
Are you claiming (a non-negligible probability) that Eliezer would be a worse programmer if he'd decided to take up programming instead of AI research (perhaps because he would have worked on boring projects and given up?), or that he isn't competent enough to get hired as a programmer now?

She did expensive altruistic stuff that was more expensive than expected self interested payoff, though; the actions that are more expensive to fake than the win from faking are a very strong predictor for non-psychopathy; the distinction between psychopath that is genuinely altruistic, and non-psychopath, is that of philosophical zombie vs human.

7MixedNuts
Eliezer either picked a much less lucrative career than he could have gotten with the same hours and enjoyment because he wanted to be altruistic, or I'm mistaken about career prospects for good programmers, or he's a dirty rotten conscious liar about his ability to program.

People do it selectively, though. When someone does IQ test and gets high score, you assume that person has high IQ, for instance, and don't postulate existence of 'low IQ people whom solved first two problems on the test', whom would then be more likely to solve other, different problems, while having 'low IQ', and ultimately score high while having 'low IQ'.

To explain the issue here in intuitive terms: let's say we have the hypothesis that Alice owns a cat, and we start with the prior probability of a person owning a cat (let's say 1 in 20), and then update on the evidence: she recently moved from an apartment building that doesn't allow cats to one that does (3 times more likely if she has a cat than if she doesn't), she regularly goes to a pet store now (7 times more likely if she has a cat than if she doesn't), and when she goes out there's white hair on her jacket sleeves (5 times more likely if she has a... (read more)

6lavalamp
I don't think you understood DanielVarga's point. He's saying that the numbers available for some of those features already have an unknown amount of the other features factored in. In other words, if you update on each feature separately, you'll end up double-counting an unknown amount of the data. (Hopefully this explanation is reasonably accurate.) http://en.wikipedia.org/wiki/Conditional_independence

The 'sociopath' label is not a well identified brain lesion; it is a predictor for behaviours; the label is used for the purpose of decreasing the computational overhead by quantizing the quality (and to reduce communication overhead). One could in principle go without this label and directly predict the likehood of unethical self serving act based on the prior observed behaviour, and that is ideally better but more computationally expensive and may result in much higher failure rate.

This exchange is, by the way, why I do not think much of 'rationality' as... (read more)

0lavalamp
I think that's an overreaction... It's not that you can't do the math, it's that you have to be very clear on what numbers go where and understand which you have to estimate and which can be objectively measured.

They are not independent - the sociopathy (or lesser degree, narcissism) is a common cause.

I am talking about conditional independence. Let us assume that the answer to your first two questions is true, and now you have a posterior of 0.1 that he is a sociopath. Next you want to update on the third claim "Is he talking people into giving him money as source of income?". You have to estimate the ratio of people for whom the third claim is true, and you have to do it for two groups. But the two group is not sociopaths versus non-sociopaths. Rather, sociopaths for whom the first two claims are true versus non-sociopaths for whom the first two claims are true. You don't have any data that would help you to estimate these numbers.

Threads like that make me want to apply Bayes theorem to something.

You start with probability 0.03 that Eliezer is sociopath - the baseline. Then you do Bayesian updates on answers to questions like: Does he imagine grandiose importance to him or is he generally modest/in line with actual accomplishments? Does he have grand plans out of the line with his qualifications and prior accomplishments, or are the plans grandiose? Is he talking people into giving him money as source of income? Is he known to do very expensive altruistic stuff that is larger than s... (read more)

5Mitchell_Porter
Can you name one person working in AI, commercial or academic, whose career is centered on the issue of AI safety? Whose actual research agenda (and not just what they say in interviews) even acknowledges the fact that artificial intelligence is potentially the end of the human race, just as human intelligence was the end of many other species?

It seems you are talking about high-functioning psychopaths, rather than psychopaths according to the diagnostic DSM-IV criteria. Thus the prior should be different from 0.03. Assuming a high-functioning psychopath is necessarily a psychopath then it seems it should be far lower than 0.03, at least from looking at the criteria:

A) There is a pervasive pattern of disregard for and violation of the rights of others occurring since age 15 years, as >indicated by three or more of the following: failure to conform to social norms with respect to lawful beha

... (read more)
2gwern
I noticed in a HN comment Eliezer claimed to have gotten a vasectomy; I wonder if that's consistent or inconsistent with sociopathy? I can come up with plausible stories either way.
1MixedNuts
Note that Melinda Gates corresponds to the same criteria about as well.
9DanielVarga
Be aware that the conditional independence of these features (Naive Bayes Assumption) is not true.