Comment author: Nominull 17 June 2013 08:08:52AM -1 points [-]

It looks like he's turned the flawed methodology of the skeptic community (things like pattern-matching against surface features of known bullshit and mockery as an argument) on the skeptic community itself. I'd say "serves them right" except we're supposed to be virtuous identity-free robots who take no pleasure in or offense from anything.

Comment author: Leonhart 16 June 2013 10:06:18PM 2 points [-]

Well, yes, I'm often disvirtuous. I'm also often unsympathetic. These episodes reliably co-occur :)

But seriously, I'm now confused and don't think I was addressing your point. Eliezer seemed to me to be talking mostly about "uninteresting", not "unsympathetic", though I'm not clear to what extent these are orthogonal for him.

Can you unpack "sympathy" a bit? When I use it of Evil+Good character A, I think it means something like "I want to see A survive a bit longer, so that he/she can develop into character B, who is the happiest, healthiest, sanest extrapolation of A". I think Evil+Evil characters are unsympathetic/uninteresting in this sense; there's nothing there that I can extrapolate into someone I'd want to hang out with.

My brain's come up with two other possible components of 'sympathy' that strike me as somehow bad ideas (not attributing them to you): "I share some disvalued traits in common with character A, so not liking them makes me somehow hypocritical" "I'll form an alliance with A for mutual defence against social opprobrium for our shared flaw X"

Comment author: Nominull 16 June 2013 10:51:41PM 2 points [-]

It strikes me as a little awful to only care about bad people inasmuch as they're likely to become good people. Maybe I've been perverted by my Catholic upbringing, but I was taught to love everyone, including the sinners, including the people you'd never want to hang out with. This appeals to me in part because I sin and people don't want to hang out with me, and yet I want to be loved regardless.

It's possible that I am the weird one here, but shows with complex but evil characters such as Breaking Bad do seem largely popular. There is a large current in modern adult TV of these sorts of villainous antagonists, and I think it's more than just false sophistication. I think it's people with the courage to see the dark parts of themselves reflected in fictional characters.

Comment author: Nominull 16 June 2013 09:05:37PM 4 points [-]

I think this is probably being too kind to my unhandicapped abilities. Rather than handicapping myself because I'm too powerful, I think the key issue is that I see things on a metalevel and analytically, such that I can notice that there is little difference between "social adeptitude" and "manipulation". And so, in order to avoid being manipulative, I consciously avoid developing social skills. I think reflectivity and pathological non-hypocrisy are the key dynamics, not inherent manipulative ability.

Comment author: Leonhart 16 June 2013 11:55:08AM *  4 points [-]

You're confusing "evil" with "unsympathetic".

I don't think he is.

Perhaps "evil" here just means a object-level match against some entries in Nega-Frankena's list of of disvalues, including: death, apathy and stasis, sickness and enervation, pain and frustration of all or certain kinds, unhappiness, blight, malcontent, etc; untruth; delusion and lies of various kinds, incomprehension, folly; ugliness, discord, monstrosity in objects contemplated; numbing experience; morally bad dispositions or flaws; mutual contempt, hatred, enmity, defection; unjust distribution of goods and evils; mania and obsession in one's own life; helplessness and experience of impotence; pointless abnegation; enslavement; strife, terror; tedium and repetition; and bad reputation, disgrace, shame, etc.

Comment author: Nominull 16 June 2013 06:46:03PM 1 point [-]

Right, but he seems to implicitly claim that characters who follow those disvirtues are necessarily unsympathetic. Some of us are sometimes disvirtuous.

Comment author: gwern 14 June 2013 03:25:59AM *  39 points [-]

I thought you were exaggerating there, but I looked it up in my copy and he really did say that: pg684-686:

To conclude this Chapter, I would like to present ten "Questions and Speculations" about AI. I would not make so bold as to call them "Answers" - these are my personal opinions. They may well change in some ways, as I learn more and as AI develops more...

Question: Will there be chess programs that can beat anyone?

Speculation: No. There may be programs which can beat anyone at chess, but they will not be exclusively chess players. They will be programs of general intelligence, and they will be just as temperamental as people. "Do you want to play chess?" "No, I'm bored with chess. Let's talk about poetry." That may be the kind of dialogue you could have with a program that could beat everyone. That is because real intelligence inevitably depends on a total overview capacity - that is, a programmed ability to "jump out of the system", so to speak - at least roughly to the extent that we have that ability. Once that is present, you can't contain the program; it's gone beyond that certain critical point, and you just have to face the facts of what you've wrought.

I wonder if he did change his opinion on computer chess before Deep Blue and how long before? I found two relevant bits by him, but they don't really answer the question except they sound largely like excuse-making to my ears and like he was still fairly surprised it happened even as it was happening; from February 1996:

Several cognitive scientists said Deep Blue's victory in the opening game of the recent match told more about chess than about intelligence. "It was a watershed event, but it doesn't have to do with computers becoming intelligent," said Douglas Hofstadter, a professor of computer science at Indiana University and author of several books about human intelligence, including "Godel, Escher, Bach," which won a Pulitzer Prize in 1980, with its witty argument about the connecting threads of intellect in various fields of expression. "They're just overtaking humans in certain intellectual activities that we thought required intelligence. My God, I used to think chess required thought. Now, I realize it doesn't. It doesn't mean Kasparov isn't a deep thinker, just that you can bypass deep thinking in playing chess, the way you can fly without flapping your wings."...In "Godel, Escher, Bach" he held chess-playing to be a creative endeavor with the unrestrained threshold of excellence that pertains to arts like musical composition or literature. Now, he says, the computer gains of the last decade have persuaded him that chess is not as lofty an intellectual endeavor as music and writing; they require a soul. "I think chess is cerebral and intellectual," he said, "but it doesn't have deep emotional qualities to it, mortality, resignation, joy, all the things that music deals with. I'd put poetry and literature up there, too. If music or literature were created at an artistic level by a computer, I would feel this is a terrible thing."

And from January 2007:

Kelly said to me, "Doug, why did you not talk about the singularity and things like that in your book?" And I said, "Frankly, because it sort of disgusts me, but also because I just don't want to deal with science-fiction scenarios." I'm not talking about what's going to happen someday in the future; I'm not talking about decades or thousands of years in the future...And I don't have any real predictions as to when or if this is going to come about. I think there's some chance that some of what these people are saying is going to come about. When, I don't know. I wouldn't have predicted myself that the world chess champion would be defeated by a rather boring kind of chess program architecture, but it doesn't matter, it still did it. Nor would I have expected that a car would drive itself across the Nevada desert using laser rangefinders and television cameras and GPS and fancy computer programs. I wouldn't have guessed that that was going to happen when it happened. It's happening a little faster than I would have thought, and it does suggest that there may be some truth to the idea that Moore's Law [predicting a steady increase in computing power per unit cost] and all these other things are allowing us to develop things that have some things in common with our minds. I don't see anything yet that really resembles a human mind whatsoever. The car driving across the Nevada desert still strikes me as being closer to the thermostat or the toilet that regulates itself than to a human mind, and certainly the computer program that plays chess doesn't have any intelligence or anything like human thoughts.

Comment author: Nominull 16 June 2013 09:09:48AM 5 points [-]

I suspect the thermostat is closer to the human mind than his conception of the human mind is.

Comment author: hedges 15 June 2013 08:01:27PM 0 points [-]

It almost certainly is, but does that matter? It is a slogan for any time when the powers that be are diminished by the truth.

Comment author: Nominull 16 June 2013 08:47:57AM 5 points [-]

Today we kneel only to hypocrisy.

Comment author: Nominull 16 June 2013 08:43:41AM 1 point [-]

You're confusing "evil" with "unsympathetic". Maybe those mean the same thing to you, but we don't all have your unimpeachable moral character.

Comment author: DataPacRat 15 June 2013 03:16:14PM 4 points [-]

Fortunately, I keep a quotefile for just such an occasion. Here are some of the pithier entries:

Peace if possible, truth at all costs. -- Martin Luther

Trust, but verify -- Russian saying

Live forever or die trying

I intend to live forever. So far, so good. -- Rick Potvin

Give me immortality or death. -- Nick de Jongh

"I'm not a psychopath, I'm just very creative"

TANSTAAFL -- Heinlein

What you don't know will kill you. -- The Cynic's Book of Wisdom

Half of knowledge is knowing the questions. -- The Cynic's Book of Wisdom

Look behind the curtain. -- The Cynic's Book of Wisdom

Plus a couple of my personal favorites:

Why should I believe that?

Then again, I could be wrong.

Comment author: Nominull 16 June 2013 05:05:01AM 8 points [-]

Peace if possible, truth at all costs. -- Martin Luther

The fact that he started some really bloody wars over something that didn't even turn out to be true should maybe give us some pause before we endorse virtues like this.

Comment author: Manfred 11 May 2013 07:35:15PM 3 points [-]

And, being right.

Comment author: Nominull 18 May 2013 08:17:19AM 1 point [-]

That's harder to distinguish from the outside.

Comment author: Qiaochu_Yuan 12 May 2013 08:42:49PM 7 points [-]

If you only have political opinions for the status benefits, then why would you need to calibrate them?

Comment author: Nominull 15 May 2013 01:02:24AM 1 point [-]

If you run in social circles where having well-calibrated beliefs is high-status, not gonna name any names.

View more: Prev | Next