Kip : The Newcombe problem only needs about 30 seconds thought: as soon as you've postulated reversed causality, any reasoning based on the premise 'there's 1m€ in box B at the moment of decision' breaks down on the meaninglessness of the notion 'at the moment of decision' under reversed causality. Are all 'philosophical paradoxes' so trite ? At least I suppose while people are 'exercising their thinking' over such trivialities they're not doing us serious harm by working on self-improving AI.
Come to think of it, there was a system which held the rank and file to be the employers and the politicians to be employees. It was called Marxism.... Must check up how it worked out.
Between the post and the comments we have a slippage from : a) the human tendency to sort ourselves into 'us' vs 'them', presumably for reasons which had selective advantage (group solidarity and heightened stimulation levels) b) our capacity to keep the positive aspects of a diluted form of this tendency, without having to pay the price of all out warfare, by choosing (deservedly highly paid) sports teams to be our 'champions' (in the sense of the word where a 'champion' was designated to represent a warring group in single combat) in facing 'them' c) the...
Between the post and the comments we have a slippage from : a) the human tendency to sort ourselves into 'us' vs 'them', presumably for reasons which had selective advantage (group solidarity and heightened stimulation levels) b) our capacity to keep the positive aspects of a diluted form of this tendency, without having to pay the price of all out warfare, by choosing (deservedly highly paid) sports teams to be our 'champions' (in the sense of the word where a 'champion' was designated to represent a warring group in single combat) in facing 'them' c) the...
Politicians are the Hated Enemy today ?
Q : Why is everyone linking together cryonicism, life-extensionism, trans-humanism, and the singularity ? In addition to Caledonian's irritability, I would add : A : Because the two main posters here seem to subscribe to the extreme desirability of all three, (counting trans-humanism and the singularity for one item translating as Self-Improving AI), in a nexus centred on the Singularity Institute.
personal take : a) Cryonics : couldn't care less b) Radical life extension : playing with fire c) Self-improving AI : burning the house down.
Just read 'The Reversal Test'. A good, honest, decent paper, but does little to address the issue. It only considers modifications in one parameter. I'd like to see a reversal test for modifying one parameter out of 100, when the 100 parameters are in some sort of equilibrium, potentially unstable, and the equilibrium is one which you don't understand too well. Even given that the status quo equilibrium is by all accounts pretty lousy.
Thanks Eliezer. My previous post on the 'CounterCultishness' thread would have been more relevant here. This is a good opportunity to give you, Robin, and any other occasional posters a vote of thanks for your (always) thought provoking and (mostly :-) ) incisive posts, whose interest keeps me, at least, coming back here, whatever my feelings about the SI.
Not sure why EY redefined the debate in terms of cultishness. Was anyone under the illusion they were being asked to pack their things for Guyana ?
Doubts about the objectives of the SI arise more from the seeming contradiction between the professed rationality of its members (Bayesian rationality, weighing the risks, putting all the 'Friendly' safeguards in place etc.) and the passion with which in their writings they seem to hail the Singularity and radical life extension like the Second Coming. Which leads one to fear a certain bias. Fear only, mind y...
By that time everyone knew it was time to leave, they had seen the lights repeatedly dimmed, but they were comfortable in the hall, and as long as no individual could be blamed for the antisocial act of staying, they would do so. Nevertheless their discomfort level was rising. Your action precipitated the decision, like seeding a supersaturated solution precipitates crystallisation. It's another example of an unstable group equilibrium just waiting to be disturbed, like the lonely dissenter in a group where the majority have private doubts. If the lights hadn't previously been repeatedly dimmed, the group might well not have followed you.
I've always wondered, since I was very small, why 'The Emperor's New Cloths' as commonly told doesn't include the scene where the Emperor has the Imperial Guard clear the street with a sabre charge.
'This may come as some surprise' to Asch & Aumann, but rationality is not the design point of the human brain (otherwise this blog would have no reason to exist), getting by in the real world is. And getting by in the real world involved, for our ancestors through tens of millenia, group belonging, hence group conformity. See J. Harris, 'No Two Alike', Chaps. 8 & 9 for a discussion which references the Asch work. This does not mean of course that group conformity was the only adaptation factor. Being right and being 'in' both had (and have...) fitness value, and it's pefectly natural that both tendencies exist, in tension.
There's a lot of confusion here. 1) Don't confuse respect for religion (unreasonable) with respect for people who have deep religious beliefs, however daft. In some abuse of religion I sense a lot of contempt for religious people. I try to fight my contemptuous side, knowing how strong it is. 2) Don't confuse 'the harm done by religion' with harm done by people, who would have done it anyway , who find in religion a convenient cloak. 3) This is not the place for a post on the human need for religion or the rag-bag of needs it subsumes (social, political...
It's illuminating to see this post next to the one on procrastination. I doubt Musashi would insist on delaying your sword stroke until you were absolutely sure you would cut at the same time as parry. His perfectionism concerns the initial state of mind, not the outcome. Raising the prior, in other words.
To the following phrase : "You can't hate someone while laughing at his foibles" I should of course have added that you may, however, get a sense of reclaiming the human high ground in what might otherwise be situational inferiority.
Scott Adams' jokes about pointy headed bosses are 'release of tension' jokes : the tension that arises from having to live with the species. You could call it, being constrained to live in absurdity. In that sense, some say they serve rather to avoid the phb becoming a hated enemy. You can't hate someone while laughing at his foibles. I guess that is the distinction, we're laughing at the phb's absurdity, not at his discomfiture. There is no such tension with a co-worker, hence no joke.
Robin, you're right, most people do think economics is a cult, even though there may be a small proportion of usefulness in the teachings... characteristics are, cult members cut off from contact with non-cult members (in this case by the ignorance of the non-cult members, of course), devotion to the cult leader (Keynes ! Friedman ! the Gourd! the Sandal!), proclamations of infallibility (the market is infallible), progressive alienation (this is a science, I can believe six impossible things before breakfast), and ending in total learned helplessness (fo...
Robin, transmission of expertise in non-rational domains has to rely on authority rather than argument, so is more susceptible to slide into abuse of authority than transmission in rational domains. The original post here is strange in that it supposes such a type of transmission in the field of rational teaching. The definition of cult in the field of master / disciple relationships has to start with an examination of whether authority is being abused by, for example, being exercised in areas unrelated to the teaching. Don't take sweets from philosophers.
That lastr one got through, so let's try : Random malfunction ?
Trying to work out the biases of the new antispam filter. Frequency of comments from same individual in same thread ?
Just had a response to Goplat rejected as spam. Wonder what the biases built in to the new antispam filter are ?
Goplat, can't answer for Caledonian, but as I'm pretty sad & pathetic myself, I'll take a stab. The unborn represent variety and potentiality. More of the same represents sterility. Sure I'd like to live 500 productive & happy years, but am in my better moments conscious that with present biotechnology this is unlikely. With SIAI improved biotechnology who knows ? However, my totally uninformed intuition is that however superproductive & longlived the ultra-new curly-wurly chromosomes that my friendly neighbourhood SIAI will give me are,...
Couldn't resist adding a complaint about the abuse of the term 'guru' as a term of ...abuse. It represents in fact an exponent of a perfectly respectable form of expertise transmission in non-rational domains. Drift into abuse of authority by such an exponent is perhaps more likely because the method relies on authority rather than argument, but that doesn't mean that the concept is invalid, or indeed that there is any other method possible in those domains.
What about the Guru who wrote 'Why work towards the Singularity' ? It is a text with a distinctly Messianic feel. Or, to be more generous, a Promethean feel. While it is true that Hom Sap has a nasty itch to create anything that can be created, regardless, thre's no need for such pseudo valuations as the following : "If there's a Singularity effort that has a strong vision of this future and supports projects that explicitly focus on transhuman technologies such as brain-computer interfaces and self-improving Artificial Intelligence, then humanity...
Robin : "For example, "ostracizing anyone who dared contradict her" would seemingly apply to a great many, perhaps the majority, of ordinary human organizations." : Yes, but there is a difference between ostracizing = damning to the nethermost pits of hell with no hope of salvation and ostracizing = delaying your next pay increase by a couple of months. i.e., the cult-dom-ness is contingent on the existential nature of the ostracization.
"an "environmentalist" is not someone who believes in the existence of the environment." Non sequitur. An environmentalist is someone who believes in the value of the environment. sloppy, sloppy, sloppy.......
It's amusing to see 'criterion of goodness' as a simile for 'criterion of correctness'. The Inquisition believed they were both 'correct' and 'good'. In torturing you, they were saving your soul, which was, for them, the ultimate in Utility. So, in calculating utility, beware of your assumptions.
I strongly encourage any AI worker who hasn't already done so to read Ian McDonald's 'River of Gods'. He's pretty positive (in timescale terms...) on AI, his answer to the question "How long will it be until we have human-level AI?" is 2047 AD, and it's a totally gob-smacking, brilliant, read.
Nick, sure, heroically not doing something will never grab the attention in the way that doing something does. Today, approximately 1,000,000 cars in Paris were not burned. So what makes the headlines ?
Statistics is actually fun, as the notion of probability is so non-intuitive. There's a 1 in 6 chance of throwing a deuce. What does that mean in the real world ? Well, if I throw the die 6 times, it should come up once ? euh no... Well if I throw 100 sequences of 6 throws I can predict the number of times the deuce will show up ? euh, no.... Well, if I throw 1000 runs of 100 sequences of 6 throws...... sorry, you still don't know one damn thing about what the result will be. So what does probability mean ? It's great ! One of life's rich prizes is to watch someone making a prediction on a particular instance based on statistical reasoning.
BTW, significant data was withheld in the examples given : a) how many dips do you get at the jellybeans ? Do the red ones taste better ? What is their market value with the current weak dollar ? b) 10,000 people overall or 10,000 infected people ? Degree of infectiousness of the disease ? But that's what the affect heuristic is for : taking decisions in situations of incomplete data. 150 people is a single bounded set, 98% of x people sounds as though it just might be a replicable set. Go for it.
Ha, Spock vs McCoy. I think Kirk's position was that it's the affect heuristic that makes us warm, cuddly, and human, data processors, even if it can be faulted in some artificial situations.. This ties in with the other thread about how far we look down possible chains of results in deciding on an action. We're wired to look to proximal results with high affect, and I'm all for it.
Hi Richard, any relation to the punch card guy ? IBM paid my salary for 35 years. Someone in one of these threads got squashed flatter than a pancake for supposedly confusing maps and territories, so let's be careful with models of reality. When I say 'dependant on usefulness', I just meant that the selectivity and level of detail of the map would depend on what you want to use it for. Not much point in going to the doctor and telling him the 'truth' about my finger, which would involve energy fields and dark matter, if what I want from him is a stick...
I'm left in 'awe and wonder' at the literalism of the debates going on here. The OT is a bunch of mythology and folklore, so, what else is new ? The NT is a heterogenous collection of Roman imperial propaganda, Jewish apocalyptic propaganda, and perhaps, some vague recollections of what a good man once said. So ? What does any of that have to do with logical categories ? Eliezar is guilty, as Anna pointed out, of mixing up the crudest OT literalism with any and every other level of religious experience and expression. I understand that, he was trauma...
'Scuse me, but isn't this trivial ? Both pragmatic and epistemic instances depend on available information. If you drive to Carrefour, you need some information to tell you they're out of chocolate. And to see the 'Out of chocolate' sign, you need to have driven to Carrefour. So, dear friends, both instances depend on (a) purpose (b) information relative to the achievability of the purpose. Unless of course your purpose is 'enculage des mouches', in which case, don't go to Carrefour. Go to Tesco. PS Truth does not reduce to usefulness. Truth is a relative concept dependant on usefulness. I asked Schrodinger's cat to contribute but she was busy with her Whiskas.
Forgive me for not picking up on the irony of including corporations and nanodevices in the same sentence. Eliezer is obviously correct in that corporations don't evolve because they don't replicate. A childish wish to gloat has to be held in check so as not to name and shame all those 'child' corporations whose DNA is specifically contrary to their parents'. The anti-wish list for nanodevices, on the other hand, is relevant and necessary. However, it is also entirely superfluous, as we all know, thanks to Dr Denning, that we are in a deterministic universe and that 'Que sera, sera'. Sit back and enjoy the ride.
'Genocide' refers to intentions rather than consequences, but it seems to me just fine to have a National Native American Genocide Day to remind us that sometimes consequences should have been taken into consideration. Even if they weren't, which of course is another question. A bit like Iraq.. (oops !! No Damn !!!! I didn't mean to say that !!!). So let's have a nice polite debate on the Instrumental Values and the Terminal Values in the Iraq war.. I've looked hard but not found any leaky generalisations in the area.....
Eliezar, something of a 'rant' ? 'the people who invented the Old Testament stories could make up pretty much anything they liked'.... overlooking that we're talking about oral traditions committed to writing centuries later. Of course the domain covered by the books of the old testament covers law, social customs, and a whole bunch of stuff which is now the domain of other institutions. Of course ideas have moved on in most of those domains. I'd be more interested in reading your ideas about why the fears, insecurities, and identitiy issues so many...
mtc, you could make a few volumes of Dilbert your required reading, to inform your faith in the 'sane corporation'. In fact, in such high powered company, I'm surprised to see non-qualified discussion of the intentionality of any organisation. Organisations don't have intentionality, individuals do (perhaps... if we don't let the Evolutionary Psychology crowd take it away from us..). As all Eliezer's anecdotes illustrate, these get lost in the wash of large numbers and multiple levels, networks, and gridlocks, so we are left with the dross of the lat...
:-) Maths is the product of the same abstracting mechanisms that create all our visions of the world. As such, maths has no more or less validity than any other of our self-consistent constructs of reality, and it is no accident that our maths has applications in our real world models. They're the products of the same mental systems. What is depressing is when a mathematical model which represents 5% of the available data is worshipped because it has internal coherence. As in Aumann's model. Tara.