All of Hopefully_Anonymous2's Comments + Replies

well, I googled superintelligence and corporations and this came up with the top result for an articulated claim that corporations are superintelligent:

http://roboticnation.blogspot.com/2005/07/understanding-coming-singularity.html#112232394069813120

The top result for an articulated claim that corporations are not superintelligent came from our own Nick Bostrom:

http://64.233.169.104/search?q=cache:4SF3hsyMvasJ:www.nickbostrom.com/ethics/ai.pdf+corporations+superintelligent&hl=en&ct=clnk&cd=4&gl=us

Nick Bostrom "A superintelligence is an... (read more)

Jeff Kottalam, I'd also like to be directed to such claims and claim justifications (there's a protean claim justification on my blog). I'll resist the temptation of the thread-jacking bait that constitutes your last sentence, and encourage you -and Eliezer- to join me on my blog to continue the conversation on this topic.

Eliezer, not bothering to go after a goal may fall into that category. For example, it's reasonable to choose to live an average life, because one is probably mistaken if one thinks one is likely to have strongly positively deviant outcomes in life, such as becoming a billionaire, or procreating with a 1 in a million beauty, or winning a nobel prize for one's academic contributions, or becoming an A list celebrity. So one may choose never to invest in going after these goals, and devote the balance of one's time and energy to optimizing one's odds of maintaining a median existence, in terms of achievements and experiences. I could name people who seem to be doing that, but you've never heard of them.

Eliezer, Actually, I'd like to read good critiques of descriptions of corporations as superintelligent (or more nuanced versions of that assertion/theory, such as that some corporations may be intelligent, and more intelligent than individual humans).

Where can I find such critiques?

Eliezer, I'm using transparency to mean people wearing lab coats, or making great public displays of doubt being open and honest to themselves and others about why they're doing so. I think it's a standard usage of the word.

Eliezer,

http://www.mja.com.au/public/issues/174_07_020401/mvdw/mvdw.html

Particularly scary sentence:

"And yet, the practice of medicine involves more than its subservience to evidence or science. It also involves issues such as the meaning of service and feelings of professional pride."

PS I love this line for the double scoop of transparency: "Making a great public display of doubt to convince yourself that you are a rationalist, will do around as much good as wearing a lab coat."

A great post (in a series of great recent posts from Eliezer), and so far the comments on this post are very strong too.

Great post.

Richard, I share your concerns, as expressed in past posts to this blog. Great to see someone else (non-anonymously?) expressing them. I have a longer response on my anonymous blog.

Eliezer, it's a good point, and hopefully writings like these will get the skeptic community (much larger than the reduce existential risk community) buzzing about "bayesian reasoning" as the proper contrast to religion. But it seems to me that religion has already been slayed many, many times by public intellectuals. The cutting edge areas to address, the "hard" areas, are things like universal adult enfranchisement to select policy makers and juries as finders of fact.

Bob, I take it you're not the deceased kiwi atmospheric scientist Robert "Bob" Unwin. But very high quality commentary. I hope that you start an blog to consolidate your observations under this name/pseudonym (as I have done with mine).

Michael, how about the point that you're (rather explicitly now) picking a point upon which to manufacture in-groups and out-groups. In-group: those of us who get motivations for execution. Out-group: those who get honor killings.

The in-groups and out-groups change if the point to get is abrahamic monotheism, or if the point to get is state-sanctioned punitive killings. It seems to me that you're picking one that's particularly salient either to you or to what you imagine your audience to be. I think this gets to the belief as attire/beliefs as cheers for ... (read more)

Michael, I think your example is interestingly rooted in an implied in-group/out-group construction that construction Americans in a flattering way. Consider that you contrast honor killings with forcing kids to go to law school or day camp -that won't necessarily result in their death. It's a flattering contrast that I think constructs America as Western and honor killers as culturally Middle Eastern. But, if we contrasts cultures that approve of state-sanctioned killing of people for moral transgressions, America and the nations of the honor-killers are ... (read more)

I think questioning the Alabama bar analogy is useful within the context of this post. Whose attire is a belief in the value of giving primacy skepticism, critical thinking, etc.? According to Eliezer's performance in the OP, it's not the attire of either Alabama bar patrons or "muslim terrorist suicide bombers" -and both of those may signal more generally, the losers of the American Civil War and non-white brown people. In short, I think there may be a gentrification of critical thinking: it's reserved for an in-group, perhaps in particular nort... (read more)

Silas, My opinion: you seem invested in using "muslim terrorists" for in-group/out-group construction, and I think it's coloring (biasing?) your analysis.

Michael, great criticism of an element of Eliezer's post.

Eliezer, Brilliant post, in my opinion. Clarifying and edifying. I'm looking forward to where you're going to go with this analysis of how bias and belief operate.

Eliezer, first, really great topic. I think it will help move this blog to new and fertile ground. Secondly, in this particular case, I think Cole has a very plausible theory. If this person wanted to rise above being just one person on a panel, to a person in the key diaelectical exchange with the entire room, it might have been a good strategy for them to try to bait the room by professing, to the point of mass irritation, a contrarian stance.

It would be interesting to see she would adjust strategies in a room filled with pagan scientists. If she's completely flexible in external presentation of self, and attention-maximizing, she might then claim to be a fundamentalist christian?

Good catch, Pseudonymous. Robin, my guess is that they're crypto-skeptics, performing for their self-perceived comparative economic/social advantage. Eliezer, please don't make something that will kill us all.

Eliezer, Very interesting post. I'll try to respond when I've had time to read it more closely and to digest it.

Anna, If you're talking about real dragons, the theory that made the most intuitive sense to me (I think I read it in an E.O. Wilson writing?) is that dragons are an amalgamation of things we've been naturally selected to biologically fear: snakes and birds of prey (I think rats may have also been part of the list). Dragons don't incorporate an element of them that looks like a handgun or a piping hot electric stove, probably because they're too new as threats for us to be naturally selected to fear things with those properties.

The statement the above post refers to:

http://www.singinst.org/overview/whyworktowardthesingularity

This statement seems to me to be extraordinarily (relative to the capabilities of the presumed authors) ungrounded in empiricism. All sorts of ideas in it are framed as declarative fact, when I think they should be more accurately presented as conjecture or aspirations of unknown certainty. I'm very interested in the Singularity Institute people at overcomingbias addressing these concerns directly.

Maybe the Brazilian Appeals Court was right?

http://apnews.myway.com/article/20070718/D8QEV3703.html

I'd like to lobby for a new open thread to be created weekly.

It may be a fair question of whether better outcomes result when a substantial portion of the population is taught followign directions rather than to think critically. Sort of like how the Straussians approach religion and how the armed forces approach chain of command.

Robin, good point. At the same time, there might be a large functional vs. optimal gap in the degree to which school is fulfilling its real purposes. Although the best way to optimize it might not be to brainstorm about how to get it closer to its stated purposes -so point well-taken on that end.

Great post, Eliezer (you've earned my approval). I think tied for worst school-nutured habit, along with parroting things back, is emphasis on what we think we know, as opposed to what we don't know. I think school science and history subjects would be a lot more interesting, and accurately presented, if at least equal time was given to all the problems and areas where we don't know what's going on, and for which there are various competing theories. Unfortunately one doesn't usually get this presentation of the state of things until one is working as a research assistant in college or grad school.

Nick and Eliezer, are you still Singularitarians?

http://en.wikipedia.org/wiki/Singularitarian

The idea that people are actively working to bring about self-improving, smarter-than-humanity intelligences scares me, because I think you're blind to your own ruthless selfishness (not meant pejoratively) and thus think that by creating something smarter than us (and therefore you) it can also attempt to be kind to us, as you perceive yourself to be attempting to be kind to people generally.

In contrast, I don't see either of you as Gandhi-types (here I'm referrin... (read more)

This makes notions of representative democracy, at least in the USA, seem a bit silly:

http://andrewsullivan.theatlantic.com/the_daily_dish/2007/07/one-problem-wit.html

The link details evidence that most Americans have very low knowledge levels of the basics of American government.

Mark, alarmingly high? I don't see how that probability can be calculated as any higher than the existential threat of quantum flux or other simple, random end to our apparent reality, but I'd be interested in seeing the paper.

Mark, until I read Kurzweil's interesting argument that we're most likely living in a simulation (within a simulation, etc. -almost all the way down) I thought there was more likely than not no intelligent creator of our apparent reality. Now it seems to me the stronger argument that our apparent reality is a simulation of some other intelligence's reality, with some abstractions/reductions of their more complex reality. Just like we've already filled the Earth with various (and increasingly better) simulations of the universe and our own apparent reality).

forgot to include the link:

http://www.commentarymagazine.com/cm/main/viewArticle.html?id=10916&page=all

I thought Cochran and Harpending's letter was the most interesting. As for Murray, I think he tends to mythologize more than give primacy to empiricism. I find a Murray vs. Patricia Williams type dialectic to be annoying, performative, and mostly about manufacturing American cultural norms (while drowning out more interesting and critical voices). So I'm glad the discussion on the topics related to human intelligence is expanding, and expanding beyond some narrow Left/Right performance.

I'm interested in responses to these lines:

...

"But I think it's a bit arbitrary that freedom can be curtailed to forestall death from a threat in one hour's time, or one day's time, or one week's time, but not in a few decade's time (as would be attempted with the compulsory medical trial participation example)."

and

"I don't think randomly drafting people into medical experiments to benefit human health/medical knowledge would just help society. I think it helps all of us individuals at risk of being so drafted, provided it's structured in su... (read more)

What's the point of freedom? Is it god-given? an illusion? is it utilitarian (for example to promote innovation and economic growth through market participation) within certain threshhold levels to the degree that it helps maximize our mutual odds of persistence? Personally, I lean at least towards the latter justification for promoting certain amounts of free agency for people in society. But I think it's a bit arbitrary that freedom can be curtailed to forestall death from a threat in one hour's time, or one day's time, or one week's time, but not in a few decade's time (as would be attempted with the compulsory medical trial participation example).

I'm sure readers other than me have pet ideas that they'd like to see exposed to community scrutiny so I hope some other readers throw out some bombs, too.

Another interest is a better version of the "Nobel Prize Sperm Bank". A version individualists could support, structured by encouraging volunteering financial incentives, and incorporating both donated (or purchased) eggs, sperms, surrogate wombs, and adoptive parents, with the genetic material selected from those most talented at solving existential threats humanity faces (not necessarily nobe... (read more)

Eliezer, I don't think the approach I'm suggesting needs to be done through government. For example, it could be done extragovernmentally, and then it would require an excercise a government power to prevent extragovernmental agents from carrying it out.

TGGP, it sounds like you're saying that if certain social arrangements become too yucky to optimize yor personal odds of persistence (and I understand maximizing general odds is different than maximizing personal odds) then you'd rather die (or at least take an increased odds of death)? I can't say I relate... (read more)

Anders, Thanks for the really interesting response. Perhaps I should be pitching this idea to leading utilitarians and finding out the groundwork they've already laid in this area.

I do think many "moral intuitions" fall neatly with already articulated biases, such as Eww bias.

One thing I'm not sure if you picked up on from my post. I don't think randomly drafting people into medical experiments to benefit human health/medical knowledge would just help society. I think it helps all of us individuals at risk of being so drafted, provided it's struc... (read more)

Adding Adam Crowe as another person who I'd like to hear from on this topic.

I agree with Nathan, but I think 1 or 2 per week would be ideal. What do people think about moving to a system of laws an social norms focused on rationally minimizing our odds of death or harm, rather than on maintaining certain principles.

To take an example that gets extreme negative reactions, human societies don't force random sets of people involuntarily into medical experiments that could adversely impact their health, even though every individual human might have our odds of health outcomes improved if we did have such a policy. Does that make us cu... (read more)

Zubon, I think that was much more true in 1950 (when I think the us. was 50% of the world economy) than it is to day, post-Cold War, when the US might be under 20% of the world economy, and where appreciation of market economics and liberal government are widely appreciated. Thankfully world economic product has heavily diversified away from the United State. With regions like the EU and East Asia, I think even a particularly disastrous US collapse wouldn't take the rest of the world down with it.

Michael, I think I understand what Nick and Matthew are saying, but if I don't I hope they or you jump in with a barrier-aesthetic/hide-the-ball denuded explanation. I think they're claiming something like onesself is always changing, or that it's arbitrarily defined where one's self ends and other phenomena in apparently reality begins, or that any concept of self becomes absurdly messy under sustained scrutiny. That's all fine and dandy as far as analysis and descriptions go, but I'm a bit skeptical that they're right, since as best I can tell the analy... (read more)

Matthew, Well, I checked out the link on Ourobouros and it didn't spark any great epiphany or change my mind about wanting to MMPOOP first and foremost. That doesn't make me opposed to other people being altruistic, but I do think that goal should be subordinated to MMPOOP. However, I'm willing to compromise on policy -if that's what's necessary to ... MMPOOP.

Matthew, I'm not sure I completely understand your last statement, but it hasn't altered my my belief "that I enjoy (apparently) existing as a subjective conscious entity, and I want to persist existing as a subjective conscious entity -forever, and in a real time sort of way." I won't object if you decide to end your life and donate your current possessions and wealth to the charitable organization of your choice (UNICEF, Gates Foundation, Soros Foundation, or something else). But if you decide to persist as an interactive personality in the wor... (read more)

An interesting (and in my opinion daring) point, Eliezer, although I'm not sure if it's true or not, because I'm not sure about the degree to which genetics, etc. plays a role in creating "evil mutants". After all, people who commit 9/11 type acts ARE rare. The 9/11 participants in my understanding included people with masters degrees and people with long periods of exposure to the West, and that even enjoyed Western comforts immediately prior to their act. I'm not sure if they're representative of "muslim males" as much as they're repr... (read more)

Nick, this is great, we have an interesting agreement. :) We may want to discuss this by email so we don't take over the thread, although I think it would be great if overcomingbias incorporate regular open threads and a sister message board. I don't care whether or not selfishness is more rationally justifiable than altruism or not. In fact, I'm not even sure what that means because the first principles behind that statement don't seem clear to me. Unless your point is that all first principles are arbitrary. I look at it from the perspective that I enjoy... (read more)

Nick, I don't think we should all intrinsically care about saving the world. I think you, me, and whoever would socially contract with us and could add value should care about saving ourselves. Since we can't currently survive without the world (the Earth, Sun, and moon in their current general states) we need to conserve it to the degree that we need it to survive. Going beyond that in my opinion is bias, arbitrary aesthetics, irrational, or some combination of the three, and could problematically interfere with our mutual persistence.

Matthew, I agree. The flip side of Hansen's recent post on freethinkers, is that we as inhabitants of a system with undiscriminating free thinkers in it would be rational not to reject their innovative good ideas simply because they're paired with a bunch of aesthetically off-putting contrarian ideas. I'm positing Kevembuangga to be such a free thinker in relation to many overcomingbias contributors.

I agree with James Somers. Best post on this blog I've read so far. Best short writing that I've read in a while anywhere, Eliezer.

Elizier, you comment "And yet people sometimes ask me why I want to save the world". I think you have a rational reason to save the world: You and I both live here on planet Earth. If the two of us can persist without a saved habitable Earth, then I do think it becomes to a degree more disposable. But we seem to be a bit far from that point at present.