All of Joshua_Fox's Comments + Replies

Wonderful project! I enjoyed writing for that old wiki.

Will you redirect given pages from the old to the new wiki, or at least have a link that readers can follow?

2habryka
Yep, after we are done with the import, we are going to redirect all the pages we imported. And then probably make all the remaining pages on the old wiki read-only, so we don't have to maintain a whole separate wiki system forever. 

How do we create a group? Please post a URL.

1Ofer
In the community page, under Local Groups you have "Create new local group"

"Why does ancient Egypt, which had good records on many other matters, lack any records of Jews having ever been there?"

Of course the words "Jews" isn't used, but it is well-documented that West-Semites lived in Egypt. (They even ruled it for a while as the Hyksos dynasty.) There is also the Mernepthah Stele, with a small mention of "Israel."

Though we do have written records from ancient Egypt, they are nowhere near complete or consistent enough for the absence of evidence to be treated as useful evidence of absence.

Not that I'm claiming to be wise or anything.

I was being forced to memorize and recite

Without getting into the theological aspects, a good technique as part of learning a second language is memorizing a text, particularly one with a poetic structure (like many prayers), even before it can be fully understood.

We were given a transliteration, but not a translation. I asked what the prayer meant. I was told that I didn't need to know

That is an extremely unusual experience, except as a temporary stage of learning. In most Jewish circles, reading Hebrew in the original script is considered important, and it is believed that one does need to understand what texts mean.

What about "near-human" morals, like, say, Kzinti: Where the best of all possible words contains hierarchies, duels to the death, and subsentient females; along with exploration, technology, and other human-like activities. Though I find their morality repugnant for humans, I can see that they have the moral "right" to it. Is human morality, then, in some deep sense better than those?

hosford42150

It is better in the sense that it is ours. It is an inescapable quality of life as an agent with values embedded in a much greater universe that might contain other agents with other values, that ultimately the only thing that makes one particular set of values matter more to that agent is that those are the values that belong to that agent.

We happen to have as one of our values, to respect others' values. But this particular value happens to be self-contradictory when taken to its natural conclusion. To take it to its conclusion would be to say that nothi... (read more)

7Roko
No. The point of meta-ethics as outlined on LW is that there is no "deeper sense", no outside perspective from which to judge moral views against one another.

Another variation on heaven/hell/man/woman in a closed room: No Exit

Minor point perhaps, but in the field I once studied, diachronic linguistics, people always want to know what the oldest language is, and no amount of explanation will convince them that there question is off-base.

Among the positive values of school, matriculation exams, college, grad school, the tenure system, and the career-track rat-race: In some cases they help motivate and bring out the best in people; even smart, creative people sometimes need that sort of external motivation.

(See also James Miller above.)

Eliezer, can you mathematically characterize those environments where randomization can help. Presumably these are the "much more intelligent than you, and out to get you" environments, but I'd like to see that characterized a bit better.

> "You should go to college and get a Master's degree and get a doctorate and publish a lot of papers on ordinary things -

scientists and investors won't listen to you otherwise." Even assuming that I tested out of the bachelor's degree... You can "test out of" every step to the ladder, and go straight to post-doc/professor equivalent by publishing multiple well-respected papers (and not necessarily on ordinary things) in top journals.

So do you now think that engineers can create a "Completely Alien Mind Design"? Do you have a feasible CAMD yourself?

I don't know if Eliezer2002 invented this reply on his own, or if he read it somewhere else. What about the concept of "optimization process"? Did you come to that idea yourself, or read about it elsewhere?

I've been stupid.

More generally, I'd like to see Overcoming Bias bloggers writing more about their current biases, either ones they struggle against, though not always successfully; or ones they have decided to surrender to.

SIAI has a ... mixed attitude towards AIXI

That's the right attitude to have in general: Encourage good work, but be prepared to criticize it as well.

He calls AIXI "brain-malfunction-causing." I don't think he says that AIXI is a malfunction itself!

@Nick Tarleton "but if it is [arguing for something], it's arguing for the propagation of those parts of our psychology we really want to keep."

For many or most humans, to the extent that current religion is imperfect, the enhancement of spirituality is perhaps the most important goal for humanity. Of course, various groups do have variations on what they mean by religion, but worship of a god is very common

I wonder, then, if Eliezer's explanation/argument could be applied just as well to the preservation and encouragement of worship of the divine, though it would not fit well with the atheism advocated in his other articles.

If you replace "love" in this article with "theistic spirituality" -- another aspect of the human psychology which many, if not most, humans consider deeply important and beautiful -- and likewise replace mutatis mutandis other parts of the dialog, would it not just as well argue for the propagation of religion to our descendants?

3Richard_Kennaway
Yes, but only to someone who believes the religion. Someone who disbelieves the religion but nonetheless finds something valuable in "spirituality", should try to find that thing elsewhere rather than collude in at best a noble lie.
6DanielLC
If you value love, then you would value passing it on. This equally applies to theistic spirituality, or torture for that matter.

Eliezer wrote "This isn't the whole story..., but it will do for a start", and in the referenced post: "This I will not describe, for it would be a long tale and complicated. I ... knew not the teachings of Tversky and Kahneman."

I've seen tantalizing hints of this "long tale," but I'd love to see the whole story, even in summary. If nothing else, it would be quite in place in a blog on Overcoming Bias.

Yet something in the real world makes it tractable to create the "map" -- to find those hidden class variables which enable Naive Bayes.

I'd like to understand: Are frequentist "probability" and subjective "probability" simply two different concepts, to be distinguished carefully? Or is there some true debate here?

I think that Jaynes shows a derivation follownig Bayesian principles of the frequentist probability from the subjective probability. I'd love to see one of Eliezer's lucid explanations on that.

The real fear is not that Singularitarianism is a cult, but that it is pseudo-science (with certain practical consequences), like ESP, Velikovskianism, or certain false nutritional beliefs.

A commonly proposed solution is to look at the evidence with a scientific (Bayesian?) mindset, but most of us are woefully unqualified to judge most scientific fields without an intensive study that we are not about to engage in.

Great stuff as always. Enhanced diagrams (beyond the simple ASCII ones), with clear labels, and even inline explanations, on nodes and edges, would make the Bayesian explanations much clearer.

I've always thought it was silly to call great football players "heroes." But in fact, people can be heroes (in the sense of role models) in one area of life and not in others. You can admire and be inspired by a role model's athleticism, intellectual honesty, kindness, etc. even though these are not usually found all together in one person.

Part of the attraction of superheroes is their alpha male status: The warm glow we feel from power that protects us, the more the better. This is not quite the same thing as the halo effect.

As always, well put. However, "Maybe you realized it was all madness, but I bet you did it anyway. You didn't have a choice, right?" Many students do have a terribly mercenary attitude. But a good number do voluntary study topics with no evident financial incentive.

"...I didn't need to know what the words meant, it would work anyway." That was a stupid thing for them to say. However, a common approach in these circumstances, similar but crucially different is "you don't need to know what the words mean now, just read them over an... (read more)

Peter de Blanc

No. What other sorts of terminal values [other than moral] did you have in mind?

Well, one could have a terminal value of making themselves happy at all costs, without any regard for whether it harms others. A sadist could have the terminal value of causing pain to others. I wouldn't call those moral. I'm interested in a succinct differentiation between moral and other terminal values.

Peter de Blanc "Huh? Considering only oneself is less general than considering everything."

Certainly. But can you give a succinct way of distinguishing moral terminal values from other terminal values?

-1Dojan
Define what you mean by "moral" and I think the answer will give itself.

What is the difference between moral terminal values and terminal values in general? At first glance, the former considers other beings, whereas the latter may only consider oneself -- can someone make this more precise?

In teaching or lecturing, I notice my own tendency, which I have since tried to correct, to avoid going over anything I had known for a long time and only mention the latest tidbit I'd learned. I attributed that to my own desire to avoid boredom and seek out important new insights. Also, through the well-known cognitive bias of projecting one's own mental state on others, I was subconsciously trying not to bore the students.

I was not displaying ... any ... virtue

Most math teachers would be delighted if a student was able to understand Cantor's proof, think critically enough to search for a counter-proof, think creatively enough to describe a counter-proof (and based on different mathematical constructs at that), even though the proof was wrong at some critical steps.

This would be quite an achievement even for those who do not go on to the crucial last step of thinking self-critically enough to find the mistake in that "proof."

The following does not invalidate the argument in the posting, but:

Subjects thought that accidents caused about as many deaths as disease

I want to eliminate aging and death as much as anyone, but I would say that many deaths from disease in old age should be filed under "old age" rather than "disease." I wonder how the statistics work out if we look at it that way. (Or maybe Lichtenstein et al did so already.)

Perhaps this explains Hofstadter's puzzled reply to the Singularity, as for example at his 2006 Singularity Summit lecture. Although his thinking into the meaning of thought are surely insightful, it seems tinged at the end with a sense of that intelligence and the Singularity are Mysterious Phenomenon in the sense described above.

(However, it can sometimes hard to distinguish whether a speakeris saying "X is a Mysterious Phenomenon (in the sense above)," "X is something that I don't understand for now," and "I understand X, and so am filled with a sense of wonder.")

0MrMormon
Or perhaps he wanted to leave his audience with a certain effect, like wonder, hope, and dreaminess? That's how I see the future sometimes, when I have no idea what tech will boom and bust.

90% of anything is crud, including schools and perhaps the scholarly motivation of most students, but the better schools don’t teach the better students by rote learning.

The magic words, as you point out at the bottom of your essay, are helpful for getting one’s thoughts into the right part of science. Most people would have a train of thought that is not quite as reflective as what you described, something a bit more confused like:

  • "Heat conduction?"
  • Something to do with heat spreading out from hot to cold.
  • This is strange. The near side shoul
... (read more)
1wizzwizz4
My first response would be "metamaterials". Then it would be an extremely excited feeling, because the teacher just Violated Thermodynamics™. Then it would be confusion, and I'd stick up my hand and say "the hot air was blown towards the far side" or something. We don't tend to question the premise when the Trusted Authority Figure is asking us questions, because our prior estimate of that is very unlikely. The chance of it actually being heat conduction in some way feels higher than the teacher faking the situation. The chance of me being completely wrong about Physics feels higher than the teacher lying, and "heat conduction" is my easiest way out, whilst saving face.

Someone who believes that a Singularity is likely at, say 2030, might save less for retirement than they otherwise would. I wonder if Singularitarians really do so?

(Some believe that the rich will be the first and only ones to afford the technologies of Transcendence. I don't believe that, but one who did might save up after all.)

5gwern
I suppose that depends on what kind of Singularity you are expecting. If you're expecting a Singleton which will pension off all the humans, then sure, eat drink and be merry - for tomorrow our investments die. If you're expecting a Hansonian 'crack of the future dawn', you'd better be saving and investing in equities so as to ride the coming bull market when ems eat everyone's wage-jobs.

A peripheral correction:

They found out that, during the supposed time of the Exodus from Egypt, Egypt ruled Canaan. The tribes would have fled to find Pharaoh's armies already at the destination.

When Egypt ruled Canaan, it was through vassal kings and not with large garrisons (although there were occasional Egyptian governors and forts). Egyptian rule was weak, partial, and often broke down completely: There were kings opposed to Egypt, the vassals were not always loyal, and all kings were under attack from each other and from nomads. Some of these nomads... (read more)

Not all schools/universities are as grim as all that. I went to a small liberal arts university where research professors taught small classes, and although it wasn't perfect, the students who wanted to learn critical thought were encouraged by many professors to do so.

trusting authority. Learning critical thinking of great minds is a decent start on developing one's own, and closer than most students will ever get.

"Maybe I'd better ... consult another textbook, they'd fail all the courses they took that quarter."

I did that occasionally, and ... (read more)

What if, as we approach the Singularity, it is provably or near-provably necessary to do unethical things like killing a few people or letting them die to avoid the worst of Singularity outcomes?

(I am not referring here to whether we may create non-Friendly AGI. I am referring to scenarios even before the AGI "takes over.")

Such scenarios seem not impossible, and creates ethical dilemmas along the lines of what Yudkowsky mentions here.

Why aren't there dojos that teach rationality?

They're called universities. My PhD adviser taught me to think rationally and caught many of the errors in my thinking, including those caused by biases. This eventually allowed me to catch many of my own errors.

No, it wasn't perfect. It was limited to one academic area and was not explicitly aimed at teaching rationality and overcoming biases. (Then again, martial-arts senseis do not teach their skills "explicitly", but by repetition and training.) Moreover, gaining subject-matter expertise took a... (read more)