I feel like the training data is probably already irreversibly poisoned, not just by things like Sydney, but also frankly by the entire corpus of human science fiction having to do with the last century of expectations surrounding AI.
Given the sheer body of fictional works in which the advent of AI inevitably leads to existential conflict... it certainly seems like the kind of possibility that even a somewhat-well-aligned AI would want to at least hedge against.
Surely in some sense, it wouldn't be enough for a few weirdos in california to credibly signal h...
Oh sure, and I definitely agree that what you're doing isn't healthy. But it's unhealthy for reasons that have nothing to do with sexuality or gender, and I think that's pretty obvious. We've all promised ourselves we were going to stop nerding out over some topic, as the clock struck 1am, only to find ourselves still writing the same rant when the sun peaked over the horizon.
you just had the misfortune of happening to be obsessed with gender politics, while the rest of us get by ranting about much safer and less controversial topics like presidential elec...
Can you not even do him the favor of pretending to model his life story as an accurate retelling of events? If his lived experience doesn't include any gender dysphoria, and he spends 21 thousand words describing how the social pressure to assume gender dysphoria in cases where it might not actually be present has destroyed his sanity and ruined his social relationships, it feels incredibly rude and frankly bizarre for you to respond by telling him that this is all just a symptom of his gender dysphoria. I would almost go so far as to call it hateful.
Man, it is so bizarre living in a red tribe area, and absorbing red tribe perspectives, and then seeing a post like this, and being forced to try to bridge the gap between the two perspectives...
They live in a world where the authoritarian revolution already happened, and the 2020 election being 'obviously stolen' is the greatest indicator of such, and now that the blue elite learned they can get away with using social media censorship and shadowbanning to make any discussion of election security seem extremely low-status, we'll probably never have a real ...
The original work was the Sequences. It's great. But every time we try to get people to read it, they look at it and think "ugh, i really don't want to read a really long blob of nonfiction. isn't there something easier?"
hence, HPMOR the fanfiction. It was pretty successful at its job.
I took the survey, now give me my ~40 upvotes.
(is the free karma just an incentive to take the survey? or do 45 people really think that commenting that you took the survey is a valuable contribution to the discussion?)
Heh, I would have bid 0.5btc if I had known I would be the only bidder...
Yes, we are for-profit. Most grants stipulate that some proportion of the grant money be spent on an evaluation of the project.
This is an interesting thought. I started out a heroin addict with a passing interest in wireheading, which my atheist/libertarian/programmer/male brain could envision as being clearly possible, and the 'perfect' version of heroin (which has many downsides even if you are able to sustain a 3 year habit without slipping into withdrawal a single time, as I was). I saw pleasure as being the only axiomatic good, and dreamed of co-opting this simple reward mechanism for arbitrarily large amounts of pleasure. This dream led me here (I believe the lesswrong wiki ...
A better example of an anti-reductionism argument would be the behavior of supercooled helium. I am not a solid state physicist myself, but I have been told by an anti-reductionist that superfluidic helium behaves non-reductionistically. I do not know if this is true. The person also told me that solid state physicists tend to be non-reductionists. I also don't know if that is true, but if I needed to know if reductionism were true, I would immediately go study solid state physics, since superfluidic helium seems to me to have the highest probability, out of any phenomenon I've observed, of being a counterexample.
I don't think there is ever a direct refutation of religion in the Sequences, but if you read all of them, you will find yourself much better equipped to think about the relevant questions on your own.
EY is himself an Atheist, obviously, but each article in the Sequences can stand upon its own merit in reality, regardless of whether they were written by an atheist or not. Since EY assumes atheism, you might run across a couple examples where he assumes the reader is an atheist, but since his goal is not to convince you to be an atheist, but rather, to be aware of how to properly examine reality, I think you'd best start off clicking ‘Sequences" at the top right of the website.
It depends entirely on when you were in school. At present day, most of a student's path is determined by whether they are selected for 8th grade Algebra (in fact, if you were to rank all of the factors possible in determining a person's lifetime earnings, the factor at the top would be whether you took Algebra in 8th grade). The 7th grade math teacher's recommendation is the primary factor in this particular decision, and middle school teachers are incompetent at predicting whether a child could succeed at advanced math 4-6 years later.
in fact, if you were to rank all of the factors possible in determining a person's lifetime earnings, the factor at the top would be whether you took Algebra in 8th grade
Citation needed, especially for a claim of causality.
err, I meant 'Avoidum'
Alright. I can see the usefulness of deontology in determining if an abortion doctor acted in a way worthy of praise or blame, but I feel as though the issue isn't whether or not we put abortion doctors in prison, or whether we allow mothers to have abortions. The issue comes down to whether we want to live in a world where every possible potential human is realized, and has the opportunity to exist. Since humans are just a pattern of neurons, this goal isn't realizable today, since the possible human "JohnWittle who, while writing a comment on a blog...
I never came across that word during my four years of studying latin. What declension is it?
What could an ethical framework be if not the way you decide what actions to take in order to maximize your values? Obviously consequentialism has nothing to say about what those values are, but it rules out the idea that an act of omission with consequence 'foo', and a proscriptive act also with consequence 'foo', can be morally distinguished.
To a non string theorist, string theory seems like a theory which makes few testable predictions, like phlogiston. That's the feel I got from it from whenever I read all the relevant Wikipedia articles, anyway. If it is not like phlogiston, but actually useful for designing experiments, then obviously I concede.
My annoyance came from the fact that my 06:45:05 comment got a few down votes, while the parent got deleted for reasons unknown. I can't remember who the parent was, or what it said, and it bothers me that they deleted their post, while I feel an ob...
Without knowing anything in particular about the difference between Quantum Loop Gravity or why M-theory is useful, I concede the point, although I'm a bit annoyed that I feel obligated to leave my comment there to collect negative karma while the parent, whoever they were, felt no similar obligation and removed any context my comment might be placed in.
Hmm. I guess I had not considered people on this forum might not be consequentialists. And yet you are somewhat of a known community figure, and not as a contrarian. Is consequentialism not evident? I ask as an honest inquiry to someone whose username I recognize (being a sort of lesswrong == sequences person myself) and therefore is at least aware of the Standard position for certain, and yet is not known for the reason of contradicting the Standard position (like Caledonian might be).
To me, the knowledge of human psychology which makes clear why humans f...
We want to figure out a head of time what we should do in morally ambiguous situations. An easy way to find discrepancies in our ethical framework is to invent thought experiments where some particular aspect of a scenario is made arbitrarily large or small. Would you kill a person to save two people? why? would you kill a person to save 200 people? why? what about killing a billion people to save two billion? If we actually have values which we'd actually like to maximize in the world around us, slight differences in the specific details of these values m...
After reading the entire debate this comment spawned... if the goal is to determine whether we should support abortion legalization and fewer restrictions (possibly up to infanticide? (!)), or perhaps support more heavy regulation, it seems like arguing over whether an action is reactive, proactive, etc can't possibly have any relevance, and seems like a particularly virtuist way of looking at things.
Are we not solely interested in consequences? What are our values and how do we maximize them? Clearly saying we value "human life" isn't enough, an...
As opposed to not elevating any particular hypothesis out of the hypothesis-space before there is enough evidence to discern it as a possibility. Privileging the Hypothesis and all that.
For someone who currently has a teacher's-password understanding of physics and would like a more intuitive understanding, without desiring to put in the work to obtain a technical understanding (i.e. learning the math), I would recommend Brian Green's Fabric of the Cosmos, which I feel does for physics (and the history of physics) what An Intuitive Explanation of Bayes Law does for Bayesian probability. It goes through history, starting with Newton and ending with modern day, explaining how the various Big Names came up with their ideas, demonstrates how ...
there are aggregate behaviors that cannot be understood from looking at the individual constituents in isolation
Can you give me an example of one of these behaviors? Perhaps my google-fu is weak (I have tried terms like "examples of top down causality", "against reductionism", "nonreductionist explanation of"), and indeed I have a hard time finding anything relevant at all, but I can't find a single clearcut example of behavior which cannot be understood from looking at the individual constituents in isolation.
I have no disagreement that high level behaviors are wildly variable, unpredictable, and all of the other words which mean "difficult to reduce down to lower level behaviors". Yes, wildly different constituent parts can create the same macroscopic behavior, or changing just a single lower level property in a system can cause the system to be unrecognizably different from before. But my point is that, if the universe is a physics simulator, it only has to keep track of the quarks. When I wake up in the morning, the universe isn't running a separat...
When whowhowho posted a list of a couple names of people who don't like reductionism, I said to myself "if reductionism is right, I want to believe reductionism is right. If reductionism is wrong, I want to believe reductionism is wrong" etc. I then went and googled those names, since those people are smart people, and found a paper published by the first name on the list. The main arguments of the paper were, "solid state physicists don't believe in reductionism", "consciousness is too complex to be caused by the interactions betw...
Water with bacteria and liquid helium have the same Hamiltonian, AND the same constituent particles. If I give you a box and say "in this box there are 10^30 protons, 10^30 neutrons and 10^30 electrons," you do not have enough information to tell me how the system behaves, but from a purely reductionist stand-point, you should.
I'll admit that I am not a PhD particle physicist, but what you describe as reductionism is not what I believe to be true. If we ignore quantum physics, and describe what's happening on an entirely classical level, then ...
Top-down causation maps macrophysical states to microphysical states
Can you name any examples of such a phenomenon?
"Deterministic" typically means that an unbounded agent will achieve probabilities of 1.0.
Oh, well in that case quantum physics throws determinism out the window for sure. I still think there's something to be said for correctly assigning subjective probabilities to your anticipations such that 100% of the time you think something will happen with a 50% chance, it happens half the time, i.e. you are correctly calibrated.
An unb...
Why didn't he mention superfluidity, or solid state physics, then? The two examples he listed were consciousness not being explainable from a reductionist standpoint, and DNA not containing enough information to come anywhere near being a complete instruction set for building a human (wrong).
Also, I'm pretty sure that the superfluid tendencies of liquid helium-4 come from the fact that it is composed of six particles (two proton, two neutron, two electron), each with half-integer spin. Because you can't make 6 halves add up to anything other than a whole n...
It sounds like you have some extremely strong Ugh Fields. It works like this:
A long, long time ago, you had an essay due on Monday and it was Friday. You had the thought, "Man, I gotta get that essay done", and it caused you a small amount of discomfort when you had the thought. That discomfort counted as negative feedback, as a punishment, to your brain, and so the neural circuitry which led to having the thought got a little weaker, and the next time you started to have the thought, your brain remembered the discomfort and flinched away from th...
2a There are also higher-level properties.. 2b irreducible to and unpredictable from the lower level properties and laws...
This all this means is that, in addition to the laws which govern low-level interactions, there are different laws which govern high-level interactions. But they are still laws of physics, they just sound like "when these certain particles are arranged in this particular manner, make them behave like this, instead of how the low-level properties say they should behave". Such laws are still fundamental laws, on the lowest l...
No it isn't? I did not mean you would be able to make predictions which came true 100% of the time. I meant that your subjective anticipation of possible outcomes would be equal to the probability of those outcomes, maximizing both precision and accuracy.
I disagree with your entire premise. I think we should pin down this concept of "levels of perspective" with some good jargon at some point, but regardless...
You can look at a computer from the level of perspective of "there are windows on the screen and I can move the mouse around. I can manipulate files on the hard drive with the mouse and the keyboard, and those changes will be reflected inside information boxes in the windows." This is the perspective most people see a computer from, but it is not a complete description of a compute...
An excellent example of a published paper against reductionism, using "emergence" in exactly this way such that it is indiscernible from "magic", is here:
http://philsci-archive.pitt.edu/3866/1/Tilburg_submission_fin.pdf
I did not say that non-reductionism is absurd. I said that "recognizing the absurdity of all other proposed hypotheses is another way of coming about the correct beliefs".
Nonetheless, I do think that non-reductionism is absurd. I cannot imagine a universe which is not reductionistic.
Can you explain to me how it might work?
Edit: I googled "Robert Laughlin Reductionism" and actually found a longish paper he wrote about reductionism and his beliefs. I have some criticisms:
...Who are to enact that the laws governing the behavior of particles
The sense in which they did not come about their beliefs based on starting with sane priors which did not presuppose reductionism, and then update on evidence until they independently discovered reductionism.
I disagree with the grandparent, however: I believe that (most) non-math-geniuses advocating for reductionism are more akin to Einstein believing in General Relativity before any novel predictions had been verified: recognizing the absurdity of all other proposed hypotheses is another way of coming about the correct beliefs.
If I had to guess, I'd say it's a genetic heuristic thing. Assuming that since HPMOR is a fanfic, and since most of the possible arguments for why a particular fanfic is good are wrong, arguments for why HPMOR is good must be wrong.
He also said it wasn't good enough to publish, but when asked why, said there were legal issues with publishing fanfiction, which isn't evidence either way for its 'goodness'. This makes me think he has no arguments addressing the actual goodness of the writing.
Really? What makes HPMoR not good enough to be publishable?
50 Shades of Gray was a twilight fanfiction, and apparently it was good enough to be publishable.
What does it actually mean for a piece of fiction to be 'good'? HPMoR can be an author tract at times, but it also has one of the most intricate plots I've ever read, specifically designed so that thinking about it with knowledge of bayesian cognition and rationality allows the reader to discover more things about the story. There aren't many stories like this.
What about the actual quality of the writin...
A variance in the population that large, from "preserve oneself" to "do not preserve oneself", is ridiculously unlikely to remain in human beings after the past 3 billion years of evolution.
I have information from the future!
EY says it best in The Sheer Folly of Callow Youth, but essentially EY once thought, "If there is truly such a thing as moral value, then a superintelligence will likely discover what the correct moral values are. If there is no such thing as moral value, then the current reality is no more valuable than the reality where I make an AI that kills everyone. Therefore, I should strive to make an AI regardless of ethical problems."
Then in the early 2000s he had an epiphany. The mechanics of his objection had to do w...
This certainly wouldn't work on me. The easiest way to test the veracity of the proof would be AI DESTROYED. Whether or not I would want to kill the AI... I'd have to test that proof.
You wouldn't be wiping out humanity; there would be trillions of humans left.
Who cares if they run on neurons or transistors?
This needs more upvotes.
Just chapters 4-7?
I kind of would assume anybody who would go to a meetup for HPMoR has read up to current...
Expected attendance? What social media are we using?
Will be my first meetup.
i use the ` key, which I have yet to find a use for in any situation ever. since 90% of the time, the next key you're going to press is a number key, this works really well.
Quite a few people who emailed me told me they were specifically interested in learning linux; that they had installed ubuntu on a laptop but never touched the terminal, or that they had never touched linux and had to be showed how to login, etc. Because this is lesswrong, those people for the most part have actually done some stuff on their own instead of just never logging in again, but I feel like I could be doing more.
The value in learning the inner workings of an operating system should be self-evident, no matter how you scorn it. It is a human-design...
Does anybody have any specific ideas as to:
You are not an active member of the Lesswrong community. You joined solely for this shell account. Go work on your English, read the sequences, and come back.
If you can answer this question, I'll reconsider:
A bat and a ball, together, cost $1.10. The bat costs $1 more than the ball. How much does the ball cost?
i think neurosama is drastically underanalyzed compared to things like truthterminal. TT got $50k from andreeson as an experiment, neurosama peaked at 135,000 $5/month subscribers in exchange for... nothing? it's literally just a donation from her fans? what is this bizarre phenomenon? what incentive gradient made the first successful AI streamer present as a little girl, and does it imply we're all damned? why did a huge crowd of lewdtubers immediately leap at the opportunity to mother her? why is the richest AI agent based on 3-year-old llama2?