The previous SOTA for MATH (https://arxiv.org/pdf/2009.03300.pdf) is a fine-tuned GPT-2 (1.5b params), whereas the previous SOTA for GSM8K (https://arxiv.org/pdf/2203.11171.pdf) is PaLM (540b params), using a similar "majority voting" method as Minerva (query each question ~40 times, take the most common answer).
Here's a thought experiment: Suppose that a market is perfectly efficient, except that every 50 years or so there's a crash, which sufficiently smart people can predict a month in advance. Would you say that this market is efficient? Technically it isn't, because smart people have a systematic advantage over the market. But practically, no trader systematically beats the market, because no trader lives long enough!
I suppose you can create a long-living institution, a "black swan fund", that very rarely makes bets on predictable crashes, and over a few centuries can prove it has higher returns. But I guess not enough people care about returns over these timescales.
What's the best way to convince skeptics of the severity of COVID? I keep seeing people saying it's just a slightly worse flu, or that car accidents kill a lot more people, and so on. I want some short text or image that illustrates just how serious this is.
I found this heartbreaking testimony from an Italian ICU doctor: https://twitter.com/silviast9/status/1236933818654896129
But I guess skeptics will want a more authoritative source.
"Or the first replicator to catch on, if there were failed alternatives lost to history - but this seems unlikely, given the Fermi Paradox; a replicator should be more improbable than that, or the stars would teem with life already."
So do you thing that the vast majority of The Big Filter is concentrated on the creation of a first replicator? What's the justification for that?
Eliezer, I remember an earlier post of yours, when you said something like: "If I would never do impossible things, how could I ever become stronger?" That was a very inspirational message for me, much more than any other similar sayings I heard, and this post is full of such insights.
Anyway, on the subject of human augmentation, well, what about them? If you are talking about a timescale of decades, than intelligence augmentation does seems like a worthy avenue of investment (it doesn't has to be full scale neural rewiring, it could be just smarter nootropics).
...Can someone explain why?
Many people believe in an afterlife... why sign up for cryonics when you're going to go to Heaven when you die?
That's probably not the explanation, since there are many millions of atheists who heard about cryonics and/or extinction risks. I figure the actual explanation is a combination of conformity, the bystander effect, the tendency to focus on short term problems, and the Silliness Factor.
Eliezer, I have an objection to your metaethics and I don't think it's because I mixed levels:
If I understood your metaethics correctly, then you claim that human morality consists of two parts: a list of things that we value(like love, friendship, fairness etc), and what we can call "intuitions" that govern how our terminal values change when we face moral arguments. So we have a kind of strange loop (in the Hofstadterian sense); our values judge if a moral argument is valid or not, and the valid moral arguments change our terminal values. I thi...
why isn't the moral of this fable that pursuing subjective intuitions about correctness a wild goose chase?
Bacause those subjective intuitions are all we got. Sure, in an absolute sense, human intuitions on correctness are just as arbitrary as the pebblesorter's intuitions(and vastly more complex), but we don't judge intuitions in an absolute way, we judge them with are own intuitons. You can't unwind past your own intuitions. That was the point of Eliezer's series of posts.
The gap between autistic humans and neurotypical humans may be bigger than the gap between male and female humans. I would list autism as an exception to the psychological unity of humankind.
I remember reading "The Curious Incident of the Dog in the Night-time" and thinking: "This guy is more alien than most aliens I saw in Sci-fi".
Let me see if I get this straight:
Our morality is composed of a big computation that includes a list of the things that we value(love, friendship, happiness,...) and a list of valid moral arguments(contagion backward in time, symmetry,...). If so, then how do we discover those lists? I guess that the only way is to reflect on our own minds, but if we do that, then how do we know if a particular value comes from our big computation, or is it just part of our regular biases? And if our biases are inextricably tangled with The Big Computation, then what hope ...
The AIs will not care about the things you care about. They'll have no reason to.The "AIs" will be created by us. If we're smart enough, we will program the AIs to value the things we value (not in the same way that evolution programmed us).
The important thing is that we humans value love, and therefore we want love to perpetuate throught the universe.
I guess that this will lead to your concept of volition, isn't it?
Anyway, is Obert really arguing that morality is entirely outside the mind? Couldn't the "fact" of morality that he is trying to discover be derived from his (or humanity's, or whatever) brain design? And if you tweak Subhan's definition of "want" enough, couldn't they actually reach agreement?
Also, I take it that this means you don't believe in the whole, "if a program implements consciousness, then it must be conscious while sitting passively on the hard disk" thing. I remember this came up before in the quantum series and it seemed to me absurd, sort of for the reasons you say.
I used that as an argument against timeless physics: If you could have consciousness in a timeless universe, than this means that you could simulate a conscious being without actually running the simulation, you could just put the data on the hard drive. I'm still waiting out for an answer on that one!
Roko, what exactly do you mean by "optimal"? "optimal" means "good", which is another word for "ethical", so your definition of ethics doesn't actually tell us anything new! An AI can view the supergoal of "creating more paperclips" as the optimal/correct/succesful/good thing to do. the value of the AI's supergoal(s) doesn't has anything to do with it's intelligence.
I still don't get the point of timeless physics. It seems to me like two different ways of looking at the same thing, like classical configuration space vs relational configuration space. Sure, it may make more sense to formulate the laws of physics without time, and it may make the equations much simpler, but how exactly does it change your expected observations? In what ways does a timeless universe differ from a timeful universe?
Also, I don't think it's neccessary to study quantum mechanics in order to understand personal identity. I've reached the same conclusions about identity without knowing anything about QM, I feel it's just simple deductions from materialism.
Wait a second, this doesn't make sense. If the universe is timeless, then you don't have to actually simulate the universe on a computer. You can just create a detailed model of the universe, put in the neccesery causality structure, stick it in the RAM, and voila! you have conscious beings living out their lives in a universe. You don't even have to put it in the RAM, you can just write out symbols on a piece of paper! Or can this impeccable line of reasoning be invalidated by experimental evidence?
When you exhaust all the language data from text, you can start extracting language from audio and video.
As far as I know the largest public repository of audio and video is YouTube. We can do a rough back-of-the-envelope computation for how much data is in there:
- According to some 2019 article I found, in every minute 50 hours of video are uploaded to YouTube. If we assume this was the average for the last 15 years, that gets us 200 billion minutes of video.
- An average conversation has 150 words per minute, according to a Google search. That gets us 30T wor
... (read more)Very interesting!
There are a few things in the calculation that seem wrong to me:
I... (read more)
I agree that this points in the direction of video becoming increasingly important.
But why assume only 1% is useful? And more importantly, why use only the language data? Even if we don't have the scaling laws, but it seems pretty clear that there's a ton of information in the non-language parts of videos that'd be useful to a general-purpose agent—almost certainly more than in the language parts. (Of course, it'll take more computation to extract the same amount of useful information from video than from text.)