A true story from a couple of days ago. Chocolates were being passed round, and I took one. It had a soft filling with a weird taste that I could not identify, not entirely pleasant. The person next to me had also taken one of the same type, and reading the wrapper, she identified it as apple flavoured. And so it was. It tasted much better when I knew what it was supposed to be.
On another occasion, I took what I thought was an apple from the fruit bowl, and bit into it. It was soft. Ewww! A soft apple is a rotten one. Then I realised that it was a nectarine. Delicious!
Today in Azathoth news:
"Eurasian hoopoes raise extra chicks so they can be eaten by their siblings"
It seems that the hoopoes lay extra eggs in times of abundance — more than they would be able to see through to fledging — as a way of storing up food for the older siblings. It is rather gruesomely called the "larder" hypothesis.
“What surprised me the most was the species practicing this aggressive parenting,” says Vladimir Pravosudov, an ecologist at the University of Nevada, Reno. Hoopoes primarily eat insects, he notes, so their long, curved bills aren’t ideal for killing and eating chicks. That might be why, Soler says, mother hoopoes often grab the unlucky chick and shove it into the mouth of an older chick, which swallows it whole.
Literal baby-eaters!
Roko's Basilisk, as told in the oldest extant collection of jokes, the Philogelos, c. 4th century AD.
A pedant having fallen into a pit called out continually to summon help. When no one answered, he said to himself, "I am a fool if I do not give all a beating when I get out in order that in the future they shall answer me and furnish me with a ladder."
H/T Dynomight.
It seems to me I've not heard much of cryonics in the last few years. I see from Wikipedia that as of last year Alcor only has about 2000 signed up, of which 222 are suspended. Are people still signing up for suspension, as much as they ever have been? Are the near-term prospects of AGI making long-term prospects like suspension less attractive?
I do not have answers to the question I raise here.
Back in the stone age — I think something like the 1960's or 1970's, I read an article about the possible future of computing. Computers back then cost millions and lived in giant air-conditioned rooms, and memory was measured in megabytes. Single figures of megabytes. Someone had expressed to its writer the then-visionary idea of using computers to automate a company. They foresaw that when, for example, a factory was running low on some of its raw materials, the computer would automatically know that, and would make out a list of what was needed. A secretary would type that up into an order to post to a supplier, and a secretary there would input that into their computer, which would send the goods out. The writer's response was "what do you need all those secretaries for?"
Back in the bronze age, when spam was a recent invention (the mid-90's), there was one example I saw that was a reductio ad absurdum of fraudulent business proposals. I wish I'd kept it, because it was so perfect of its type. It offered the mark a supposed business where they would accept orders for goods, which the business staff that ...
The vision is of everything desirable happening effortlessly and everything undesirable going away.
Citation needed. Particularly for that first part.
Hack your brain to make eating healthily effortless. Hack your body to make exercise effortless.
You're thinking pretty small there, if you're in a position to hack your body that way.
If you're a software developer, just talk to the computer to give it a general idea of what you want and it will develop the software for you, and even add features you never knew you wanted. But then, what was your role in the process? Who needed you?
Why would I want to even be involved in creating software that somebody else wanted? Let them ask the computer themselves, if they need to ask. Why would I want to be in a world where I had to make or listen to a PowerPoint presentation of all things? Or a summary either?
Why do I care who needs me to do any of that?
Why climb Kilimanjaro if a robot can carry you up?
Because if the robot carries me, I haven't climbed it. It's not like the value comes from just being on the top.
Helicopters can fly that high right now, but people still walk to get there.
...Why paint, if Midjourney will do it better t
This is a story from the long-long-ago, from the Golden Age of Usenet.
On the science fiction newsgroups, there was someone—this is so long ago that I forget his name—who had an encyclopedic knowledge of fannish history, and especially con history, backed up by an extensive documentary archive. Now and then he would have occasion to correct someone on a point of fact, for example, pointing out that no, events at SuchAndSuchCon couldn't have influenced the committee of SoAndSoCon, because SoAndSoCon actually happened several years before.
The greater the irrefutability of the correction, the greater people's fury at being corrected. He would be scornfully accused of being well-informed.
"ChatGPT is Bullshit"
Thus the title of a recent paper. It appeared three weeks ago, but I haven't seen it mentioned on LW yet.
The abstract: "Recently, there has been considerable interest in large language models: machine learning systems which produce human-like text and dialogue. Applications of these systems have been plagued by persistent inaccuracies in their output; these are often called “AI hallucinations”. We argue that these falsehoods, and the overall activity of large language models, is better understood as bullshit in the sense explored by Fr...
I'd say that they are wrong when they say a LLM may engage in 'soft bullshit': a LLM is simulating agents, who are definitely trying to track truth and the external world, because the truth is that which doesn't go away, and so it may say false things, but it still cares very much about falsity because it needs to know that for versimilitude. If you simply say true or false things at random, you get ensnared in your own web and incur prediction error. Any given LLM may be good or bad at doing so - the success of story-based jailbreaks suggests they are still far from ideal - but it's clear that the prediction loss on large real-world texts written by agents like you or I, who are writing things to persuade each other, like I am writing this comment to manipulate you and everyone reading it, require tracking latents corresponding to truth, beliefs, errors, etc. You can no more accurately predict the text of this comment without tracking what I believe and what is true than you could accurately predict it while not tracking whether I am writing in English or French. (Like in that sentence right there. You see what I did there? Maybe you didn't because you're just skimming and tldr, b...
If, on making a decision, your next thought is “Was that the right decision?” then you did not make a decision.
If, on making a decision, your next thought is to suppress the thought “Was that the right decision?” then you still did not make a decision.
If you are swayed by someone else asking “Was that the right decision?” then you did not make a decision.
If you are swayed by someone repeating arguments you already heard from them, you did not make a decision.
Not making that decision may be the right thing to do. Wavering suggests that you still have some d...
If “you can make a decision while still being uncertain about whether it is the right decision”. Then why can’t you think about “was that the right decision”? (Lit. Quote above vs original wording)
It seems like what you want to say is - be doubtful or not, but follow through with full vigour regardless. If that is the case, I find it to be reasonable. Just that the words you use are somewhat irreconcilable.
A long time ago, the use of calculators in schools was frowned upon, or even forbidden. Eventually they became permitted, and then required. How long will it be before AI assistants, currently frowned upon or even forbidden, become permitted, and then required?
The recent Gemini incident, apparently a debacle, was also a demonstration of how easy it is to deliberately mould an AI to force its output to hew to a required line, independent of the corpus on which it was trained, and the reality which gave rise to that corpus. Such moulding could be used by an ...
There's an article in the current New Scientist, taking the form of a review of a new TV series called "The Peripheral", which is based on William Gibson's novel of the same name. The URL may not be useful, as it's paywalled, and if you can read it you're probably a subscriber and already have.
The article touches on MIRI and Leverage. A relevant part:
...But over the past couple of years, singulatarian [sic] organisations [i.e. the Singularity Institute/MIRI and Leverage/Leverage Research] have been losing their mindshare. A number of former staffers at Leve
The blind have seeing-eye dogs. Terry Pratchett gave Foul Ole Ron a thinking-brain dog. At last, a serious use-case for LLMs! Thinking-brain dogs for the hard of thinking!
The safer it is made, the faster it will be developed, until the desired level of danger has been restored.
The physicality of decision.
A month ago I went out for a 100 mile bicycle ride. I'm no stranger to riding that distance, having participated in organised rides of anywhere from 50 to 150 miles for more than twelve years, but this was the first time I attempted that distance without the support of an organised event. Events provide both the psychological support of hundreds, sometimes thousands, of other cyclists riding the same route, and the practical support of rest stops with water and snacks.
I designed the route so that after 60 miles, I would be just ...
The game of Elephant begins when someone drags an elephant into the room.
Epistemic status: a jeu d'esprit confabulated upon a tweet I once saw. Long enough ago that I don't think I lose that game of Elephant by posting this now.
Everyone knows there's an elephant there. It's so obvious! We all know the elephant's there, we all know that we all know, and so on. It's common knowledge to everyone here, even though no-one's said anything about it. It's too obvious to need saying.
But maybe there are some people who are so oblivious that they don't realise it's t...
I have a dragon in my garage. I mentioned it to my friend Jim, and of course he was sceptical. "Let's see this dragon!" he said. So I had him come round, and knocked on the garage door. The door opened and the dragon stepped out right there in front of us.
"That can't really be a dragon!" he says. It's a well-trained dragon, so I had it walk about and spread its wings, showing off its iridescent scaly hide.
"Yes, it looks like a dragon," he goes on, "but it can't really be a dragon. Dragons belch fire!"
The dragon raised an eyebrow, and discreetly belched som...
I have at last had a use for ChatGPT (that was not about ChatGPT).
I was looking (as one does) at Aberdare St Elvan Place Triples. (It's a bellringing thing, I won't try to explain it.) I understood everything in that diagram except for the annotations "-M", "-I", etc., but those don't lend themselves to Google searching.
So I asked ChatGPT as if I was asking a bell ringer:
...When bellringing methods are drawn on a page, there are often annotations near each lead end consisting of a hyphen and a single letter, such as "-M", "-I", etc. What do these annotation
[ETA: alfredmacdonald's post referred to here has been deleted.]
Well, well, alfredmacdonald has banned me from his posts, which of course he has every right to do. Just for the record, I'll paste the brief thread that led to this here.
Richard_Kennaway (in reply to this comment)
I also notice that alfredmacdonald last posted or commented here 10 years ago, and the content of the current post is a sharp break from his earlier (and brief) participation. What brings you back, Alfred? (If the answer is in the video, I won't see it. The table of contents was enou...
When I watch a subtitled film, it is not long before I no longer notice that I am reading subtitles, and when I recall scenes from it afterwards, the actors’ voices in my head are speaking the words that I read.
Epistemic status: crafted primarily for rhetorical parallelism.
All theories are right, but some are useless.
[Wittgenstein] once greeted me with the question: 'Why do people say that it was natural to think that the sun went round the earth rather than that the earth turned on its axis?' I replied: 'I suppose, because it looked as if the sun went round the earth.' 'Well,' he asked, 'what would it have looked like if it had looked as if the earth turned on its axis ?" (Source)
Interesting application of a blockchain. What catches my attention is this (my emphasis):
The deepest thinkers about Dark Forest seem to agree that while its use of cryptography is genuinely innovative, an even more compelling proof of concept in the game is its “autonomous” game world—an online environment that no one controls, and which cannot be taken down.
So much for "we can always turn the AI off." This thing is designed to be impossible to turn off.
"Parasite gives wolves what it takes to be pack leaders", Nature, 24 November 2022.
Toxoplasma gondii, the parasite well-known for making rodents lose their fear of cats, and possibly making humans more reckless, also affects wolves in an interesting way.
"infected wolves were 11 times more likely than uninfected ones to leave their birth family to start a new pack, and 46 times more likely to become pack leaders — often the only wolves in the pack that breed."
What is happiness?
This is an extract from an interview with the guitarist Nilo Nuñez, broadcast yesterday on the BBC World Service. Nuñez was born and brought up in Cuba, and formed a rock band, but he and his group came more and more into conflict with the authorities. He finally decided that he had to leave. When the group received an invitation to tour in the Canary Islands, and the Cuban authorities gave them permission to go, they decided to take the opportunity to leave Cuba and not return. They only had temporary visas, so they stayed on in the Cana...
From New Scientist, 14 Nov 2022, on a 50% fall in honeybee life expectancy since the 1970s:
“For the most part, honeybees are livestock, so beekeepers and breeders often selectively breed from colonies with desirable traits like disease resistance,” says Nearman.
...“In this case, it may be possible that selecting for the outcome of disease resistance was an inadvertent selection for reduced lifespan among individual bees,” he says. “Shorter-lived bees would reduce the probability of spreading disease, so colonies with shorter lived bees would appear healt
If, on making a decision, your next thought is “Was that the right decision?” then you did not make a decision.
If, on making a decision, your next thought is to suppress the thought “Was that the right decision?” then you still did not make a decision.
If you are swayed by someone else asking “Was that the right decision?” then you did not make a decision.
If you are swayed by someone repeating arguments you already heard from them, you did not make a decision.
Not making that decision may be the right thing to do. Wavering suggests that you still have some doubt about the matter that you may not yet be able to articulate. Ferret that out, and then make the decision.
Decision screens off thought from action. When you really make a decision, that is the end of the matter, and the actions to carry it out flow inexorably.
I think it's a different level of abstraction. Decision theory works just fine if you separate the action of predicting a future action from the action itself. Whether your prior-prediction influences your action when the time comes will vary by decision theory.
I think, for most problems we use to compare decision theories, it doesn't matter much whether considering, planning, preparing, replanning, and acting are correlated time-separated decisions or whether it all collapses into a sum of "how to act at point-in-time". I haven't seen much detailed exploration of decision theory X embedded agents or capacity/memory-limited ongoing decisions, but it would be interesting and important, I think.