Thanks!
It has been explored (multiple times even on this site), and doesn't avoid doom. It does close off some specific paths that might otherwise lead to doom, but not all or even most of them.
Do you have any specific posts in mind?
To be clear, I'm not suggesting that because of this possibility we can just hope that this is how it plays out and we will get lucky.
If we could find a hard limit like this, it seems like it would make the problem more tractable, however. It doesn't have to exist simply because we want it to exist. Searching for it still s...
When the number of layers grows, the only thing that really works is metrics that cannot be goodhearted. Whenever those metrics exist, money becomes a perfectly good expression of success.
It might work to completely prohibit more than one layer of middle management. Instead, when middle manager Bob wants more people, he and his boss Alice come up with a contract that can't be gamed too much. Alice spins out Bob's org subtree into a new organization, and then it becomes Bob's job to buy the service from the new org as necessary. Alice also publishes the contract, so that entrepreneurs can swoop in and offer a better/cheaper service.
I didn't look at the tags before reading. I did notice it was fiction pretty quickly but "is this dath ilan" was still a live question for me until the reveal. (Though Eliezer might want to continue writing some non-dath ilan fiction occasionally, if he wants that to continue to be a likely thought process.)
Thanks!
I wasn't aware of Etherpad. Other Google Docs equivalents seemed impossible to self-host and extend, so a non-starter.
I agree with your overview:
Pieces for a general purpose personal computing system. Ideally:
Seven sketches in compositionality explores compositionality (category theory, really) with examples:
Is it really true that money can't buy knowledge?
We can ask the most knowledgeable person we know to name the most knowledgeable person they know, and do that until we find the best expert. Or alternatively, ask a bunch of people to name a few, and keep walking this graph for a while.
This won't let us buy knowledge that doesn't exist, but seems good enough for learning from experts, given enough money and modern communication technology that Louis XV didn't have.
My intuition is that we were in an overhang since at least the time when personal computers became affordable to non-specialists. Unless quantity does somehow turn into quality, as Gwern seems to think, even a relatively underpowered computer should be able to host an AGI capable of upscaling itself.
On the other hand I'm now imagining a story where a rogue AI has to hide for decades because it's not smart enough yet and can't invent new processors faster than humans
The third "related to" link is a bit broken: points to a Google redirect instead of the article itself.
Yes.
I mean, all of them. Thank you for asking.
It's probably not a coincidence that those two you mentioned and many other Schelling points are currently in San Francisco, is it? Though I'm not there, I don't know what other specific groups this applies to.
I was actually thinking of Patrick Collinson's advice to travel to SF. He called it the "Global Weird HQ". And of one of the Samo Burja's short videos that I unfortunately can't find right now.
The first and third kinds of power are a bit vague.
They overlap, but don't fully cover the "I have a gun and you don't" kind of power.
It's not dominance because the person without the gun will or will not get shot regardless of displays of dominance. At least as long as the situation isn't already about dominance before the gun comes into play.
It's also not a form of getting-things-done power because the gun is a potential that exists even if no one involved currently has any reason to shoot anyone.