In the book, I don't remember and think probably it's just weird and subtle because part of the point of it is that it's alien.
As I intend it here, yeah, it would be a distinct thing. I think almost everyone knows criticism can be painful to receive and rude to give, whereas advice can feel a lot more benign.
Reasonable! It strikes me as a little silly for in person conversation, but I find it fun to type and read.
"Face" is pretty close, and it's cool to be reminded that that word (in this context) exists.
The main difference as I see it is that shifgrethor is narrower. At least as I propose the term be used (which is not as subtle or mysterious as in the book), it's specific to advice. You can also lose face by e.g. not responding to taunting, or something. Shifgrethor would have no opinion on that.
Yeah, probably. There are a few things like "meconium aspiration" that would make a literal 1:1 womb substitute insufficient to give the baby a few more weeks, and for all we know some of the 42-43 issues are direct harms of marginal gestation. But I'd be rather surprised (<10% chance) if the optimal gestation-in-artificial-womb duration were less than 41 weeks.
They're correlational, though the broad cohorts help - not sure what you can do beyond just canvassing an entire birth cohort and noticing differences. There are possible pitfalls like the decision to induct early being made by people with genes that predict bad outcomes? But I really don't think that's major.
Yeah, you've convinced me I was a little too weak just by saying "the scaling laws are untested" - I had the same feeling of like "maybe I'm getting Eulered here, and maybe they're Eulering themselves" with the 10^23 thing.
Mostly I just kept seeing suggested articles in the mainstream-ish tech press about this "wow, no MatMul" thing, assumed it was an overhyped exaggeration/misleading, and was pleasantly surprised it was for real (as far as it goes). But I'd give it probably... 15%? Of having industrial use cases in the next few years. Which I guess is actually pretty high! Could be nice for really really huge context windows, where scaling on input token length sucks.
Yeah, could cut both ways for this I think? On the one hand, if no-MatMul models really are more efficient in the long run, you could probably make custom hardware optimized for the stuff they require (e.g. lots of ternary stuff). But getting there from the ASICs currently in development would be a necessary pivot.
Maybe the race dynamics actually help slow things down here? Since nobody wants to pivot and fall temporarily behind; money might dry up or someone else might get there before the investment pays off and you leapfrog.
But yeah, even in the medium run, as constraints start to flare up, probably ASICs are a factor in changing up architectures.
Thanks for this - helpful and concrete, and did change my mind somewhat. Of course, if it really is just 10x, in terms of orders of magnitude/hyper fast scaling we are pretty close to the wall.
Mostly just public text, I think. But I'm not sure how much more you get out of e.g. video transcripts. Maybe a lot! But it wouldn't surprise me if that was notably worse as a source.
(I assume you are asking why it should be rarer, not why it is rarer.)
A few reasons, including:
I suppose there may be lots of cases where upregulating advice would be good, and that these outweigh the common cases where downregulating it would be good. I just haven't thought of those. If you have, I'd be interested in hearing them!