Point #1 was raising alarm bells on my mind, too naive, so thank you for asking the question.
What's up with the weird units for money?
I dont think any of that invalidates that Gwern is a usual, usually right.
I dont think this is a good take.
The Cybertruck does not break on that pull. It breaks on this one: 0:27
"We'll be building a cluster of around 22,000 H100s. This is approximately three times more compute than what was used to train all of GPT4.
This bothers me. It's a naive way of seeing compute. It's like confusing Watts and Watt-hours
22,000 H100s is three times the amount of FLOP/s than what was used to GPT-4, so you could train it in 3x less time, of with 1/3 of your cluster and the same time.
I think this view of looking at compute helps making naive asumptions about what this compute can be used to. And FLOP/s are not a perfect unit for normal discourse when we're at x10¹⁵ scales.
If ancestor is parent/mother/grandparent etc but nothing else. Obviously non hunters.
If we count how many people dead or alive are you related to. Farmers.
Better than 90% of amateur fiction posted.
This gap will only widen over time; China is failing to develop a domestic semiconductor industry, despite massive efforts to do so, and is increasingly cut off from international semiconductor supply chains.
I would say this is a falsehood
The US export ban on Controlled GPUs has really made china push for local semiconductor manufacturing way, and accelerate their projects, they dont have 5nm TSMC quality wafers, fine, but they're developing the full stack.
I dont think the difficulty of the task has much with the outcome.
I mean, I take your comment at face value and update to "it's going to get powerful faster" and not the other way around.
Okay so, with the inspirations of the concise posts about lifestyle that user @jefftk does, I want to share one of my most recent discoveries with LW, one that with little economical input can offer you a better quality of life.
Really! A 20 bucks Oral-B department store is fine!
Do you remember the nice feeling when you go to your dentist for a cleanup and you leave with that smooth, polished feeling on your teeth that sometimes last you days? I do remember it, I got the exact same feeling from my first brush with an Electric toothbrush.
I got a Basic Oral-B Vitality[1] from my grocery store a week ago as... (read more)
Could we not devise AlphaFold but for LLM alignment?
Your P/NP remark reminded me of the scepticism around Protein folder before the Alpha fold days.