Do humans really learn from "little" data?
How much data does it take to pretrain a (human) brain? I conducted a (fairer) Fermi estimate. The post goes through the following questions: * How long does it take to grow a human brain? * How many waking seconds do we have in our life? * How many “tokens”...