Thanks for the feedback! working on refining the writeup.

though as Geoff Hinton has pointed out, 'confabulations' might be a better word

I think yann lecun was the first one to using this word https://twitter.com/ylecun/status/1667272618825723909

not much information is given regarding that so far, i was curious about that too

"Algorithm for Concept Extrapolation"

I don't see any recent publications for paul christiano related to this. So i guess the problem[s] is still open.

parameters before L is less than $m$,

should this be after?

AutoGPT was created by a non-coding VC

It looks like you are confusing autoGPT with babyagi which was created by yohei nakajima who is a VC. the creator of autoGPT (Toran Bruce Richards) is a game-developer with a decent programming (game-development) experience. Even the figure shown here is that from babyagi (https://yoheinakajima.com/task-driven-autonomous-agent-utilizing-gpt-4-pinecone-and-langchain-for-diverse-applications/).

47 layers layer

47 layers later ?

really interesting idea.

Regarding the first one i am not expecting a single-prompt to generate the entirity of enwiki8/9. I am more interested in finding a set of prompts with a lookup table if possible to replicate enwiki data.

Thanks for the pointer for chincilla post, will look into it.