Thanks for your suggestions! All these are, in fact, in the works.

Write down any previously unpublished ideas in SIAI people's heads, as concisely and completely as possible, as blog posts or papers.

Carl is writing up some of these on his blog, Reflective Disequilibrium.

Incrementally improve the LW Wiki. Add entries for any of the topics on your list that are missing, and link to existing blog posts and papers.

This is in my queue of things for remote researchers to do.

Make a push for "AI Risk" to become a proper academic discipline

I'm working with Sotala and Yampolskiy on a paper that summarizes the problem of AI risk and the societal & technical responses to it that have been suggested so far, to give some "form" to the field. I already published my AI Risk Bibliography, which I'll update each year in January. More importantly, AGI-12 is being paired with a new conference called AGI-Impacts. Also, SIAI is developing a "best paper" prize specific to AGI impacts or AI risk or something (we're still talking it through).