All of voyantvoid's Comments + Replies

For the Skunk Works and SpaceX examples, I did find myself wondering whether some aspects like the powerful decisive managers are strictly better or merely increase variance and so appear more often when looking at the most successful projects. I haven't done much reading of the primary and secondary sources for progress studies, how easy would it be to find details of the practices of average or failed projects to compare against?

3Owain_Evans
We think there's a connection between the Reversal Curse and some results in the model editing literature. I'm not sure if this applies to the specific ROME results in that post. We'll have the Reversal Curse paper out soon, which will explain more.

RE: claim 25 about the need for research organisations , my first thought is that government national security organisations might be suitable venues for this kind of research as they have several apparent advantages:

  • Large budgets
  • Existing culture and infrastructure for research in secret with internal compartmentalisation
  • Comparatively good track record for keeping results secret in crypto, such as the NSA with RSA or GCHQ with PGP
  • Routes to internal prestige and advancement without external publication
  • Preventing the creation of unaligned AI would acco
... (read more)