As intelligence and safety research continue to progress, I’ve been thinking more and more about how to create potential market dynamics that help with alignment and safer usage of AI. This feels especially important as we likely face cat and mouse games with frontier models pushing performance first and alignment/red teaming second, along with open source continuing to keep up (on a 3-9 month lag) with frontier models.
The traditional approach to AI safety has largely operated through the paradigm of technical constraints and social responsibility; a framework that, while noble in intention, often positions safety as friction against the relentless momentum of capability advancement. This has of course led to signals of... (read 1684 more words →)
The idea of knowledge over money is romantic and one that I agree, is at times the right long-run bet. I understand you're arguing for diminishing returns here but the issue I've found is that some tiers of wealth *on average* allow one to access tiers of collectives of knowledge that meaningfully impact your ability to scale with lower effort (& thus at equal effort, faster).