Having documented epistemic consequences of realist metaphysics (https://doi.org/10.6084/m9.figshare.19204896.v1), it has been pointed-out to me that even non-realists might endorse them. That should be no surprise since non-realists are in community with realists, and sharing epistemic practices (like sharing language) makes community easier. No doubt, realists would likewise endorse non-realist practices, in return, if non-realism made any such practice necessary.
What makes this observation relevant to this article is the potential for non-realist positi...
To get the “orthogonality” part, I think the definition of the thesis also needs to include that increasing the intelligence of the agents does not cause interpretation of (some) goals to converge.
In particular, the dismissal of the concern that policy must include an absolutely perfect specification of the perfect goal does not deny that an agent could have a goal to maximize paperclip production, but rather asserts that the paperclip maximization goal may seed ASI adequately because a perfect intelligence pursuing it would behave the same as a perf...
AI threatens to orchestrate sustainable social reform would belong in the 2025 review, but may I suggest adding a new kind of agenda to your taxonomy for 2025?
Most of your current categories focus on technology, but this article focusses on safety, on the nature of our self-destruction/warfare, and explores what is needed technically from AI to solve it. It sees caste systems that predate AI, notes that they are dangerous (perhaps increasingly dangerous) and how to adjust AI designs and evaluation processes accordingly.
Perhaps the title of the agenda... (read more)