Short Summary

This is a commentated research agenda on the metaethics and normative ethics of AGI (artificial general intelligence) value alignment. It aims to show that various crucial aspects of this interdisciplinary Herculean task hinge on
1) numerous metaethical (and metaethics-related) questions;
2) on the moral implications of different answers to these questions;
3) on how relevant actors end up deciding to take the uncertainty surrounding these (meta)ethical questions into account.

My key takeaways (for the short summary):
1) At least some of the questions about metaethics and normative ethics briefly discussed in the six main parts and listed in the two appendices merit further attention.
2) Let us take seriously Nick Bostrom’s verdict... (read 2142 more words →)

LESSWRONG
LW

LESSWRONG
LW

Eleos Arete Citrini

Eleos Arete Citrini

Eleos Arete Citrini

The Metaethics and Normative Ethics of AGI Value Alignment: Many Questions, Some Implications

Eleos Arete Citrini

Eleos Arete Citrini

Eleos Arete Citrini

The Metaethics and Normative Ethics of AGI Value Alignment: Many Questions, Some Implications

Short Summary