LESSWRONG
LW

All of PeteJ's Comments + Replies

AI Alignment and the Classical Humanist Tradition
PeteJ10

Note: I see this approach is also proposed by "AI Alignment Proposals"

This article explores the concept and potential application of bottom-up virtue ethics as an approach to instilling ethical behavior in artificial intelligence (AI) systems. We argue that by training machine learning models to emulate virtues such as honesty, justice, and compassion, we can cultivate positive traits and behaviors based on ideal human moral character. This bottom-up approach contrasts with traditional top-down programming of ethical rules, focusing instead on experiential

... (read more)
Reply
AI Alignment and the Classical Humanist Tradition
PeteJ-10

Thanks for the reply. To comment on your reply, let me be more precise in what I believe are the problems this approach could address. 

a) Assuming that the AI is already loyal, or at least following our wishes: how can we make sure that it takes human values into account in its decisions such that it doesn't mistakenly do something against these values?

  • I believe running every decision through a "Classical Virtue Ethics"-control, to be a way to do this.
  • As an analogy, we can train AI on grammar and rhetoric, by giving it a huge amount of literature to r
... (read more)
Reply
2AnthonyC
If we are lucky enough to find ourselves in one of in those situations you describe, where we have an AGI that wants to do what humanity wants (or would/should want) it to want to do, then to what degree is additional training actually required? I'm sure there are many possible such scenarios that vary widely, but my mental default assumption is that such a system would already be motivated to seek out answers to questions such as, "What is it the humans want me to want, and why?" which would naturally include studying... well, pretty much the entire moral philosophy literature. I wouldn't put super high odds on it, though. That said, one of my main concern about a classical virtue ethics training regimen specifically is that it doesn't really give a clear answer about how to prioritize among virtues (or more broadly, things some subset of cultures says are virtues) that are in conflict, and real humans do in fact disagree and debate about this all the time.
1PeteJ
Note: I see this approach is also proposed by "AI Alignment Proposals"  
Catching the Eye of Sauron
PeteJ10

"You are, whether you like it or not, engaged in memetic warfare - and recent events/information make me think this battle isn't being given proper thought"

I'd like to chime in on the psychological aspects of such a warfare. I suggest that a heroic mindset will be helpful in mustering courage, hope and tenacity in fighting this cultural battle. In the following I will sketch out both a closer view of the heroic mindset, as well as a methodology for achieving it. 

A) On the heroic mindset
Heroism is arguably "altruistic risk, resilience, and fundamental ... (read more)

Reply