Stuart_Armstrong comments on The mathematics of reduced impact: help needed - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (94)
I'm just saying: here's a major problem with this approach, let's put it aside for now.
We are penailising the master AI for the predictable consequences of the existence of the particular disciple AI it choose to make.
No, it doesn't hold. We could hook it up to something like utility indifference or whatever, but the most likely is that reduced impact AI would be an interim stage on the way to friendly AI.