Eugine_Nier comments on We Don't Have a Utility Function - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (123)
My fault for failing to clarify. There are roughly three ways one can talk about changes to an agent's terminal values.
(1) Such changes never happen. (At a society level, this proposition appears to be false).
(2) Such changes happen through rational processes (i.e. reasoning).
(3) Such changes happen through non-rational processes (e.g. tribal affiliation + mindkilling).
I was using "conversion" as a metaphorical shorthand for the third type of change.
BTW, you might want to change "conversation" to "conversion" in the grandparent.
Ah! Thanks.