= 27d567bc2d48d9f40e9ccc20ea370b15)
David_Gerard comments on Mahatma Armstrong: CEVed to death. - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (60)
This seems related to the problem that human preferences are contradictory. As I suggested here, this may be kept in place by evolution to keep us working and enhancing our genetic fitness - meaning that human preferences would not only be incoherent, but would need to be incoherent to capture human value.
So, how would one approach creating a mostly-usable extrapolation of inconsistent starting values?
By letting people evolve their values at their own pace, within ethical boundaries.
There are certain problems in attempting to program such a procedure, however, that being the problem at hand.
I agree. In case it's not clear, my opinion is that an essential part of being a person is developing one's value system. It's not something that you can entirely outsource because "the journey is part of the destination" (but of course any help one can get matters) and it's not a requirement for having ethical people or AI. ETA: i.e. having a fixed value system is not a requirement for being ethical.