= 27d567bc2d48d9f40e9ccc20ea370b15)
NancyLebovitz comments on The Importance of Goodhart's Law - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (112)
Once management recognizes that there is something to measure, I think they do an OK job measuring it - secret shoppers come to mind. But there's something more subtle about when you take for granted that G = G* and don't even think to verbalize your true values, so can't measure them.
The secret shoppers are a variant of "the king going incognito"-- but not as good in some ways because they may be tasked with evaluating according to a checklist, and thus could still be trapped by G vs G*.
I believe that the problem isn't that true values aren't verbalized, it's that they can't be fully verbalized. Language is too low-bandwidth to capture all the aspects of a situation.
The point of a king going incognito isn't just to enforce existing, verbalized rules, it's to see how things are in the kingdom. It's a bit easier for a king than an AI because a king is more like a subject than an AI is like people.