I had an idea a while ago, which sounded simple to me, but searching with certain keywords did not yield appropriate results, so am presenting it for discussion to LW . Please inform me if something like this is already in existence. Please inform if I need to cross post...
I wanted to take a poll among LW folk since this question I had didn't seem to have a straight forward utilitarian answer. Please correct my impression, if wrong. Situation A government has a limited budget of USD $10 Billion, which it will award in 10 years with which it...
I would like to raise a discussion topic in the spirit of trying to quantify risk from uncontrolled / unsupervised software. What is the maximum autonomy that has been granted to an algorithm according to your best estimates? What is the likely trend in the future? The estimates could be...
Related to : Lost Purposes, The importance of Goodhart's Law, Homo Hypocritus, SIAI's scary idea, Value Deathism Summary : Whenever human beings seek to achieve goals far beyond their individual ability, they use leverage of some kind of another. Creating organizations to achieve goals is a very powerful source of...
Most long term users on Less Wrong understand the concept of optimization power and how a system can be called intelligent if it can restrict the future in significant ways. Now I believe that in this world, only institutions are close to superintelligence in any significant way. I believe it...
This article introduces Goodhart's law, provides a few examples, tries to explain an origin for the law and lists out a few general mitigations. Goodhart's law states that once a social or economic measure is turned into a target for policy, it will lose any information content that had qualified...