= 27d567bc2d48d9f40e9ccc20ea370b15)
chron comments on Heroin model: AI "manipulates" "unmanipulatable" reward - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (10)
Imagine a drug with no effect except that it cures its own (very bad) withdrawal symptoms. There's no benefit to taking it once, but once you've been exposed, it's beneficial to keep taking more because not taking it makes you feel very bad.
And in that case U(++,-) doesn't imply that forcing people on the drug increases utility.
It implies it only in combination with the false premise that peoples' actions accurately reflect the utility function we want to maximize.