= 27d567bc2d48d9f40e9ccc20ea370b15)
timtyler comments on The Domain of Your Utility Function - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (94)
I don't think this post adequately distinguishes between two concepts: how does the human utility function actually work, and how should it work.
The answer to the first question is (I thought people here agreed) that humans weren't actually utility maximizers; this makes things like your descriptive argument against perceptive determinism unnecessary and a lot of your wording misleading.
The second question is: if we're making some artificial utility function for an AI or just to prove a philosophical point, how should that work - and I think your answer is spot on. I would hope that people don't really disagree with you here and are just getting bogged down by confusion about real brains and some map-territory distinctions and importing epistemology where it's not really necessary.
I'm pretty sure that the first reasonably-intelligent machines will work much as illustrated in the first diagram - for engineering reasons: it is so much easier to build them that way. Most animals are wired up that way too - as we can see from their drug-taking behaviour.