The problem is a kind of quodlibet. Any inadequate theory can be made to work if one is allowed to dismiss whatever the theory can't explain.
Sure, I agree.
And any theory can be made to fail if I am allowed to demand that it explain things that don't actually exist.
So it seems to matter whether the thing I'm dismissing exists or not.
Regardless, all of this is a tangent from my point.
You asked "Why does it appear to make sense to wonder if we are valuing the right things?" as a rhetorical question, as a way of arguing that it appears to make sense because it does make sense, because the question of whether our values are right is non-empty. My point is that this is not actually why i...
There seems to be a widespread impression that the metaethics sequence was not very successful as an explanation of Eliezer Yudkowsky's views. It even says so on the wiki. And frankly, I'm puzzled by this... hence the "apparently" in this post's title. When I read the metaethics sequence, it seemed to make perfect sense to me. I can think of a couple things that may have made me different from the average OB/LW reader in this regard: