This is our monthly thread for collecting these little gems and pearls of wisdom, rationality-related quotes you've seen recently, or had stored in your quotesfile for ages, and which might be handy to link to in one of our discussions.
- Please post all quotes separately, so that they can be voted up/down separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
- Do not quote yourself.
- Do not quote comments/posts on LW/OB.
- No more than 5 quotes per person per monthly thread, please.
Not directly, there is no fixed "preference mapping" from minds to preferences that works in general. We can only hope for one that works for humans, constructed for searching preference of humans, because it won't need to work for any almost-humans or not-humans-at-all. I look at a mind and see that its preference is X, you look at the same mind and say it's Y. There is no factual disagreement, the sense of "preference" was different; and if it was the same, the purpose was lost.
Well, yes; it's not straightforward to go from brains to preferences. But for any particular definition of preference, a given brain's "preference" is just a fact about that brain. If this is true, it's important to understanding morality/ethics/volition.