= 27d567bc2d48d9f40e9ccc20ea370b15)
thomblake comments on Attention Less Wrong: We need an FAQ - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (108)
Surely it's a logical possibility. Stipulate: "What's right is either X or Y, where we ask each person in the universe to think of a random integer, sum them, and pull off the last bit, 0 meaning X is right and 1 meaning Y is right."
ETA: CEV, perhaps?
Wouldn't "Everyone should do what my moral code says they should" be subjective nonrelativism? Surely there are lots of people who believe that.
I don't think the people who believe that, think that their own mental states are what determine the truth of their moral code.
Is CEV even an ethical theory? I thought it was more of an algorithm for extracting human preferences to put them in an AI.
Surely it's a de facto ethical theory, since it determines entirely what the FAI should do. But then, the FAI is not supposed to be a person, so that might make a difference for our use of 'ethical'.
hmm. Then wouldn't it be premised on subjective relativism? (relative to humans)
Yes, I'd considered that when I wrote it, but it's an odd use of 'relative' when it might be equivalent to 'the same for everyone'.
not all possible minds, just human minds
EDIT: but if you thought all possible minds had the same preferences, then it would be subjective nonrelative, wouldn't it?
Maybe, though in that unlikely event I would suspect that there's some universal law behind that odd fact about preferences, in which case I'd think it would be objective.
Well I'm not sure we need to consider merely logically possible minds, and it's logically possible that non-human minds are physically impossible.
Only in the sense that it logically possible that travel to Mars is physically impossible. The wording is deceptive.
I'm not sure what sense you're referring to, or what you're comparing it to, or how it's deceptive.
Privileging the hypothesis, really.
well then, I'm just not imaginative enough!
Once you've had to argue about ethics with logicians, it becomes natural. "But what if... (completely implausible hypothesis that no one believes)" comes up a lot.