People don't want you to be happy for complex reasons. They want you to be happy for specific reasons, that just happen to not be simple.
People want you to be happy because you enjoy some piece of fine art, not because the greatest common divisor of the number of red and black cars you saw on the way to work is prime.
Complexity in morality is like consistency in truth. Let me explain.
If all of your beliefs are exactly correct, they will be consistent. But if you force all your beliefs to be consistent, there's no guarantee they'll be correct. You can end up fixing a right thing to make it consistent with a wrong thing.
Just so with morality; humans value complex things, but this complexity is a result, not a cause, and not something to strive for in and of itself.
The sequences contain a preemptive counterargument to your post, could you address the issues raised there?
To address some topic digression. My point is not the theoretical notion whenever you can or can't derive the FAI rules this way. The point here is that we, humans, seem to use some intuitive notion of complexity - for lack of better word - to rank moral options. The wire-heading objection issue is particularly striking example of this.
Just a note - I'd change your last sentence as it seems to imply some form of Lamarckianism and will probably get your post downvoted for that, when I'm sure that wasn't your intent...
I don't understand why this post and some of Dmytry's comments are downvoted so hard. The idea might be far-fetched, but certainly not crazy, self-contradictory or obviously false.
My personal impression has been that emotions are a result of a hidden subconscious logical chain, and can be affected by consciously following this chain, thus reducing this apparent complexity to something simple. The experiences of others here seem to agree, from Eliezer's admission that he has developed a knack for "switching off arbitrary minor emotions" to Alicorn...
I can't speak to the downvoting, but for my part I stopped engaging with Dmytry altogether a while back because I find their habit of framing interactions as adversarial both unproductive and unpleasant. That said, I certainly agree that our emotions and moral judgments are the result of reasoning (for a properly broad understanding of "reasoning", though I'd be more inclined to say "algorithms" to avoid misleading connotations) of which we're unaware. And, yes, recapitulating that covert reasoning overtly frequently gives us influence over those judgments. Similar things are true of social behavior when someone articulates the underlying social algorithms that are ordinarily left covert.
I agree that some level of ambiguity is unavoidable, especially on initial exchange.
Given iterated exchange, I usually find that ambiguity can be reduced to negligible levels, but sometimes that fails.
I agree that some folks here have the habit you describe, of interpreting other people's comments uncharitably. This is not unique to AI issues; the same occurs from time to time with respect to decision theory, moral philosophy, theology, various other things.
I don't find it as common here as you describe it as being, either with respect to AI risks or anything else.
Perhaps it's more common here than I think but I attend to the exceptions disproportionally; perhaps it's less common here than you think but you attend to it disproportionally; perhaps we actually perceive it as equally common but you choose to describe it as the general case for rhetorical reasons; perhaps your notion of "the interpretation that makes the least amount of sense" is not what I would consider an uncharitable interpretation; perhaps something else is going on.
I agree that fear tends to inhibit reasonable processing.
I don't understand why this post and some of Dmytry's comments are downvoted so hard.
I'm going with the position that the post got the votes that it deserved. It's not very good thinking and Dmytry goes out of his way to convey arrogance and condescension while he posts. It doesn't help that rather than simply being uninformed of prior work he explicitly belligerently defies it - that changes a response of sympathy with his efforts and 'points for trying' to an expectation that he says stuff that makes sense. Of course that is going to get downvoted.
The idea might be far-fetched, but certainly not crazy, self-contradictory or obviously false.
It isn't self-contradictory, just the other two.
Seriously, complexity maximisation and "This also aligns with what ever it is that the evolution has been maximizing on the path leading up to H. Sapiens." That is crazy and obviously false.
It is not such a big leap to suggest that our snap moral judgments likewise result from a complex, or at least hidden, subconscious reasoning.
Of course that is true! But that isn't what the post says. There is a world of difference between "our values are complex" and "we value complexity".
Establish a track record of being a careful thinker, who usually spends a lot of time looking for holes in their own ideas and arguments before posting them. And not in a cursory way or out of a sense of obligation, but because you know deep down that most new ideas, including your own, and even new arguments pointing out that other ideas are wrong, are wrong. Looks for steps in your argument that are weak. Intuitions that other people may not share. Equally plausible arguments with contradictory conclusions. Analogous arguments that lead to obviously wrong conclusions. Alternative hypotheses that can explain your observations.
TBH with this community i'm feeling i'm dealing with some people who got in general a very deeply flawed approach to the thought which in a subtle way breaks problem solving, and especially cooperative problem solving.
The topic here is fuzzy, and I do say that it is rather unfinished; it is implied that I think it may not be true, doesn't it? It is also, a discussion post. At the same time what I do not say, is 'lets go ahead and implement AI based on this', or something similar. It is immediately presumed of me, that I has posted this with utter and complete certainty - even though this can not be inferred from anything. The disagreement I get also is that of utter - crackpot grade - certainty that no theres no way it is in any way related to human moral decisionmaking. Yes, I do not have a proof, or particularly convincing argument that it is related; that is absolutely true, and I do not think I do. At the same time, the point is to look and see how it may enhance the understanding.
For example - it is plausible that we humans do use size of our internal representation of concepts as proxy for something, because it generally e.g. associates with closer people, etc. Assuming any kind of compression, size of internal representation is a form of complexity measure.
Forget about fairness
I'll just go to a less pathological place. The issue is not the fairness; here it is not enough (nor needed) to have any domain specific knowledge (such as e.g. knowing that size of compressed representation = some form of complexity). What is necessary, is very extensive knowledge of a large body of half baked (or entirely un-baked while verbose), vague stuff, 'less you contradict any of it while trying to do any form of search for any kind of solution. What you're doing here is pathologically counter productive to any form of problem solving that involves several individuals (and likely counter productive to problem solving by individuals as well). You (lesswrong) are still apes with pretensions, and your 'you have not proved it' still leaks into 'your belief is wrong' just as much as for anyone else, because that's how brains work, nearby concepts collapse, and just because you know they do doesn't magically make it not so; the purpose of knowing fallibility of human brain is not for (frankly, very naive) assumption that now - that you know - you are magically not fallible. This is like those toy decision agents that second guess themselves into a faulty answer.
TBH with this community i'm feeling i'm dealing with some people who got in general a very deeply flawed approach to the thought which in a subtle way breaks problem solving, and especially cooperative problem solving.
And this community gets the impression that they are dealing with what amounts to a straw-man generator. Let's agree to disagree.
I'll just go to a less pathological place.
Please do. As you have said, you can expect to achieve more social success with your preferred behaviors if you execute them in different social hierarchies. And suc...
Preface: I am just noting that we people seem to be basing our morality on some rather ill defined intuitive notion of complexity. If you think it is not workable for AI, or something like that, such thought clearly does not yet constitute a disagreement with what I am writing here.
More preface: The utilitarian calculus is an idea that what people value is described simply in terms of summation. The complexity is another kind of f(a,b,c,d) that behaves vaguely like a 'sum' , but is not as simple as summation. If the a,b,c,d are strings, and it is a programming language, the above expression would often be written like f(a+b+c+d) , using + to mean concatenation, while it is something very fundamentally different from summation of real valued numbers. But it can appear confusingly close, as for a,b,c,d that don't share a lot of information among themselves, the result will behave a lot like a function on sum of real numbers. It will, however, diverge from the sum like behaviour as the a,b,c,d share more information among themselves, much in similar to how our intuitions for what is right diverge from sum like behaviour when you start considering exact duplicates of people, which only diverged for a few minutes.
It's a very rough idea, but it seems to me that a lot of common sense moral values are based on some sort of intuitive notion of complexity. Happiness via highly complex stimuli that pass through highly complex neural circuitry inside your head seems like a good thing to pursue; happiness via wire, resistor, and battery seems like a bad thing. What makes the idea of literal wireheading and hard pleasure inducing drugs so revolting for me, is the simplicity, banality of it. I have much fewer objections to e.g. hallucinogens (never took any myself but I am also an artist and I can guess that other people may have lower levels of certain neurotransmitters, making them unable to imagine what I can imagine).
The complexity based metrics have a property that they easily eat for breakfast huge numbers like "a dust speck in the 3^^^3 eyes", and even the infinity. The torture of a conscious being for a long period of time can easily be more complex issue than even the infinite number of dust specks.
Unfortunately, the complexity metrics like Kolmogorov's complexity are noncomputable on arbitrary input, and are big for truly random values. But in so much as the scenario is specific and has been arrived at by computation, there is this computation's complexity which sets an upper bound on complexity of scenario. The mathematics may also be not here yet. We have the intuitive notion of complexity where the totally random noise is not very complex, the very regular signal is not either, but some forms of patterns are highly complex.
This may be difficult to formalize. We could of course only define the complexities when we are informed of properties of something, but can not compute them for arbitrary input from scratch; if we map something as 'random numbers', the complexity is low; if it is encrypted volumes of works of Shakespeare, even though we wouldn't be able to distinguish that from random in practice (assuming good encryption), as we are told what it is, we can assign it higher complexity.
This also aligns with what ever it is that the evolution has been maximizing on the path leading up to H. Sapiens (Note that for the most part, evolution's power gone into improving the bacteria; the path leading up H. Sapiens is a very special case). Maybe we for some reason try to extrapolate this [note: for example, a lot of people rank their preference of animals as food by the animal's complexity of behaviours, which makes the human least desirable food; we have anti-whaling treaties], maybe it is a form of goal convergence between brain as intelligent system, and evolution (both employ hill climbing to arrive at solutions), or maybe we evolved the system that aligns with where evolution was heading because that increased fitness [edit: to address possible comment, we have another system based on evolution - the immune system - it works by evolving the antigens using somatic hypermutation; it's not inconceivable that we use some evolution-like mechanism to tweak our own neural circuitry, given that our circuitry does undergo massive pruning in early stages of life].