= 27d567bc2d48d9f40e9ccc20ea370b15)
VoiceOfRa comments on Rationality Quotes Thread September 2015 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (482)
The general opinion around here (which I share) is that the complexity of those is much higher than you probably think it is. "Human-level" concepts like "mercy" and "adultery" and "benevolence" and "cowardice" feel simple to us, which means that e.g. saying "God is a perfectly good being" feels like a low-complexity claim; but saying exactly what they mean is incredibly complicated, if it's possible at all. Whereas, e.g., saying "electrons obey the Dirac equation" feels really complicated to us but is actually much simpler.
Of course you're at liberty to say: "No! Actually, human-level concepts really are simple, because the underlying reality of the universe is the mind of God, which entertains such concepts as easily as it does the equations of quantum physics". And maybe the relative plausibility of that position and ours ultimately depends on one's existing beliefs about gods and naturalism and so forth. I suggest that (1) the startling success of reductionist mathematics-based science in understanding, explaining and predicting the universe and (2) the total failure of teleological purpose-based thinking in the same endeavour (see e.g., the problem of evil) give good reason to prefer our position to yours.
That sounds really optimistic.
They can be derived from simple game theory as applied to humans.
I'm not entirely convinced, but in any case even "human" is a really complicated concept.
I guess that means humans don't exist. Oh, wait.
No, but it does mean that if you want to argue that humans exist you must provide strong positive evidence, perhaps telling us an address where we can meet a real live human ;)
I could stand to meet a real-life human. I've heard they exist, but I've had such a hard time finding one!
No idea where you get that from. Theories don't get a complexity penalty for the complexity of things that appear in universes governed by the theories, but for the complexity of their assumptions. If you have an explanation of the universe that has "there is a good god" as a postulate, then whatever complexity is hidden in the words "good" and "god" counts against that explanation.
Yes, and God would care about game theory concepts and apply them to whatever being exist.
If I'm correctly understanding what you're claiming, it's something like this: "One can postulate a supremely good being without needing human-level concepts that turn out to be really high-complexity, by defining 'good' in very general game-theoretic terms". (And, I assume from the context in which you're making the claims: "... And this salvages the project, mentioned above by CCC, of postulating God as an explanation for the world we see, the idea being that ultimately the details of physical law follow from God's commitment to making the best possible world or something of the kind".)
I'm very pessimistic about the prospects for defining "good" in abstract game-theoretic terms with enough precision to carry out any project like this. You'd need your definition to pick out what parts of the world are to count as agents that can be involved in game-like interactions, and to identify what their preferences are, and to identify what counts as a move in each game, and so forth. That seems really difficult (and high-complexity) to me, whether you focus on identifying human agents or whether you try to do something much more general. Evidently you think otherwise. Could you explain why?
(I'll mention two specific difficulties I anticipate if you're aiming for simplicity through generality. First: how do you avoid identifying everything as an agent and everything that happens as an action? Second: if the notion of goodness that emerges from this is to resemble ours enough for the word "good" actually to be appropriate, it will have to give different weight to different agents's interests -- humans should matter more than ducks, etc. How will it do that?)
So it would be difficult for a fintie being that is figuring out some facts that it doesn't already know on the basis of other facts that it does know. Now..how about an omniscient being?
I think you may be misunderstanding what the relevance of the "difficulty" is here.
The context is the following question:
If some notion like "perfectly benevolent being of unlimited power" turns out to have very low complexity, so much the better for theistic explanations of the universe. If it turns out to have very high complexity, so much the worse for such explanations.
(Of course that isn't the only relevant question. We also need to estimate how likely a universe like ours is on any given hypothesis. But right now it's the complexity we're looking at.)
In answering this question, it's completely irrelevant how good some hypothetical omniscient being might be at figuring out what parts of the world count as "agents" and what their preferences are and so on, even though ultimately hypothetical omniscient beings are what we're interested in. The atheistic argument here isn't "It's unlikely that the world was created by a god who wants to satisfy the preferences of agents in it, because identifying those agents and their preferences would be really difficult even for a god" (to which your question would be an entirely appropriate rejoinder). It's something quite different: "It's not a good explanation for the universe to say that it was created by a god who wants to satisfy the preferences of agents in it, because that's a very complex hypothesis, because the notions of 'agent' and 'preferences' don't correspond to simple computer programs".
(Of course this argument will only be convincing to someone who is on board with the general project of assessing hypotheses according to their complexity as defined in terms of computer programs or something roughly equivalent, and who agrees with the claim that human-level notions like 'agent' and 'preference' are much harder to write programs for than physics-level ones like 'electron'. Actually formalizing all this stuff seems like a very big challenge, but I remark that in principle -- if execution time and computer memory are no object -- we basically already know how to write a program that implements physics-so-far-as-we-understand-it, but we seem to be some way from writing one that implements anything much like morality-as-we-understand-it.)
It's not surprising that one particular parsimony principle can be used to overturn one particular form of theism. After all, most theists disagree with most theisms...and most believres in a Weird Science hypothesis (MUH, Matrix, etcv ) don't believe in the others.
The question is: where is the slam dunk against theism..the one that works against all forms of theism, that works only against theism , and not against similar scientific ideas like Matrix Lords, and works against the strongest arguments for theism, not just biblically literalist creationist protestant Christianity, and doesn't rest on cherry-picking particular parisimony principles?
There are multiple principles of parsimony, multiple Occam's razors.
Some focus on ontology, on the multiplication of entities, as in the original razor others on epistemology the multiplication of assumptions. The Kolmogorov complexity measure is more alligned to the latter.
Smaller universes are favoured by the ontological razor,but disfavoured by the Epistemological razor, because they are more arbitrary. Maximally large universes can have low epistemic complexity (because you have to add information specifying hwat has been left out to arrive at smaller universs), and low K. complexity (because short programmes can generate infinite bitstrings, eg an expansion of pi).
Morality as we know it evolved from physics plus starting conditions. When you say that physics is soluble but morality isn't, I suppose you mean that the starting conditions are absent.
This is motivated stopping. You don't want to admit any evidence for theism so you declare the problem impossible instead of thinking about it for 10 seconds.
Here are some hints: If you were dropped into an alien planet or even an alien universe you would have no trouble identifying the most agenty things.
Well there you go, agents are things that can be involved in game-like interactions.
This is the third time in the last few weeks that you have impugned my integrity on what seems to me to be zero evidence. I do wish you would at least justify such claims when you make them. (When I have asked you to do so in the past you have simply ignored the requests.)
Would it kill you to entertain some other hypotheses -- e.g., "the other guy is simply failing to notice something I have noticed" and "I am simply failing to notice something the other guy has noticed"? Perhaps it would; your consistent strategy of downvoting everyone who disagrees with you doesn't exactly suggest that you're here for a collaborative search for truth as opposed to fighting a war with arguments as soldiers.
[EDITED to add: I didn't, in fact, declare anything impossible; and before declaring it very difficult I did in fact think about it for more than ten seconds. I see little evidence that you've given as much thought to anything I've said in this discussion.]
I have agent-identifying hardware in my brain. It is, I think, quite complicated. I don't know how to make a computer identify agents, and so far as I know no one else does either. The best automated things I know of for tasks remotely resembling agent-identification are today's state-of-the-art image classifiers, which typically involve large mysterious piles of neural network weights, which surely count as high-complexity if anything does.
Identifying game-like interactions is also (so far as I can tell) a problem no one has any inkling how to solve, especially if we don't have the prior ability to identify the agents.
No, but I do downvote people who appear to be completely mind-killed.
Rather, identifying agents using algorithms with reasonable running time is a hard problem.
Also, consider the following relatively uncontroversial beliefs around here:
1) The universe has low Kolmogorov complexity.
2) An AGI is likely to be developed and when it does it'll take over the universe.
Now let's consider some implications of these beliefs:
3) An AGI has low Kolmogorov complexity since it can be specified as "run this low Kolmogorov complexity universe for a sufficiently long period of time".
Also the AGI to be successful is going to have to be good at detecting agents so it can dedicated sufficient resources to defeating/subverting them. Thus detecting agents must have low Kolmogorov complexity.
I think there a word missing there. ("trouble believing"? "trouble with"? "trouble recognizing"?)
Thanks, fixed.