lessdazed comments on A Rationalist's Tale - LessWrong

82 Post author: lukeprog 28 September 2011 01:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (305)

You are viewing a single comment's thread. Show more comments above.

Comment author: lessdazed 10 September 2011 09:19:09AM 2 points [-]

Is there non-dualist theism? if not, that's the bottleneck making dismissal of theism justified, though ignorance does not excuse inaccurate descriptions of theism.

Comment author: Mitchell_Porter 10 September 2011 09:51:19AM 12 points [-]

My problem with Will's outlook is that if we are indeed being "watched over by a superintelligence", it doesn't appear to care about us in any very helpful way. Our relationship to it is therefore more about survival than it is about morality. According to the scenario, there is some thing out there which is all-powerful, whose actions depend partly on our actions, and which doesn't care about {long list of evolutionary and historical holocausts}, in any way that we would recognize as caring. Clearly, if we had any idea of the relationship between our actions and its actions, it would be in one's interest, first of all, to act so that it would not allow various awful things to happen to you and anyone you care about, and second, to act so that you might gain some advantage from its powers.

It appears that the only distinctive reason Will has for entertaining such a scenario is the usual malarkey about timeless game-theoretic equilibria... A while back, I was contemplating a post, to be called "Towards a critique of acausal reason", which was going to mention three fallacies of timeless decision theory: acausal democracy, acausal trade, acausal blackmail. The last two arise from a fallacy of selective attention: to believe them possible, you must only pay attention to possible worlds which only care about you in a highly specific way. But for any possible world where there is an intelligence simulating your response and which will do X if you do Y, there is another possible world where there is an intelligence which will do X if you don't do Y. And the actual multiplicity of worlds in which intelligences make decisions on the basis of decisions made by agents in other possible worlds that they are simulating it is vanishingly small, in the set of all possible worlds. Why the hell would you base your decision, regarding what to do in your own reality, on the opinions or actions of a possible entity in another world? You may as well just flip a coin. The whole idea that intelligences in causally disjoint worlds are in a position to trade, bargain, or arrive at game-theoretic equilibria is deeply flawed; it's only a highly eccentric agent which "cares" strongly about events which are influenced by only an extremely small fraction of its subjective duplicates (its other selves in the space of possible worlds). So some of these "eccentric agents" may genuinely "do deals", but there is no reason to think that they are anything more than a vanishingly small minority among the total population of the multiverse. (Obviously it would be desirable for people trying to work rigorously in TDT to make this argument in a rigorous form, but I don't see anything that's going to change the basic conclusion.)

So that leaves us in the more familiar situation, of possibly being in a simulation, or possibly facing the rise of a superintelligence in the near future, or possibly being somewhere in the guts of a cosmic superintelligence which either just tolerates our existence because we haven't crossed thresholds-of-caring yet, or which has a purpose for us which extends to tolerating the holocausts I mentioned earlier. All of this suggests that our survival and well-being are on the line, but it doesn't suggest that we are embedded in an order that is moral in any conventional sense.

Comment author: lessdazed 10 September 2011 10:57:22AM *  3 points [-]

acausal democracy

What does that even mean? Does that mean something like: hypothetical lunar farmers in a hypothetical lunar utopia should send down some ore to Earth, and that actual people hundreds of years earlier in a representative body voted 456-450 not to fund a lunar expedition even with a rider to the bill requiring future farmers to send down ore, but the farmer votes from the future+450 > 456? So the farmers "promised' to send ore?

acausal blackmail

It seems more like a real self inflicted wound than a fallacy or fake blackmail to me, perhaps we don't disagree. it's something that is real if one has certain patterns of mind that one could self modify away from, I think.

Comment author: Mitchell_Porter 10 September 2011 11:16:16AM 2 points [-]

By "acausal democracy", I mean the attempt to justify the practice of democracy - specifically, the act of voting - with timeless decision theory. No-one until you has attempted to depict a genuinely acausal democracy :-) This doesn't involve the "fallacy of selective attention", it's another sort of error, or combination of errors, in which TDT reasoning is supposed to apply to agents with only a bare similarity to yourself. See discussion here for a related example.

I also think we agree regarding acausal blackmail, that for a human being it can only be a mistake. Only one of those "eccentric agents" with a very peculiar utility function or decision architecture could rationally be susceptible to acausal blackmail - its decision procedure would have to insist that "selective attention" (to just those possible worlds where the specific blackmail threat is being made) is important, rather than attending to other worlds where contrary threats are being made, or to worlds where the action under consideration will be rewarded rather than punished, or to worlds where the agent is simply a free agent not being threatened or enticed by a captor who cares about acausal dealmaking (and those worlds should be in the vast majority).

Comment author: Will_Newsome 10 September 2011 11:19:31AM 1 point [-]

Right, humans can't even do straightforward causal reasoning, let alone weird superrational reasoning.

Comment author: Wei_Dai 24 April 2012 10:39:35PM 2 points [-]

I brought up a similar objection to acausal trade, and found Nesov's reply somewhat convincing. What do you think?

Comment author: Mitchell_Porter 24 April 2012 11:37:44PM 2 points [-]

We are now advanced enough to tackle this issue formally, by trying to construct an equilibrium in a combinatorially exhaustive population of acausal trading programs. Is there an acausal version of the "no-trade theorem"?

Comment author: Will_Newsome 10 September 2011 09:38:04AM *  0 points [-]

E.g. this is what most theism actually looks like: http://plato.stanford.edu/entries/divine-simplicity/ . A lot of it is simply hypotheses about attractors for superintelligences and the Platonic algorithms that they embody. Trust me, I am not just being syncretic.

Comment author: lessdazed 10 September 2011 10:45:17AM 6 points [-]

this is what most theism actually looks like

Please make a claim. Are you saying that if one were to take a proxy for quality like citations to papers/capita of religious studies branches of universities, or the top theological seminaries attached to the most competitive Ivy League Schools, or similar, you are 95% confident that at least 70% of the theist professors believe something like this?

Or is it a stronger claim? With 50% confidence, what percentage of counties and county-equivalents in the United States have most self-identified theists or spiritualists or whatever believing something like this? 50%? 10%?

In what percentage are there at least ten such people?

Comment author: Will_Newsome 10 September 2011 11:08:55AM *  0 points [-]

I don't see how that is the claim at issue. Most people are incompetent. That tells us little about what theism is. How would knowing the answer tell us anything useful about whether or not theism itself is or isn't a tenable philosophical position? I really dislike focusing on individual people, I'd rather look at memes. Can I guess at how many of the SEP's articles on theism are not-obviously-insane and not just if-a-tree-falls debates? I think that question is much more interesting and informative. I'd say... like, 30%.

Comment author: lessdazed 10 September 2011 11:15:23AM *  5 points [-]

Why call it "theism"?

Comment author: Will_Newsome 10 September 2011 11:23:05AM 2 points [-]

That's what the Stanford Encyclopedia of Philosophy calls it. Most biologists are mediocre at biology (many are creationists, God forbid!); that doesn't mean we should call the thing that good biologists do by some other name. (If this is a poor analogy I don't immediately see how, but it does have the aura of an overly leaky analogy.) If you asked "why reason in terms of theism instead of decision theory?" then I'd say "well we should obviously reason in terms of decision theory; I'd just prefer we not have undue contempt for an interesting memeplex that we're not yet very familiar with".

Comment author: lessdazed 10 September 2011 11:56:21AM *  5 points [-]

Biology is the repository of probable information left over after putting data and experiments through the sieve of peer review (the process is also "biology"). The more important ideas get parsed more. Mediocre enough biologists don't add to biology.

Theology starts with a belief system and is the remnants that by their own lights theologians have not discarded. The process of discarding is also called theology. Unsophisticated people are likely to fail to see what is wrong with more of the original belief set than sophisticated ones, they don't add to showing what is wrong with the belief pile. It isn't a crazy analogy, but it's not quite symmetrical.

To call this theism says more about the language than the beliefs you describe. Is the word closest in idea-space to this memeplex theism? OK, maybe, but it could have been "hunger for waffles and other, lesser breakfast foods" with a few adjustments to the history without adjusting anything at all about the ideas. These beliefs didn't originate as the unfalsifiable part of an arbitrary cult focused on breakfast, as it happens.

an interesting memeplex

it's interesting as the least easy to falsify, arguably unfalsifiable core of motivated, unjustified belief. It's not interesting as something at all likely to be true.

Comment author: Will_Newsome 10 September 2011 10:11:15AM *  0 points [-]

I can briefly try to translate the divine simplicity thing: "The perfectly reflective Platonic decision algorithm that performs optimally on all optimization problems doesn't 'possess' the quality of optimizerness---it is optimization, just as it is reflectivity. Being a Platonic algorithm, it does not have inputs or outputs, but controls all programs ambiently. It has no potentiality, only actuality: everything is at equilibrium." And so on and so forth. (Counterarguments would be like "what, there is a sense of equilibrium that implies that this algorithm is a decision theoretic zombie, I think you're using a non-intuitive definition of 'equilibrium'" and things like that, or something. It's better to talk in terms of decision theory but that doesn't mean they're not actually equivalent. The parts that don't boil down to predictions about decision theory tend to be just quibbling over ways of carving reality, which is often informative but not when the subject matter is so politically charged.)

Comment author: jimrandomh 13 September 2011 09:36:04PM 8 points [-]

I can briefly try to translate the divine simplicity thing: "The perfectly reflective Platonic decision algorithm that performs optimally on all optimization problems doesn't 'possess' the quality of optimizerness---it is optimization, just as it is reflectivity. Being a Platonic algorithm, it does not have inputs or outputs, but controls all programs ambiently. It has no potentiality, only actuality: everything is at equilibrium." And so on and so forth.

I think you need to take a big step back and consider what you've studied and what you've come up with. I'm not sure where divine simplicity fits in your worldview exactly, but in the course of my own decision theory studies, I came up with an issue that seems to shoot down that concept entirely: there can be no decision algorithm that performs optimally on all optimization problems, because there are optimization problems for which the solution space is infinite, and there is an infinite chain of progressively better solutions. Worse, the universe we presently occupy appears to be infinite, and to have such chains for almost all sensible optimization criteria. The best we can do, decision-theory wise, is to bite off special cases, come up with transforms and simplifications to make those cases more broadly applicable, and fall back on imperfect heuristics for the rest.

But there's a much bigger issue here. It looks to me like you've taken a few batches of concentrated confusion - the writings of old philosophers - and invented a novel interpretation to give it meaning. You then took these reinterpretations and mixed them into what started out as a sensible worldview. You're talking about studying Aquinas and Leibniz, and this makes me very worried, because my longstanding belief is that these authors, and most others of their era, are cognitive poison that will drive you insane. Furthermore, your writings recently look to me like evidence that this may actually be happening. You should probably be looking to consolidate your findings, and to communicate them.

Comment author: Will_Newsome 13 September 2011 11:56:38PM *  -1 points [-]

Divine simplicity is a hypothesis, what you say is strong evidence against that hypothesis. But I think it's still a coherent hypothesis. At the very least we can talk about Goedelian stuff or NFL theorems to counterargue a bunch of the stronger 'omnipotence, omniscience' stuff... but things are all weird when you're that abstract; you can just say, "okay, well, this agent is multipartite and so even if one part has one Chaitin's constant this other part has another Chaitin's constant and so you can get around it", or something, but I doubt that actually works or makes sense. On the other hand it's always really unclear to me when the math is or isn't being used outside its intended domain. Basically I notice I am confused when I try to steel man "optimal decision policy" arguments, for or against. (There's also this other thing that's like "optimal given boundedness" but I think that doesn't count.)

I disagree about Aquinas and Leibniz. I see them as putting forth basically sane hypotheses that are probably wrong but probably at least a little relevant for our decision policies. I don't think that theology is a useful area of study, not when we have decision theory, but I really don't think that Leibniz especially was off track with his theology. (I dunno if you missed my comments about how he was really thinking in terms of the intuitions behind algorithmic information theory?)

Comment author: CarlShulman 14 September 2011 12:41:28AM 8 points [-]

I have significant familiarity with Aquinas, and I do not see anything worth reading Aquinas for, save perhaps arguing with theists. Insofar as there are interesting ideas in his writing, they are better presented elsewhere (particularly in modern work with the benefit of greatly improved knowledge and methods), with greater clarity and without so much nonsense mixed in. Recommending that people read Aquinas, or castigating them for not having read Aquinas, seems like a recipe for wasting their time.

Comment author: Will_Newsome 14 September 2011 02:02:50AM 1 point [-]

(I agree with this.)

Comment author: lessdazed 10 September 2011 10:34:28AM 4 points [-]

I saw this after making my Plato's theory of forms comment at 10:19:54AM.

This is what I thought the article was saying.

the subject matter is so politically charged

Everyone seems to be operating under something like the law of conservation of ninjitsu here. You seem to be perhaps the worst offender, with gratuitous offensiveness and the like being approximately equal among all of the few theists here and the many atheists.

In this thread alone:

Sadly Less Wrong seems to know absolutely nothing about theism, which ends up with me repeatedly facepalming when people feel obliged to demonstrate how incredibly confident they are that theism is stupid and worth going out of their way to signal contempt for.

It tends to be like, yeah, we get it, minds reside in brains, neuroscience is cool and shit, but repeatedly bringing it up as if nobody had ever heard that before is a facepalm-inducing red herring.

theism is a less naive perspective on cosmology-morality than atheism is

Also bad is how you characterize what LW thinks, this seems like a artificial way to pretend you have the only or best informed position by averaging many people on here with the people who do't know and don't care to know about things that the best evidence they have shows are elaborate rationalizations and meta-hipsterism by intellectuals.

Comment author: Will_Newsome 10 September 2011 09:29:27AM *  0 points [-]

Yes, lots of it. E.g. Leibniz's monadology is monist (obviously); it's equivalent to computationalism in fact. But note that it's not like dualism is well-understood 'round these parts either. It's really hard to find a way in which you can say that a property dualist is wrong. It tends to be like, yeah, we get it, minds reside in brains, neuroscience is cool and shit, but repeatedly bringing it up as if nobody had ever heard that before is a facepalm-inducing red herring.

Comment author: lessdazed 10 September 2011 10:19:54AM 1 point [-]

It seems that monadology relies on something like Plato's theory of forms. That fills the role usually played by dualism in theism. Is there theism without that?

Comment author: Will_Newsome 10 September 2011 11:15:29AM *  0 points [-]

Theism without computationalism? It's not popular, but most Less Wrong folk are computationalists AFAIK. Hence the "timeless decision theory" and "Tegmark" and "simulation argument" memes floating around. I don't see how a computationalist can ignore theism on the grounds that it claims that abstract things exist.

Comment author: lessdazed 10 September 2011 11:17:09AM 4 points [-]

I do not think Plato's forms are equivalent to computationalism.

Comment author: Jack 10 September 2011 11:25:18AM 1 point [-]

Modern platonism is just the view that abstract objects exist.

Comment author: lessdazed 11 September 2011 02:21:05AM 4 points [-]

Do they causally do anything?

Comment author: Jack 11 September 2011 01:20:16PM 1 point [-]

Of course not.

Comment author: Will_Newsome 04 March 2012 01:15:49AM 0 points [-]

What? Of course abstract objects have causal influence... why do you think people don't think they do?

Comment author: Jack 04 March 2012 08:16:32AM 1 point [-]

Because I've studied metaphysics? It's not even a quirky feature of abstract objects it's often how they are defined. Now that distinction may be merely an indexical one-- the physical universe could be an abstraction in some other physical universe and we just call ours 'concrete' because we're in it. But the distinction is still true.

If you can give an instance of an abstract object exerting causal influence that would be big news in metaphysics.

(Note that an abstract object exerting causal influence is not the same as tokens of that abstraction exerting causal influence due features that the token possesses in virtue of being a token of that abstract object. That is "Bayes Theorem caused me to realize a lot of my beliefs were wrong" is referring to the copy of Bayes Theorem in your brain, not the Platonic entity. There are also type-causal statements like "Smoking causes cancer" but these are not claims of abstract objects having causal influence just abstractions on individual, token instances of causality. None of this, or my assent to lessdazed question, reflects a disparaging attitude toward abstract objects. You can't talk about the world without them. They're just not what causes are made of.)

Comment author: Will_Newsome 10 September 2011 11:30:52AM *  0 points [-]

Metaphysics of abstract processes: Pythagoras -> Leibniz -> Turing. Platonism -> monadology -> algorithmic information theory.

Math and logics: Archimedes et al -> Leibniz -> Turing. Logic -> symbolic logic -> theory of computation.

Philosophy of cognition: (haven't researched yet) -> Leibniz -> Turing. ? -> alphabet of thought -> Church-Turing thesis.

Computer engineering: Archimedes -> Pascal-Leibniz -> Turing. Antikythera mechanism -> symbolic calculator -> computer.

Comment author: Jack 10 September 2011 11:54:35AM *  1 point [-]

I think you're vastly over emphasizing the historic importance of Leibniz.

Comment author: Will_Newsome 10 September 2011 12:12:53PM 0 points [-]

True, but I think only in the same sense that everyone vastly overemphasizes the importance of Babbage. They both made cool theoretical advances that didn't have much of an effect on later thinking. This gives a sort of distorted view of cause and effect but the counterfactual worlds are actually worth figuring in to your tale in this case. Wow that would take too long to write out clearly, but maybe it kinda makes sense. (Chaitin actually discovered Leibniz after he developed his brand of algorithmic information theory; but he was like 'ah, this guy knew where it was at' when he found out about him.)

Comment author: RichardKennaway 10 September 2011 08:17:47PM 1 point [-]

OTOH, Wiener already in 1948 explicitly saw the digital computer as the fulfilment of Leibniz's calculus ratiocinator. (Quoted on Wiki here, full text (maybe paywalled) here.)

Comment author: Jack 10 September 2011 12:14:31PM 1 point [-]

Chaitin actually discovered Leibniz after he developed his brand of algorithmic information theory; but he was like 'ah, this guy knew where it was at' when he found out about him.

Interesting! You have a cite?

Comment author: Will_Newsome 10 September 2011 12:24:53PM *  3 points [-]

This is the original essay I read, I think: http://evans-experientialism.freewebspace.com/chaitin.htm

I should point out that Leibniz had the two key ideas that you need to get this modern definition of randomness, he just never made the connection. For Leibniz produced one of the first calculating machines, which he displayed at the Royal Society in London, and he was also one of the first people to appreciate base-two binary arithmetic and the fact that everything can be represented using only 0s and 1s. So, as Martin Davis argues in his book The Universal Computer: The Road from Leibniz to Turing, Leibniz was the first computer scientist, and he was also the first information theorist. I am sure that Leibniz would have instantly understood and appreciated the modern definition of randomness.

Comment author: Will_Newsome 10 September 2011 12:18:47PM *  0 points [-]

It'll take a few minutes, Googling Leibniz+Chaitin gives a lot of plausible hits.

Comment author: Will_Newsome 10 September 2011 11:42:47AM *  0 points [-]

(The history of how the idea of computation got formulated is really pertinent for FAI researchers. Justification is a lot like computation. I think we're nearing the "Leibniz stage" of technical moral philosophy. Luckily we already have the language of computation (and decision theory) to build off of in order to talk about justification. Hopefully that will reduce R&D time from centuries to decades. I'm kind of hopeful.)

Comment author: Jack 10 September 2011 10:44:32AM 0 points [-]

Leibniz doesn't believe in material substance, so in no sense is he a dualist. If you are asking if there are materialists theists- eh, maybe but as far as I know it has never been a well developed view. That said, the entire platonism-materialism question can probably be reduced to an issue of levels of simulation... in which case it is easy to envision a plausible theism that is essentially dualist but not repugnant to our computationalist sensibilities.

Comment author: lessdazed 10 September 2011 10:47:37AM 0 points [-]

It would be repugnant to their sensibilities if you described in detail the sorts of scenarios that comply with our sensibilities.

Comment author: Jack 10 September 2011 10:56:10AM *  0 points [-]

For most, probably. But you might be surprised how much unorthodoxy is out there.

Comment author: lessdazed 10 September 2011 11:02:04AM *  0 points [-]

If you first tell them, or give them enough information to realize, or strongly suspect, that without this concession by them they fail, then you can get them to agree to very nearly anything.

But those people are slightly different than the versions uninformed of this, people who would reject it.

The unorthodoxy is motivated and not serious in terms of relative degrees of belief based on what is most likely true.

Comment author: Jack 10 September 2011 11:19:41AM *  0 points [-]

"Fall"? I don't understand the second sentence either.

The unorthodoxy is motivated and not serious in terms of relative degrees of belief based on what is most likely true.

Often, though on occasion their reasons are isomorphic to stories we'd find plausible. If someone thought it was worthwhile to reinterpret some of the older theistic philosophers in light of modern information theory and computer science... some interesting ideas might fall out.

But yes- I doubt there are more than a handful of educated theists not working with the bottom line already filled in.

Comment author: lessdazed 10 September 2011 11:37:14AM 0 points [-]

Edited "fall" to "fail".

the second sentence means I am trying to distinguish between who someone is and who they might have been. Another intuition pump: put identical theists in identical rooms, on one play a television program explaining how they have to admit that all good evidence makes it unlikely there exists (insert theological thing here, an Adam and eve, a soul, whatever) and on the other play something unrelated to the issue. Then ask the previously identical people if they believe in whatever poorly backed theological thing they previously believed. the unorthodox will flee the false position, but only if they see it as obviously false.

Something like this.

Often, though on occasion their reasons are isomorphic to stories we'd find plausible.

That doesn't mean the reasons we find it implausible aren't good or can't be taught., just as teaching how carbon dating relates to the age of the Earth militates against believing it is ~6,000 years old, one can show why what ancestors tell you in dreams isn't good evidence.

So my conclusion, my supposition, is that if you muster up the most theistic-compatible metaphysics you find plausible, and show it to those theists who don't know why anything more supernatural is implausible, inconsistent or incoherent, they will reject it.

That they accept it after learning that you have good objections to anything more theistic is not impressive at all.

Comment author: Jack 10 September 2011 11:50:05AM 1 point [-]

Got it. Don't disagree. But it doesn't follow that a) we should disregard all theistic philosophy or b) not use theistic language. Given that there are live possibilities that resemble theism the circle of concepts and arguments surrounding traditional, religious theism are likely to be fruitful.

Comment author: Will_Newsome 10 September 2011 11:57:35AM *  -1 points [-]

But yes- I doubt there are more than a handful of educated theists not working with the bottom line already filled in.

Rationalization is an important skill of rationality. (There probably needs to be a post about that.) But anyway, I think my "theistic" intuitions are very similar to those of Thomas Aquinas, a.k.a. the rock that Catholic philosophy is built on. Like, actually similar in that we're thinking about the same decision agent and its properties, not just we're thinking about similar ideas.