All of Fivehundred's Comments + Replies

I've been anesthetized twice. I don't remember any dreams whatsoever, but I had the distant feeling that I did dream upon waking (though they may have happened as the drug was loosening its hold).

But you still experience things when you sleep, hence are observing. Also, quantum insomnia should exist if you're correct, but it doesn't.

I don't see how a Boltzmann brain spontaneously forming could ever be more likely than existing in a universe with all the infrastructure necessary to support a natural brain - even if that infrastructure beats some amazing odds, it only has to maintain itself. The theory further requires that mind unification be true.

1gilch
As I said elsewhere observer moments need not be contiguous. And I agree that you could count as an observer if you're dreaming ("semiconsciouse maybe"), but not if you're anesthetized or similarly unconscious. This is probably the case in deep sleep and likely in comatose states.
And I don't see how a death being "natural" makes it OK.

That's not what I said (though it is a good reason to be suspicious of attempts to remove it.) I'll just leave it that I have some philosophical opinions which lead me to believe it is not annihilation.

Also, the baseball example is not a natural phenomenon. If it were, I'd consider it rational to accept it as a good thing.

1gilch
I wouldn't consider it rational even if natural. You know what else is natural? Smallpox. The Appeal to Nature is generally considered a weak argument. A "natural life" is a stone-age life. You could certainly do worse, but it's not setting the bar very high.

Actually, I just realized there's no reason you would remain conscious in QI. Surely the damage to your brain and body would put you into a coma - a fate I'd like to avoid, but definitely better than Literally Hell.

Also, what is all this talk about suicide? All I said was that I plan to die normally. You guys are reading weird things into that...

1gilch
A coma where you're semiconscious maybe. You can't get a successor observer-moment to the current one without the "observer". And have you considered more exotic possibilities like Boltzmann brains?
1gilch
It was mostly just for contrast with the cryonics bit. Also, Quantum Suicide is another name for the same thought experiment. The others might be reacting to the "I'm in a bad place right now" combined with all this talk of death. And I don't see how a death being "natural" makes it OK. Death is Bad. If you want to live today, and expect to feel the same way tomorrow, then by induction, why not at 80? Ill health? Medicine might be more advanced by then.
4gilch
Rationalists love criticism that helps them improve their thinking. But this complaint is too vague to be any help to us. What exactly went wrong, and how can we do better?

To be clear: your argument is that every human being who has ever lived may suffer eternally after death, and there are good reasons for not caring...?

That requires an answer that, at the very least, you should be able to put in your own words. How does our subjective suffering improve anything in the worlds where you die?

3Vladimir_Nesov
It's not my argument, but it follows from what I'm saying, yes. Even if people should care about this, there are probably good reasons not to, just not good enough to tilt the balance. There are good reasons for all kinds of wrong conclusions, it should be suspicious when there aren't. Note that caring about this too much is the same as caring about other things too little. Also, as an epistemic principle, appreciation of arguments shouldn't depend on consequences of agreeing with them. Focusing effort on the worlds where you'll eventually die (as well as the worlds where you survive in a normal non-QI way) improves them at the cost of neglecting the worlds where you eternally suffer for QI reasons.

Yes, you either lose or you win. Two choices.

1Akram Choudhary
its a 2x2 matrix if you are married tho 

No, it isn't. The same thing will happen to everyone in your branch (you don't see it, of course, but it will subjectively happen to them).

Perhaps you don't understand what the argument says. You, as in the person you are right now, is going to experience that. Not a infinitesimal proportion of other 'yous' while the majority die. Your own subjective experience, 100% of it.

4Vladimir_Nesov
This has the same issue with "is going to experience" as the "you will always find" I talked about in my first comment. Yes. All of the surviving versions of myself will experience their survival. This happens with extremely small probability. I will experience nothing else. The rest of the probability goes to the worlds where there are no surviving versions of myself, and I won't experience those worlds. But I still value those worlds more than the worlds that have surviving versions of myself. The things that happen to all of my surviving subjective experiences matter less to me than the things that I won't experience happening in the other worlds. Furthermore, I believe that not as a matter of unusual personal preference, but for general reasons about the structure of valuing of things that I think should convince most other people, see the links in the above comments.

Why wouldn't it create random minds if it's trying to grab as much 'human-space' as possible?

EDIT: Why focus on the potential of quantum immortality at all? There's no special reason to focus on what happens when we *die*, in terms of AI simulation.

By "essentially impossible" I meant "extremely improbable". The word "essentially" was meant to distinguish this from "physically impossible".

I don't see how it refutes the possibility of QI, then.

There is a useful distinction between knowing the meaning of an idea and knowing its truth. I'm disagreeing with the claim that "all of our measure is going into those branches where we survive", understood in the sense that only those branches have moral value (see What Are Probabilities, Anyway?),
... (read more)
4Vladimir_Nesov
See the context of that phrase. I don't see how it could be about "refuting the possibility of QI". (What is "the possibility of QI"? I don't find anything wrong with QI scenarios themselves, only with some arguments about them, in particular the argument that their existence has decision-relevant implications because of conditioning on subjective experience. I'm not certain that they don't have decision-relevant implications that hold for other reasons.) This seems tautologously correct. See the points about moral value in the grandparent comment and in the rest of this comment for what I disagree with, and why I don't find this statement relevant. Neither would I. But this is not all that people care about. We also seem to care about what happens outside our subjective experience, and in quantum immortality scenarios that component of value (things that are not personally experienced) is dominant.

Why? Surely they're trying to rescue us. Maintaining the simulation would take away resources from grabbing even more human-measure.

1avturchin
To escape creating just random minds, the future AI has to create a simulation of the history of the whole humanity, and it is still running, not maintained. I explored the topic of the resurrectional simulations here: https://philpapers.org/rec/TURYOL
The meaning of "you will always find" has a connotation of certainty or high probability, but we are specifically talking about essentially impossible outcomes.

Why? Nothing is technically impossible with quantum mechanics. It is indeed possible for every single atom of our planet to spontaneously disappear.

This could make sense as a risk on the dust speck side of , but conditioning on survival seems to be just wrong as a way of formulating values (see also).

You're not understanding that all of our measure is going into those branches where... (read more)

4Vladimir_Nesov
By "essentially impossible" I meant "extremely improbable". The word "essentially" was meant to distinguish this from "physically impossible". There is a useful distinction between knowing the meaning of an idea and knowing its truth. I'm disagreeing with the claim that "all of our measure is going into those branches where we survive", understood in the sense that only those branches have moral value (see What Are Probabilities, Anyway?), in particular the other branches taken together have less value. See the posts linked from the grandparent comment for a more detailed discussion (I've edited it a bit). This meaning could be different from one you intend, in which case I'm not understanding your claim correctly, and I'm only disagreeing with my incorrect interpretation of it. But in that case I'm not understanding what you mean by "all of our measure is going into those branches where we survive", not that "all of our measure is going into those branches where we survive" in the sense you intend, because the latter would require me to know the intended meaning of that claim first, at which point it becomes possible for me to fail to understand its truth.
But you wanted something who adheres to MWI, and that is not me.

That would be optimal, but I still would like to hear your thoughts.

Some thoughts from Sean Carroll on the topic of Quantum Immortality:
https://www.reddit.com/r/seancarroll/comments/9drd25/quantum_immortality/e5l663t/
And this one from Scott Aaronson:
https://www.scottaaronson.com/blog/?p=2643#comment-1001030
Celebrity or not, both are quite likely to reply to a polite yet anxious email, since they can actually relate to your worries, if maybe not on the same topic.

Unfortunately, neither of ... (read more)

1gilch
I don't buy that argument about sleep, but what about anesthesia? I see no reason why successor observer-moments have to be contiguous in either time or space. They likely will be due to the laws of physics, but we're talking about improbable outcomes here. Your unconscious body is not your successor. It's an inanimate object that has a high probability of generating a successor observer-moment at a later time. (That is, it might wake up as you.)
2Vladimir_Nesov
The meaning of "you will always find" has a connotation of certainty or high probability, but we are specifically talking about essentially impossible outcomes. This calls for tabooing "you will always find" to reconcile an intended meaning with extreme improbability of the outcome. Worrying about such outcomes might make sense when they are seen as a risk on the dust speck side of Torture vs. Dust Specks (their extreme disutility overcomes their extreme improbability). But conditioning on survival seems to be a wrong way of formulating values (see also), because the thing to value is the world, not exclusively subjective experience, even if subjective experience manages to get significant part of that value.
the second is "unification of identical experiences"

I disagree. Quantum Immortality can still exist without it; it's only this supposition of the AI 'rescuing you' that requires that. Also, if AIs are trying to grab as many humans as possible, there's no special reason to focus on dying ones. They could just simulate all sorts of brain states with memories and varied experiences, and then immediately shut down the simulation.

If we assume that we cannot apply self-locating belief to our experience of time (and assume AIs are i... (read more)

1avturchin
Agree, but some don't. We could be (and probably are) in AI-created simulation, may be it is a "resurrectional simulation". But if friendly AIs dominate, there will be no drastic changes.

But wait, doesn't that require the computational theory of mind and 'unification' of identical experiences? If they don't hold, then we can't go into other universes regardless of whether MWI is true (if they do, then we could even if MWI is false). I would have to already be simulated, and if I am, then there's no reason to suppose it is by the sort of AI you describe.

Your suggestion was based on the assumption of an AI doing it, correct? It isn't something we can naturally fall into? Also, even if all your other assumpt... (read more)

3avturchin
QI works only if at least three main assumptions hold, but we don't know for sure if they are true or not. One is very large size of the universe, the second is "unification of identical experiences" and the third one is that we could ignore the decline of measure corresponding to survival in MWI. So, QI validity is uncertain. Personally I think that it is more likely to be true than untrue. It was just a toy example of rare, but stable world. If friendly AIs are dominating the measure, you most likely will be resurrected by friendly AI. Moreover, friendly AI may try to dominate total measure to increase human chances to be resurrected by it and it could try to rescue humans from evil AIs.

What was that talk about 'stable but improbable' worlds? If someone cares enough to revive me (I assume my measure would mostly enter universes where I was being simulated), then that doesn't seem likely. I also can't fathom that an AI wanting to torture humans would take up a more-than-tiny share of such universes. Do you think such things are likely, or is it that their downsides are so bad that they must be figured into the utilitarian calculus?

1avturchin
The world where someone wants to revive you has low measure (may be not, but let's assume), but if they will do it, they will preserve you there for very long time. For example, some semi-evil AI may want to revive you only to show red fishes for the next 10 billion years. It is a very unlikely world, but still probable. And if you are in, it is very stable.

What about Tegmark's argument that dying would have to be a binary event in order to experience immortality? If so, wouldn't your consciousness just dissolve? Or can no iota of consciousness be lost?

1Pattern
Is winning the lottery a binary event?
You've been basilisked.

Yes, but how plausible are such scenarios considered? If I die naturally? I don't find AI superintelligence very plausible.

What about that talk of being 'locked in a very unlikely but stable world'? Where is he getting that from?

There is no empirical evidence for MWI, but a number of physicists do believe that it can be something related to reality, with some heavy modifications, since, as stated, it contradicts General Relativity. Sean Carroll, an expert in both Quantum Mechanics and General Relativity, is one
... (read more)
2Shmi
I do have a PhD in Physics, classical General Relativity specifically. But you wanted something who adheres to MWI, and that is not me. Some thoughts from Sean Carroll on the topic of Quantum Immortality: https://www.reddit.com/r/seancarroll/comments/9drd25/quantum_immortality/e5l663t/ And this one from Scott Aaronson: https://www.scottaaronson.com/blog/?p=2643#comment-1001030 Celebrity or not, both are quite likely to reply to a polite yet anxious email, since they can actually relate to your worries, if maybe not on the same topic.
However, in current situation of quick technological progress such eternal sufferings are unlikely, as in 100 years some life extending and pain reducing technologies will appear. Or, if our civilization will crash, some aliens (or owners of simulation) will eventually bring pain reduction technics.

What if I don't agree?

If you have thoughts about non-existence, it may be some form of suicidal ideation, which could be side effect of antidepressants or bad circumstances. I had it, and I am happy that it is in the past. If such ideation persists,
... (read more)
3avturchin
If QI is true, no matter how small is the share of the worlds where radical life extension is possible, I will eventually find myself in it, if not in 100, maybe in 1000 years.

That does not apply to outside-of-the-mainstream views.

It does indeed. Evidence that x is true is not the same as an explanation of how x occurred. For instance, we can see that an ancient city was burned down around a certain year, but not know for what purpose or by whom.

History is a very big subject. Translating Herodotus does not give you any insights into VI-VII century Arabia.

You just complained that he wasn't an academic.

0Lumifer
With straightforward archeological evidence, yes, it does. But if you are talking about a different interpretation of well-known sources, it's not like you have new facts -- what you are offering is a new narrative and that needs, basically, to make sense. "Making sense" here implies fitting into a larger context better than the old narrative which, in turn, involves better explanations of how and why things known to happen happened. The point of that was to draw your attention to the criteria for his work. An academic (outside of gender studies and such) generally has to be very careful about his claims and very explicit about the evidence he uses. There are a lot of safeguards against jumping to conclusions and shoddy scholarship tends to be ruinous to a reputation. A popsci writer, on the other hand, has incentives to produce an exciting and controversial story which will sell well.

Refraining from a 'detailed' reconstruction seems quite reasonable. In history, you don't generally have to explain how something happens to assert that it did.

Holland is indeed something of a pop author, but once you've translated Herodotus it's hard to claim that you have no real expertise in history.

0Lumifer
That does not apply to outside-of-the-mainstream views. History is a very big subject. Translating Herodotus does not give you any insights into VI-VII century Arabia.

Um... did you read the following sentence? She didn't abandon the idea at all. And there's at least one major work that argues for it: 'In the Shadow of the Sword.'

0Lumifer
I did read the following sentence and noted that it does not have any footnotes attached to it -- as far as I can see it's an unsubstantiated assertion by some Wikipedia editor. Besides "I'm not going to admit I was wrong, I just will stop talking/writing about this" counts as abandonment in my book. As to Tom Holland, he is a writer, not an academic. Pop science, of course, has a rather large liking for outrageous claims.

The idea as I know it comes from Patricia Crone, but it's been picked up by other historians like Tom Holland. Basically, it claims that Muhammad came from Jordan and the idea of Islam originating in Medina was an attempt to 'Arabize' the new religion.

0Lumifer
Ah, interesting. But it seems that this "Revisionist" school is about critically analysing Koran and hadiths -- basically not taking them at their word which is entirely reasonable. The claim that Islam didn't originate in Arabia is mostly limited to Crone and even she looks to have abandoned this claim: Wikipedia says "Later, Patricia Crone refrained from this attempt of a detailed reconstruction of Islam's beginnings".

I'm not sure it counts. Muhammad certainly existed. Most of the theology wouldn't have been made up as you describe. I'm really just talking about the origin story, since whether Islam actually came from Arabia isn't certain.

0Lumifer
I haven't read anything which doubts that. What is the alternative theory?

I admit it's possible for components of a religion to be taken from political propaganda (certain parts of the NT fit the bill), but inventing the idea as a whole... I can't see how that would work out. Except maybe in the case of Islam, but even then it was just grabbing on to the coattails of Judaism and Christianity.

1Lumifer
So you can see. And the example is the second most popular religion in the world.

It's a safe assumption that any religion with ancient roots was not made up by someone for political purposes.

0Lumifer
I don't see why. Religions mutate and evolve.

Sure, but (without even mentioning how much it takes from mainstream Christianity) Mormonism is... 150 years old. How many Quakers do you see these days?

0Lumifer
What is the point that you are making? Religions get born, go through natural/social selection, some survive -- for some time, some do not. This is all uncontroversial, as far as I know. When you set up a new religion, you don't know how successful will it be, but the probability of it becoming very successful is not zero.

Would Snell's Law possibly explain it? Someone claimed to me that it makes light refract more with decreasing altitude.

0Lumifer
Don't you want to get a handle on basic physics first, before going natural-law-hopping across Wikipedia?

Ah, I already Googled but I got confused because the first guy who came up on the search seemed to be talking about something else.

But I used a different phrasing and got the answer. FWI, Google isn't always reliable for refuting crackpots and Wikipedia is very unreliable. If I assumed that the latter represented the state of human knowledge I'd be forced to concede that most of what Wild Heretic says is true.

0cousin_it
If you're not an expert on some topic, and it's not too politicized, then I think trusting Wikipedia and using it as a starting point is the best strategy available today.

Hmm, his argument that stars can never be seen anywhere at high altitudes (excepting the 'fraudulent' NASA photographs) doesn't yet have an unambiguous counterexample I could find. He doesn't deny that the stars must be higher than the atmosphere but think they only become visible near the ground.

But the articles on the solar equinox and the solstice are probably the best on the whole site. Or they just seem that way to me, because I don't know enough math to refute them.

0Stabilizer
Stars become invisible at high altitudes because the Earth becomes very bright compared to the stars. This happens because when you are higher up, you see more of the sunlight reflected by the Earth. This happens because at higher altitudes more of the Earth is visible to you. Thus, your eyes or your cameras cannot distinguish the relatively dim light of the stars. The sky still appears black because there is no atmosphere to make the light scatter and give you feeling of being light outside that you experience on the surface of the Earth. You can see the stars if you are on the night side, you have good cameras, and you set the focal point to the sky. I'll get to the equinox thing later.

The claim being made is that satellites should be exposed to temperatures nearly twice as hot as the melting point of iron.

2cousin_it
The claim is correct. The ISS is orbiting right in the middle of the thermosphere, and the temperature there is indeed higher than the melting point of iron. You're one Google search away from learning why the ISS doesn't melt. I know the answer, but it's important that you find it out yourself.

I don't understand why you think this is a refutation. What is giving energy to the molecules in the upper atmosphere, if not the sun? And if it is the sun, higher density matter like satellites would would experience extreme heat.

2Lumifer
Not extreme heat. Satellites do get heated by the sun, certainly, but not to 2500 C. They absorb energy coming from the sun, but they also radiate energy -- the stable/average temperature depends on the balance of incoming and outgoing. Satellites have to manage this balance and they do. One very common method is reflective shields. Think about it this way -- why doesn't the whole Earth overheat?

You're not giving the full quote, and even if he had said that, it wouldn't remotely meet any burden of proof for showing Christianity was probably created for political purposes. The behavior of the Roman authorities towards Christianity seems to offer more evidence against that, as well as the embarrassment for having their Messiah be crucified by a Roman governor.

Ugh... I'm talking about whoever created Islam or Christianity in the first place, and Lumifer's response didn't seem to acknowledge that. I am indeed aware that Islam predates the Ottoman dynasty.

Yes, that's precisely my point. Religious doctrines get sorted out over centuries so that the most viable survive. People who deliberately set out to create their own cult can't match this.

0Lumifer
They can get lucky. Example: Joseph Smith.

Thought it was worth posting, but even he doesn't think it's very convincing on its own.

0Lumifer
Given that you know the expression "Ottoman sultans", what do you think?
0NoSignalNoNoise
No. The Ottoman Empire started in 1299. Islam, and various very powerful caliphates, had existed for centuries before that.

This is not a good response. Surely you can admit this is coherent?

At about 85km altitude temperatures start to rise until they hit the Kármán line which is 100km high. After this line, the heat abruptly increases rising rapidly to 200km whereby it starts to level off (100km is the very start of the radiation belts as well which become full strength at 200km funnily enough), although other sources say it continually rises. Temperatures can vary, depending on sun activity, but can reach as high as… wait for it…

2500°C!

I kid you not.

In case you don

... (read more)
3Lumifer
First of all, reality is interconnected. If you are evaluating a hypothesis about reality (as opposed to an abstract puzzle), it should match everything you see. So, Hollow Earth. What are the implications? Clearly there is a vast conspiracy to conceal the truth. A massive, very expensive conspiracy -- someone has to generate all these photos made from space or from upper atmosphere, generate e.g. live video feeds from the International Space Station. There are no satellites, but GPS actually works, so there is some entirely unknown system which allows you to pinpoint your location anywhere on Earth. Gravity obviously works very differently from what the textbooks say. Etc. etc. If Hollow Earth is actually true, you should be much more concerned about things other than the shape of the planet. As to this specific example, it's misleading. Speaking at a very crude level, temperature is a measure of energy. The higher the temperature of something, the more energy that something has. If we are talking about gases (like the Earth's atmosphere), we can simplify it even more -- temperature is a measure of how fast do gas molecules move. However temperature (= speed) is a per-molecule thing. Let's take a cubic meter of space and put a single gas molecule in there. And let's make it move very fast -- as fast as it would take to correspond to 2500 degrees C. Will this molecule melt anything? Nope, it's energetic, but it's alone. The amount of energy it can transfer to something it hits is very very small. How much something gets heated in a, technically, 2500 C environment depends on the density of that environment. If the gas is very rarefied, meaning the number of molecules per cubic meter is small, you won't get much heat. If it's dense (lots of molecules), you get a lot of heat. That's why you can easily pass your hand through a flame (gas, low density), but you can't pass your hand through boiling water (liquid, high density) even though the temperature of the fla
1cousin_it
Yes, satellite cooling is a real technical problem. You're one Google search away from learning all about it.
0phonypapercut
No. Temperature is not heat.

Ah, I mean a religion that was created or originally propagated through patronization. Every religion has been patronized for political purposes at some point. Christianity is a pretty good example of a religion that was not useful to the authorities during its early years.

2James_Miller
Matthew 22:21 Jesus said "Render to Caesar the things that are Caesar's".
0Stabilizer
Sure. His arguments look pretty easy to refute using some basic physics and some Google searches. Let me know if you find any other argument of his that you find particularly compelling and I'll take a crack at it.

At risk of derailing the thread here, I'd say there are no examples you can bring of a politically created/patronized religion displacing native beliefs, assuming the mentality of the public didn't favor that religion. For instance, Anglicanism may have suited the British state well, but it wasn't arbitrarily forced onto a resistant Catholic population.

0James_Miller
From Wikipedia: "During the Saxon Wars, Charlemagne, King of the Franks, forcibly Roman Catholicized the Saxons from their native Germanic paganism by way of warfare, and law upon conquest. Examples are the Massacre of Verden in 782, when Charlemagne reportedly had 4,500 captive Saxons massacred upon rebelling against conversion, and the Capitulatio de partibus Saxoniae, a law imposed on conquered Saxons in 785 that prescribed death to those who refused to convert to Christianity."
2Lumifer
"Convert or die" was a very popular proposition for many centuries. Take, I don't know, former Yugoslavia. The Bosnians are mostly Muslim, the Serbs are Christian Orthodox, and the Croats are Roman Catholic. You think that's because they all had different mentalities?

Well, I don't know a whole lot about physics or the other subjects he talks about. It just seems very well-argued to me. Would you care to elaborate on what you think is incoherent?

I don't know a whole lot about physics or the other subjects he talks about. It just seems very well-argued to me.

These two facts are related.

2Lumifer
All of it. I recommend developing critical thinking skills.

Many are given in the words themselves, so I don't see why you're asking. The laser between posts?

Nearly every link provides falsifiable claims, although some are difficult to test.

2eternal_neophyte
Those are a lot of links to sift through though - can you give an example of just one? :)

How do I contact a mod or site administrator on Lesswrong?

0Elo
Pm me

Sorry for taking such a long time to respond.

the main question for any AI is its relations with other AIs in the universe. So it should learn somehow if any exist and if not, why. The best way to do it is to model AIs development on different planets. I think it include billion simulations of near-singularity civilizations.

Any successful FAI would create many more simulated observers, in my scenario. Since FAI is possible, it's much more likely that we are in a universe that generates it.

Many extinction scenarious will be checked in such simulations,

... (read more)
0turchin
After thinking more about the topic and while working on simulation map, I find the following idea: If in the infinite world exist infinitely many FAIs, each of them couldn't change the landcsape of simulation distibution, because his share in all simulations is infinitely small. So we need acasual trade between infinite number of FAIs to really change proportion of simulations. I can't say that it is impossible, but it maybe difficult.
0turchin
Ok, I agree with you that FAI will invest in preventing BBs problem by increasing measure of existence of all humans ( if he find it useful and will not find simpler method to do it) - but anyway such AI must dominate measure landscape, as it exist somewhere. In short, we are inside (one of) AI which tries to dominate inside the total number of observer. And most likely we are inside most effective of them (or subset of them as they are many). Most reasonable explanation for such desire to dominate total number of observers is Friendliness (as we understand it now). So, do we have any problems here? Yes - we don't know what is the measure of existence. We also can't predict landscape of all possible goals for AIs and so we could only hope that it is Friendly or that its friendliness is really good one.

It may just test different solutions of Fermi paradox on simulations, which it must do.

What? What does this mean?

Or you mean that friendly AI will try to give humans the biggest possible measure? But our world is not paradise.

No, it's trying to give measure to the humans that survived into the Singularity. Not all of them might simulate the entire lifespan, but some will. They will also simulate them postsingularity, although we will be actively aware of this. This is what I mean by 'protecting' our measure.

0turchin
the main question for any AI is its relations with other AIs in the universe. So it should learn somehow if any exist and if not, why. The best way to do it is to model AIs development on different planets. I think it include billion simulations of near-singularity civilizations. That is ones that are in the equivalent of the beginning of 21 century in their time scale. This explain why we found our selves in the beggining of 21 century - it is dominating class of simulations. But thee is nothing good in it. Many extinction scenarious will be checked in such simulations, and even if they pass, they will be switched off. But I dont understand why FAI should model only people living near singulaity. Only to counteract this evil simulations?

Sorry for the late response. I've been feeling a lot better and found it hard to discuss the subject again.

Ok, look. By definition BBs are random. Not only random are their experience but also their thoughts. So, half of them think that they are in chaotic environment, and 50 per cent thinks that they are not. So thought that I am in non-chaotic environment has zero information about am I BB or not. As BB exist only one moment of experience, it can't make long conjectures. It can't check its surrounding, then compare it (with what?), then calculate its m

... (read more)
0turchin
May be better to speak about them as one acts of experience, not moments. Ok, but why it should be friendly? It may just test different solutions of Fermi paradox on simulations, which it must do. It would result in humans of 20-21 century to be dominating class of observers in the universe, but each test will include global catastrophe. Or you mean that friendly AI will try to give humans the biggest possible measure? But our world is not paradise.

We have additional evidence for BB, that is idea of eternal fluctuation of vacuum after heat death, which may give us very strong prior. Basically if there is 10 power 100 BBs for each real mind it will override the evidence by non randomness of our environment.

How? The proportion of chaotic minds to orderly minds will never change. Even if there are infinite BBs in the future, it doesn't alter how likely it is that the 'heat death' model is simply mistaken, and that some infinite source of computing is found for us to use.

I agree that sapient beings

... (read more)
1turchin
Ok, look. By definition BBs are random. Not only random are their experience but also their thoughts. So, half of them think that they are in chaotic environment, and 50 per cent thinks that they are not. So thought that I am in non-chaotic environment has zero information about am I BB or not. As BB exist only one moment of experience, it can't make long conjectures. It can't check its surrounding, then compare it (with what?), then calculate its measure of randomness and thus your own probability of existence. Finally, what do you mean by "measure"? The fact that Im not a superintelligence is evidence against that superintelligence are dominating class of beings. But some may exist. No, my DA version only make it stronger. Doom is near.

Measure. His arguments do not account for it.

0TheAncientGeek
Measure can lead to just about any conclusion, depending on how you define it.
Load More