All of Ape in the coat's Comments + Replies

Good overall, but you are making a serious mistake: confusing single halfism, with double halfism.

SSA is a generalized single halfism reasoning. It's very obviously wrong in Sleeping Beauty as it implies that if the Beauty knows that she is awakened on Monday, she expects that there is 3/2 chance that the coin is Heads. Generally if you actually do the math, SSA can't produce correct betting odds for Sleeping Beauty problem. It's, in a sense, even worse than SIA for SB, but ultimately both of them are based on the flawed and unjustified framework of "centr... (read more)

So if a the territory is branching , the map.should, too.

Of course not. The territory can be made of rocks and dirt, but it doesn't mean that the map also has to be.

That's a disadvantage, because the same map can't represent any territory.

I'm not saying that it represents every territory.  I'm saying that it represents a more general class of territories without loosing any advantages of the framework of possible worlds.

 In the post I've even specifically outlined what are the territories that my framework can represent:

"So the territory that pro

... (read more)
2TAG
If that's what you actually think, the first line should read something like "under circumstances where probability is in the mind".

You keep missing the point. It's as if you haven't even read the post and simply noticed a couple of key words.

The map that corresponds to a deterministically branching multiversal has possible worlds.

Some do.

I'm proposing a better map, capable to talk about knowledge states and uncertainty, in any circumstances, having all the advantages of maps using the concept of possible worlds, without their weak point.

If you think that the framework of probability experiment that I'm outlining in the post fails to account for something that the frameworks of possibl... (read more)

2TAG
The point is that a map has to represent the territory. "And sure, every map is, in a sense, a map of the world", as you out it., So if a the territory is branching , the map.should, too. (A map may include aspects of human knowledge as well). That's a disadvantage, because the same map can't represent any territory. Threre may be an ontologically neutral way of doing probability calculations, but it's not a map, for that reason....more of a tool. The problem is the implied ontology. You haven't actually proven that probability is only in the mind and you can't prove it using methodology, because its a statement about the territory , not just about probability calculations. If there is a referent for it in the territory, it is entirely reasonable to say "possible worlds exist". Is it really a win to admit the substance of existing possible worlds, but under a different name?

If..it was pointed out a long time ago that (a form of) probability being in the mind doesn't imply (a firm of) it isn't in the territory as well.

 

That not true because fundamental determinism is true , or because effective determinism at the macroscopic level is true.

This is beside the point that I'm making. Which is: even if we grant that the universe is utterly deterministic and therefore probability is fully in the map, this map still has to correspond to the territory for which you have to go an look. And we still have to be able to construct a m... (read more)

2TAG
The map that corresponds to a deterministically branching multiversal has possible worlds. The map that corresponds to a Copenhagen universe has inherent indeterminism Refusing to.ever talk about possible worlds is dangerous, because they might exist (they do in MWI ) and they might be useful otherwise. What you really have is an argument that they are a poor match for logical uncertainty, which they are, but you are allowed to use different tools for different jobs. Having dogmatic , non-updatable assumptions is bad (see rationality, passsim) and it's still bad when they are in the direction of determinism, reductionism, etc.

I don't see problems here.

The problem is that according to the framework of "possible worlds" we technically need to be able to do a thing that we can't do.  The solution to this problem is to use a better framework - the one of probability experiments.

You should imagine a part of the world, not the whole world, including orbits of start in an other galaxy.

My point exactly. In actuality we simply approximate a particular process of our universe to the best of our knowledge, instead of imagining all the universal permutations and then filtering from them the ones logically consistent with our knowledge.

Disagree. For example, if you have a dice that is symmetric by form and by weight with 4 sides, you are sure that if you roll it 100 times you will have around 25 results for each side.

And this belief of mine is grounded in actual behavior of dice in our physical reality, which I would never be able to get without going and checking the way reality works. I don't think we actually have any disagreement here.

I don't see which direct experiment you can use to figure out whether we are in a simulation or not that isn't extremely dangerous (searching for bugs

... (read more)

"Stones" is not a good class with clearly defined boundaries (like humans or potatoes)

Nothing is. We are dealing with abstractions and approximations of reality, in probability theory especially. And yet some approximations are correct while others are not.

Reference class "all stones in the bag" use all information we have, so it's the best.

We've been through that already. We have all kind of information, but still truly take in account only some of it, while constructing our mathematical models.

In fact, reference class should be the space of possibilities

... (read more)
1Crazy philosopher
Disagree. For example, if you have a dice that is symmetric by form and by weight with 4 sides, you are sure that if you roll it 100 times you will have around 25 results for each side. I don't see which direct experiment you can use to figure out whether we are in a simulation or not that isn't extremely dangerous (searching for bugs in the simulation? Suicide?), so we should use other methods. I still don't see. Can you be even more direct?

You are perhaps interpreting his interactive dualism as substance dualism

You seem to be nitpicking definitions. Let's try to grasp the substance. Eliezer was initially distinguishing between two types of dualism:

  1. Where consciousness is causally ineffective
  2. Where consciousness has causal effects

His Zombie post were about the first one. This post is about the second one.

If you want to talk about some sub-type of the second that manages to evade the argument in this post - be my guest. 

The point of arguing for zombies is to argue for non physicalism. Zombi

... (read more)
2TAG
No side of the argument has a proof , in the maths sense. To show that physicalism isn't necessarily true, I only need to show there is some plausibility to the existence of intrinsic subjectivity. There is debate on the subject because everyone has prima facie evidence that they are some kind of self,they are self aware, they have their own unique perceptions, and so on. It wasn't invented out of nothing. What we care about us one thing, what we know another. We have no access to the ontologically physical except via our maps. I'm not saying dualism is necessarily true, I'm saying physicalism isn't necessarily true. The one is not a corollary of the other. What's the problem? If you argument is that substance dualism is disguised physicalism in the absence of a demarcation between the mental and physical, well there's your demarcation. Or are you sratating that "structural" and "functional" are meaningless terms? To something. Falsehoods contradict truths, truths contraduct falsehoods. That doesnt mean all falsehoods are self contradictions. You can learn logic.

There is no such thing as The One Truly Perfect Class. All of these are rough estimations; some are better than others. It's better to use "all stones in the multiverse" than to use nothing, but if you have a choice between all stones in the multiverse and all stones on Earth, use the latter as the reference class.

But why is one reference class more preferable than the other? What does determine it? How do we know that it's better to use "all the stones on Earth" than "all the stones in the multiverse"? And even better still to use "all the stones in this ... (read more)

1Crazy philosopher
"Stones" is not a good class with clearly defined boundaries (like humans or potatoes), but we know about the stone that it is from Earth, so we must use this information. Reference class "all stones in the bag" use all information we have, so it's the best. In fact, reference class should be the space of possibilities. Your second question leads to the same answer, isn't it? P. S.: can you just write your argument directly? It took too much time to ask questions, so it's inefficient.

Maybe you have to consider all the info you have, so you can't use all the stones in the multiverse as a reference class if you already know what's in the bag?

Consider the information you have:

  • There are stones in this particular bag
  • There are stones in many other bags
  • There may be other stones in this bag in the future
  • There are stones in your neighbourhood within R meters
  • There are stones in your country
  • There are stones on your continen
  • There are stones on the planet Earth
  • ...
  • There are stones all around the multiverse throughout time and space

And yet from all ... (read more)

1Crazy philosopher
There is no such thing as The One Truly Perfect Class. All of these are rough estimations; some are better than others. It's better to use "all stones in the multiverse" than to use nothing, but if you have a choice between all stones in the multiverse and all stones on Earth, use the latter as the reference class. Probabilities are in the mind, and you use a reference class because you can't calculate the trajectories of stones in the bag — and you have good reasons to believe there is an equal probability for each stone to be chosen (since they're all in the bag). It was a fun exercise, thanks. (I’m repeating it just to make sure you’ve understood my argument. If you have, ignore the next paragraph.) However, I still don't understand how this proves that we are not in a simulation: all I know is that my memory claims I live in the 21st century, but I think most people who believe they live in the 21st century are wrong. I can't see any priors that distinguish between the two universes, so I just use a priori probabilities.

Why I am not a randomly sampled person? 

≈all peoples who believe they live in 21st century actually don't. I believe that I live in 21nd century, so I don't live in the 21st century. It sounds like perfect logic.

In be honest, I don't understand your counterargument right now.

Okay, let's start from the beginning. What does it mean to be randomly sampled? How do we know that some things are randomly sampled from some set of things and why this set of things in particular?

Suppose you have a bag of stones. When you blindly pick a stone from this bag why a... (read more)

3Crazy philosopher
Maybe you have to consider all the info you have, so you can't use all the stones in the multiverse as a reference class if you already know what's in the bag? And the stones in this bag strongly influence the chance of picking one, unlike stones in a different bag.

I'm afraid you didn't make it clearer what you mean by "complexity" with your explanation. Could you taboo the word?

Are you using "comlex" and "emergent" simply as synonims to "having low entropy"? Or is there some more nuanced relations between them?

By "aligned with" I mean not merely related to but, "following the same pattern as"

Okay then putting it into the sentence in question we get:

a system more closely follows the pattern of a macroscopic phenomenon than its components.

I'm afraid this is also not particularly comprehensible. What you seem to be say... (read more)

1James Stephen Brown
Sorry about my lack of clarity: By "complex" I mean "intricately ordered" rather than the simple disorder generally expected of an entropic process. To taboo both this and alignment as "following the same pattern as": By a macroscopic phenomenon, I mean any (or all) of the following: 1. Another physical feature of the world which it fits to, like roads aligning with a map and its terrain (and obstacles). 2. Another instance of what appears to fulfil a similar purpose despite entirely different paths to get there or materials (like with convergence) 3. A conceptual feature of the world, like a purpose or function. So, we can more readily understand an emergent phenomenon in relation to some other macroscopic phenomenon than we can were we to merely inspect the cells in isolation. In other words, there is usefulness identifying the 20+ varieties of eyes as "eyes" (2) even though they are not the same at all, on a cellular level. It is also meaningful to understand that they perform a function or purpose (3), and that they fit the physical world (by reflecting it relatively accurately) (1).

Glad that you've enjoyed the post and thank you for your kind words.

In case you've also missed it, I'm currently working on a sequence about general probability theoretic reasoning to provide a clear framework which would not produce this kind of confusions in the first place.

2Said Achmiz
I’ll check out the sequence, thanks!

if peoples of future spend 0.01% of their time in simulation of the Earth of 21st century, most of peoples, who think they are living in 21st century are wrong.

Granted. 

Therefore, if you were a randomly sampled person from all people who has ever thought or will be thinking that they live in 21st century you should think that there is only a small chance that you indeed live in 21st century.

But, as you are not, in fact, a randomly sampled person, this whole reasoning is unsound.

It's like you have 2 bag of numbered pieces of paper, in the first one the

... (read more)
1Crazy philosopher
Why I am not a randomly sampled person?  ≈all peoples who believe they live in 21st century actually don't. I believe that I live in 21nd century, so I don't live in the 21st century. It sounds like perfect logic. In be honest, I don't understand your counterargument right now. I have simply forgot to mention this condition, but I did mean it.

...Or we could realize that we've been using an inappropriate mathematical model and then everything adds up back to normality.

1Crazy philosopher
I disagree with argument of your article in this context. I didn't wrote it explicitly, but if peoples of future spend 0.01% of their time in simulation of the Earth of 21st century, most of peoples, who think they are living in 21st century are wrong. It's like you have 2 bag of numbered pieces of paper, in the first one there are 1 million of them, and 1% of them have number 6. An other bag have 10 pieces of paper and they are numbered correctly. Each piece of paper have equal chance to be taken. You take one, and you see 6. From which bag did you take the paper?

I’d like to make the case that emergent complexity is where…

  • a whole system is more complex than the sum of its parts

Could you explain what exactly you mean by "complex" here? Surely you don't mean "how many lines of code is required to make a thing". But then what?

  • a system is more closely aligned with a macroscopic phenomenon than with its component parts.

I'm not sure I understand this either. What does "aligned" mean in this context?

I'm looking at your example:

So, when we look at an eye, we can see that it can be understood as something that fits the purp

... (read more)
1James Stephen Brown
Thanks for your well considered comment. So, here I'm just stating the requirement that the system adds complexity, and that it is not merely categorically different. So, heat, for instance could be seen is categorically different to the process that it "emerged" from, but it would not qualify as "emergent" it is clearly entropic, reducing complexity. Whereas an immune system is built on top of an organism's complexity, it is a more complex system because it includes all the complexity of the system it emerged from + its own complexity (or to use your code example, all the base code plus the new branch). The second part is more important to my particular way of understanding emergence. I think I could potentially make this clearer as it seems "alignment" comes with a lot of baggage, and has potentially been worn out in general (vague) usage, making its correct usage seem obscure and difficult to place. By "aligned with" I mean not merely related to but, "following the same pattern as", that pattern might be a function it plays or a physical or conceptual shape that is similar. So, the slime mold and the Tokyo rail system share a similar shape, they have converged on a similar outcome because they are aligned with a similar pattern (efficiency of transport given a particular map). I think we're in agreement here, my point is that the eye or testicle perform a (macroscopic) function, the cells they are made of are less important than the function—of the 20+ different varieties of eyes, none of them are made of the same cells, but it still makes sense to call them eyes, because they align with the function, eyes are essentially cell-agnostic, as long as they converge on a function. Again, thanks for the response, I'll try to think of some edits that help make these aspects clearer in the text.

Because it isn't (yet), at least for those lucky enough not to be drafted, or living in the border regions.

True. And I think it speaks a lot about how bad the 90s were if several years of drop in a labor force, neccessity to bribe people to join the army and harsh sanctions by all the developped world is a cake walk compared to them.

You raise some problems with the current system:

Who polices the police? Voters can be ignorant. Elections can be rigged. 

None of them seem to be particularly bad, we do have standard ways to deal with them, but sure enough let's see your proposed solution.

But suppose that tax payers were able to vote for their own tax rates, and voting power was proportionate to taxes paid? And suppose the vote took place via crypto, so that the results of the vote could neither be rigged nor ignored?

I don't see how this proposal helps us with police taking protection... (read more)

The fact that sleep initially evolved for temporal niches doesn't mean that no important machinery was connected to it later. Evolution is not a programmer, following single responsibility principle. It has a tendency to hook more and more functionality to the same module with time.

So, while safe sleep reduction may be possible, it's very much not clear whether it's the case just based on this evolutional argument. And it can be quite dangerous in the worst case. Research in this direction is interesting and promising, but it seems we should start with better understanding of sleep in general before trying to reduce it.

3harsimony
Yeah I think sleep probably serves other roles, I just don't see why those roles require 7 hours of sleep rather than say 5 hours. I do agree that basic research is what will actually get sleep need reduction therapies to work at scale. I'm hoping that citizen science and discussion of the topic will encourage more work on this.

This. Shock Therapy in Russia went so bad that it led to one of the worst quality of life drop in history, not related to war, and memetically innoculated whole generations from the ideas of free-market democracy, eventually leading to the current quasi-fashist state waging a war with a death toll in multiple hundreds of thousands.  And even now, during the afformentioned war, people still manage to claim that at least it's not as bad as the 90s.

In this sense, reasonable experts such as Joseph Stiglitz were completely vindicated.

3xpym
Because it isn't (yet), at least for those lucky enough not to be drafted, or living in the border regions. Sure, the 90s could've gone better, but I doubt that anything could've stopped the KGB from ending up in power. Yeltsin was far too clueless to prevent that.

You can treat is as a miracle, but don't pretend that observation selection effects explains it any better than divine intervention. Otherwise you may feel as if you actually became less confused about the problem just by using different terminology.

Good observations about Putin's "Gift". I would notice that reproducing this probably requires something similar to Russia's social political climate of poverty, fear, apathy and cynicism, with a strong memetic innoculation against overthrowing governments and most develloped countries do not share these properties. But, that said, getting there is much easier than may innitially seem and USA is currently speedrunning it.

It never stops fascinating me how otherwise reasonable people are ready to believe in literal magic just because we've renamed it. Sequences have called out this failure mode explicitly and yet here we.

If I say that psychic power of soul granted to us by God systematically protects our civilization from extinction, who would treat me seriously? Clearly this is just some New-Age quasi-religious nonsense.

But what if, instead, I say that anthropical effects of consciousness granted to us by metaphysics systematically protects our civilization from extinction?... (read more)

2avturchin
There is at least one anthropic miracle that we can constantly observe: life on Earth has not been destroyed in the last 4 billion years by asteroids, supervolcanoes, or runaway global warming or cooling, despite changes in Solar luminosity. According to one geologist, the atmospheric stability is the most surprising aspect of this.

That has been the default strategy for many years and it failed dramatically. 

All the "convinced influential people in tech", started making their own AI start-ups, while comming up with galaxy-brained rationalizations why everything will be okay with their idea in particular. We tried to be nice to them in order not to lose our influence with them. Turned out we didn't have any. While we carefully and respectfully showed the problems with their reasoning, they likewise respectfully nodded their heads and continued to burn the AI timelines. Who could'... (read more)

I will take blame for not making it clear that this is an introduction to a much larger body of thought

I'll have another essay in a few weeks - I will send it to you and I look forward to your criticism. 

This does provide the necessary context absolving the post from the main blow of my critique, for the time being. Looking forward for your next essay!

I would be glad if your future reasoning gave me some novel insight, and I'm giving you the benefit of the doubt about it and will do my best to approach it open-mindedly. But as of now, I'm afraid, your... (read more)

1rogersbacon
What is different about us then? What has gotten us into this "dreamtime"? Why aren't we still savages (animals) trapped in an endless war of all against all? Animals have to act in ruthless "rational" self-interest yet we do have a choice, we can embrace all of these delusions and thwart moloch (or at least play him to a stalemate, which is all we need to do really). For example, there exists an entire institution of non-breeding individuals with immense worldly power because of widespread belief in a story - the catholic church. Obviously I used a lot of Christian imagery in the essay (and will do so more explicitly in the next essay), but that's a key example here - a man was systematically eliminated and it spawned a movement which truly was based (at first...) on compassion and love (for your enemy). I'm not at all saying that Christianity was/is the One True Religion, but there is a blueprint - it is not true to say that the survivors become even more enslaved by Moloch as a result - the (early) history of Christianity (and many other spiritual traditions) show this to not be the case. Of course the catholic church is now just another servant of Moloch, but that doesn't invalidate the point - the game goes on, we must constantly devise new tricks to outwit Moloch as he does to enslave us. Are you familiar with David Deutsch's Beginning of Infinity? David Deutsch makes a distinction between predictions (extrapolations from current knowledge) and prophecies (claims about future knowledge and creativity, “that problem can’t be solved”). For example, “earth’s temperature is projected to increase by X degrees by 2060” is a prediction; “the earth’s temperature will increase by X degrees by 2060 and it will be catastrophic for humanity” is a prophecy because it presupposes that we won’t find a way to prevent the projected temperature increase or mitigate its negative consequences.  This null hypothesis is a prediction, not a prophecy. You can’t just crunch the numb

Metaphors and poetry are great when they highlight a valid intellectual point you are trying to make, allowing to engage with it on emotional level. Meditations on Moloch, that you cite, have quite a lot of that and are beloved.

It's even okay when metaphors and poetry obfuscate your point a little. Indeed, some people prefer their reading material to be less on the nose, and enjoy deciphering hidden meanings. There are both pros and cons and matters of taste here. But ultimately you won't be ostracised for that.

What is not okay, is when your post lacks sub... (read more)

2rogersbacon
I will take blame for not making it clear that this is an introduction to a much larger body of thought. If there is a vagueness and incompleteness to it, that's because it's one essay and not the full book. Here is a comment I made on the blog that more directly explains my thesis.  "Game theory and evolution give us pretty clear null hypothesis for the future and it ain't pretty - the strongest always survive, the mighty are always righty. Weakness and "delusion" (e.g. art, spirituality, love, mercy, compassion) get optimized out of existence as the number of competing agents asymptotes towards infinite; similarly, as technological power asymptotes towards infinity so does infinite corruption. That sucks. More than anything, it's just fucking boring - nothing surprising ever happens, the underdog never wins, the story always ends the same way. But this is just a null hypothesis - as they say, you don't play the games on paper. I want to live in a universe where surprising things happen and the aforementioned delusions still have a place. In some sense, I want to turn the world and its ways upside down - I want the weak and the deluded to win - but how? Not through rational intelligence or "work" because that is exactly how the null hypothesis becomes fulfilled. Reality is like a chinese finger trap, struggling only deepens your entrapment.  Workfulness/playfulness, adultiness/childliness - all of this is about realizing the ludic/dramatic dimension of reality (as opposed to giving in to the machinic dimension of reality in which might inexorably makes right). If this seems paradoxical/delusional - well, so is reality, that's the game of it all. This idea that reality is illusive/delusive and is something more like a trick or game is almost the default pre-modern view (Hindus, Greeks, Aztecs, etc.) - it is only us moderns believe who what you see is what you get (that reality is a problem to be solved).  There's a lot more to unpack and I will eventually take
Answer by Ape in the coat31

The optimal strategy seems to be Prudent Extorter:

  1. Extort agents vulnerable to extortion
  2. Cooperate with agents that are not vulnerable to extortions and will cooperate back.
  3. Defect against everyone else.

Such agents perform better than your Naive Extorter as they would be able to cooperate with each other and do not nuke a Defection Rock.

When Naive Extorter meets Prudent Extorter they die in a nuclear fire. 

You can in fact have an agent who prefers to be money pumped. And from their perspective there is no problem with that.

Money pumps isn't a universal argument that could persuade a rock to turn into a brain. It's just an appeal to our own human intuitions.

It really seemed that you are going somewhere with all this, and then it turned out that you are not. All these beautiful metaphors, complicated topics, all the reference to works of other authors - all for naught. Form without a substance. Question was raised and then a complete lack of answer was produced. 

That's quite dissapointing. And makes this post a poor story. 

hich For example, If I use self-sampling to estimate the number of seconds in the year, I will get a correct answer of around several tens of millions. But using word generator will never output a word longer than 100 letters. 

Using the month of your birth to estimate the number of seconds in the year also won't work well, unless you multiply it by number of seconds in a month.

Likewise here. You can estimate the number of months in a year by number of letters in the world and then multiply it by number of seconds in a months.

I didn't understand your i

... (read more)
2avturchin
I meant that if I know only the total number of the seconds which passed from the beginning of the year (around 15 million for today of this year) – and I want to predict the total number of seconds in each year. No information about months.  As most people are born randomly and we know it, we can use my date of birth as random. If we have any suspicions about non randomness, we have to take them into account.  

You chose word length generator as you know that typical length of words is 1-10. Thus not random.

This is not relevant to my point. After all you also know that typical month is 1-12

No, the point is that I specifically selected a number via an algorithm that has nothing to do with sampling months. And yet your test outputs positive result anyway. Therefore your test is unreliable.

I didn't rejected any results  – it works in any test I have imagined

That's exactly the problem. Essentially you are playing a 2,4,6 game, got no negative result yet and are ... (read more)

1avturchin
For example, If I use self-sampling to estimate the number of seconds in the year, I will get a correct answer of around several tens of millions. But using word generator will never output a word longer than 100 letters.  I didn't understand your idea here:

First of all, your experimental method can really benefit from a control group. Pick a setting where a thing is definitely not randomly sampled from a set. Perform your experiment and see what happens.

Consider. I generated a random word using this site https://randomwordgenerator.com/

This word turned out to be "mosaic". It has 6 letters. Let's test whether it's length is randomly sampled from the number of months in a year.

As 6*2=12, this actually works perfectly, even better than estimating the number of months in a year based on your birth month!

It also ... (read more)

5avturchin
Don't agree. You chose word length generator as you know that typical length of words is 1-10. Thus not random. I didn't rejected any results  – it works in any test I have imagined, and I also didn't include several experiments which have the same results, e.g the total number of the days in a year based on my birthday (got around 500) and total number of letters in english alphabet (got around 40).  Note that alphabet letter count is not cyclical as well as my distance to equator.  Do not understand this: If I were born 1 of January, I would get years duration 2 days which is very wrong. 

I personally didn't expect Trump to do any tarrifs at all

Just curious, how comes? Were you simply not paying attention to what he was saying? Or were you not believing in his promises?

2Rafael Harth
Trump says a lot of stuff that he doesn't do, the set of specific things that presidents don't do is larger than the set of things they do, and tariffs didn't even seem like they'd be super popular with his base if in fact they were implemented. So "~nothing is gonna happen wrt tariffs" seemed like the default outcome with not enough evidence to assume otherwise. I was also not paying a lot of attention to what he was saying. After the election ended, I made a conscious decision to tune out of politics to protect my mental health. So it was a low information take -- but I don't know if paying more attention would have changed my prediction. I still don't think I actually know why Trump is doing the tariffs, especially to such an extreme extent..

I think "mediocre" is a quite appropriate adjective when describing a thing that we had high hopes for, but now received evidence, according to which while the thing technically works, it performs worse than expected, and the most exciting use cases are not validated.

I indeed used a single example here, so the strength of the evidence is arguable, but I don't see why this case should be an outlier. I could've searched for more, like this one, that is particularly bad:

In any case, you can consider this post my public prediction that othe... (read more)

I think the problem here is that you do not quite understand the problem.

There is definetely some kind of misunderstanding that is going on, and I'd like to figure it out.

It's not that we "imagine that we've imagined the whole world, do not notice any contradictions and call it a day". 

How it's not the case? Citing you from here:

When you are conditioning on empirical fact, you are imaging set of logically consistent worlds where this empirical fact is true and ask yourself about frequency of other empirical facts inside this set.

How do you know which ... (read more)

In this post I've described a unified framework that allows to reason about any type of uncertainty be it logical or empirical. I would appreciate engagement from people who think that logical uncertainty is still unsolved.

Are you arguing that the distinction between objective and subjective are "very unhelpful," because the state of people's subjective beliefs are technically an objective fact of the world?

It's unhelpful due to a an implicit (and in our case somewhat explicit) assumption that "subjective" and "objective"  are in opposition to each other. That it's two different magisteriums and things are either one or the other.

why don't you argue that all similar categorizations are unhelpful, e.g. map vs. territory

Map and territory framework lacks this assumption. I... (read more)

1Knight Lee
To me, it looks like the blogger (Coel) is trying to say that morality is a fact about what we humans want, rather than a fact of the universe which can be deduced independently from what anyone wants. My opinion is Coel makes this clear when he explains, "Subjective does not mean unimportant." "Subjective does not mean arbitrary." "Subjective does not mean that anyone’s opinion is “just as good”." "Separate magisteriums" seems to refer to dualism, where people believe that their consciousness/mind exists outside the laws of physics, and cannot be explained by the laws of physics. But my opinion is Coel didn't imply that subjective facts are a "separate magisterium" in opposition to objective facts. He said that subjective morals are explained by objective facts: "Our feelings and attitudes are rooted in human nature, being a product of our evolutionary heritage, programmed by genes. None of that is arbitrary." But I'm often wrong about these things don't take me too seriously :/

This debate seems hampered by a lack of clarity on what “objective” and “subjective” moralities are.

Absolutely.

Coyne gave a sensible definition of “objective” morality as being the stance that something can be discerned to be “morally wrong” through reasoning about facts about the world, rather than by reference to human opinion.

That's a poor definition. It tries to oppose facts about the worlds to human opinions. While whether humans have particular opinions or not is also a matter of facts about the world.

The fault here lies on the terms itself. Such dyc... (read more)

-1TAG
You can claim that subjective attitudes are still part of reality ontologically , but the point is that they function differently epistemologically . Opinions and beliefs and for the and falsehoods are all made of atoms, but all function differently. There are potentially as many subjective attitudes as there are people, and they are variable across time as well. The arbitrariness and lack of coherence is what causes the problems. Objectivity is worth having in ethics, because a world in which prisoners have done something really wrong, and really deserve their punishment is a better than a world in which prisoners just have desires the majority don't like.
1Knight Lee
I'm not 100% sure I know what I'm talking about, but it feels like that's splitting hairs. Are you arguing that the distinction between objective and subjective are "very unhelpful," because the state of people's subjective beliefs are technically an objective fact of the world? In that case, why don't you argue that all similar categorizations are unhelpful, e.g. map vs. territory?

Yes, you are correct! Thanks for noticing it.

1Markvy
Did not expect you to respond THAT fast :)

Actually... I will say it: This feels like a fast rebranding of the Halting Problem, like without actually knowing what it implies.

Being able to rebrand an argument so that it could talk about a different problem in a valid way is exactly what is to understand it - not just repeat the same words in the same context that the teacher said but generalize it. We can go into the realm of second order logic and say that

For every property that at least one program has, a universal detector of this property has to itself have this property on at least some input.

M... (read more)

0milanrosko
I realized that with you formulating the Turing problem in this way helped me a great dead how to express the main idea. What I did Logic -> Modular Logic -> Modular Logic Thought Experiment -> Human Logic -> Lambda Form -> Language -> Turing Form -> Application -> Human This route is a one way street... But if you have it in logic, you can express it also as Logic ->  Propositional Logic  -> Natural Language -> Step by step propositions where you can say either yey or ney. If you are logical you must arrive at the conclusion. Thank you for this.
0milanrosko
1. I will say that your rational holds up in many ways, in some ways don't. I give you that you won the argument. You are right mostly.   2. "Well, I'm not making any claims about an average LessWronger here, but between the two of us, it's me who has written an explicit logical proof of a theorem and you who is shouting "Turing proof!", "Halting machine!" "Godel incompletness!" without going into the substance of them." Absolutely correct. You won this argument too. 3. Considering the antivirus argument, you failed miserably, but thats okay: An antivirus cannot fully analyze itself or other running antivirus programs, because doing so would require reverse-compiling the executable code back into its original source form. Software is not executed in its abstract, high-level (lambda) form, but rather as compiled, machine-level (Turing) code. Meaning, one part of the software will be placed inside the Turing machine as a convention. Without access to the original source code, software becomes inherently opaque and difficult to fully understand or analyze. Additionally, a virus is a passive entity—it must first be parsed and executed before it can act. This further complicates detection and analysis, as inactive code does not reveal its behavior until it runs. 4. This is where it gets interesting. "Maybe there is an actual gear-level model inside your mind how all this things together build up to your conclusion but you are not doing a good job at communicating it. You present metaphors, saying that thinking that we are conscious, while not actually being conscious is like being a merely halting machine, thinking that it's a universal halting machine. But it's not clear how this is applicable." You know what. You are totally right. So here is what I really say: If the brain is something like a computer... It has to be obey the rules of incompleteness. So "incompleteness" must be hidden somewhere in the setup. We have a map:

You basically left our other more formal conversation to engage in the critique of prose.

Not at all. I'm doing both. I specifically started the conversation in the post which is less... prose. But I suspect you may also be interested in engagement with the long post that you put so much effort to write. If it's not the case - nevermind and let's continue the discussion in the argument thread.

These are metaphors to lead the reader slowly to the idea...

If you require flawed metaphors, what does it say about the idea?

Now you might say I have a psychotic fit

Fr... (read more)

So, essentially, it's like trying to explain to a halting machine—which believes it is a universal halting machine—that it is not, in fact, a universal halting machine.

Don't tell me what it's like. Construct the actual argument, that is isomorphic to Turing proof.

Let me give you an example. Let's prove that no perfect antivirus is possible. 

Let a perfect antivirus A be a program that receives some program P and it's input X as arguments and returns 1 if P is malevolent on input X and 0 otherwise. And A itself is not malevolent on any input.

Suppose A e... (read more)

0milanrosko
Actually... I will say it: This feels like a fast rebranding of the Halting Problem, like without actually knowing what it implies. Why? Because, it’s unintuitive — almost so that it's false. How would a virus (B) know what the antivirus (A) predicts about B? That seems artificial. It can't quarry an antivirus software. No. Fuck that. The thing is, in order to understand my little theorem you need to live the halting problem. But seems people here are not versed in classical computer science only shouting "Bayeism! Bayeism!" which is proven to be effectively wrong by the sleeping beauty paradox (frequentist "thirder's" get more money in simulations.) btw I gave up on lesswrong completely. This feels more like where lesser nerds hang out after office. Sad, because the site has a certain beauty in it's tidiness and structure.  
1milanrosko
1. "Don't tell me what it's like." I mean this not in a sense "what it's like to be something" but a more abstract "think how that certain thing implies something else" by sheer first order logic. 2. Okay so this is you replaced halting machines with programs, and the halting oracle with a virus... and... X as an input?  ah no the virus is that what changes, it is the halting. Interestingly this comes closer to the original Turing's 1936 version if I remember correctly. Okay so... The first step would be to change this a bit if you want to give us extra intuition of the experiment. Because the G Zombie is a double Turing experiment. For that, we need to make it timeless, and more tangible. Often the Halting oracles is explained by throwing it and the virus chained together... like there are two halting oracles machines and a switch, interestingly this happens with the lambda term. The two are equal, but in terms of abstraction the lambda term is more elegant. Okay, now... it seems you understand it perfectly. Now we need to go a bit meta. Church-Turing-Thesis. This implies the following. Think of how you found something out with antivirus program. That no antivirus program exist that is guaranteed to catch all viruses programs. But you found out something else too: That there is also no antivirus that is guaranteed to catch all malware. AND there is no software to catch all cases... You continue this route... and land on "second order logic" There is no case of second order logic that catches all first-order-logic terms (virus). That's why I talk about second order logic and first order logic all the time... (now strictly speaking this is not precise, but almost. You can say first order is complete, second order is incomplete. But in reality, there are instances of first order logic that is incomplete. Formally first order is assumed to be complete) It is the antivirus and the virus. This is profound because it highlights a unique phenomenon: the more c

If you are familiar with it, just say “yes,” and we’ll proceed.

Yes.

-2milanrosko
Perfect. So, essentially, it's like trying to explain to a halting machine—which believes it is a universal halting machine—that it is not, in fact, a universal halting machine. From the perspective of a halting machine that mistakenly believes itself to be universal, the computation continues indefinitely. This isn’t exactly the original argument, but it’s very similar in its implications. However— My argument adds another layer of complexity: we are halting machines that believe we are universal halting machines. In other words, we cannotlogically prove that we are not universal halting machines if we assume that we are. That’s why I don't believe that I don’t have qualia. But from a rational, logical perspective, I must conclude that I don’t, according to the principles from first order logic. And this, I argue, is a profound idea. It explains why qualia feels real—even though qualia, strictly speaking, doesn’t exist within our physical universe. It's a fiction. But as I say this, I laugh—because I feel qualia, and I am not believing my own theory... Which, ironically, is exactly what Turing’s argument would predict.

In The Terminator, we often see the world through the machine’s perspective: a red-tinged overlay of cascading data, a synthetic gaze parsing its environment with cold precision. But this raises an unsettling question: Who—or what—actually experiences that view?

Is there an AI inside the AI, or is this merely a fallacy that invites us to project a mind where none exists?

Nothing is preventing us from designing a system consisting of a module generating a red-tinged video stream and image recognition software that looks at the stream and b... (read more)

0milanrosko
You basically left our other more formal conversation to engage in the critique of prose. *slow clap* These are metaphors to lead the reader slowly to the idea... This is not the Argument. The Argument is right there and you are not engaging with it. You need to understand the claim first in order to deconstruct it. Now you might say I have a psychotic fit, but earlier as we discussed Turing, you didn't seem to resonate with any of the ideas. If you are ready to engage with the ideas I am at your disposal.

 "This, if I'm not missing anything" Yes you This is called a Modus tollens. We are not concerned about the boolean of each of the statements.
 

1.
"if I'm not missing anything" it is likely you do let me explain. This is called a Modus Tollens. We are not concerned about Lisas logic as a boolean. We look each proposition its entirety. I advice you to read about Turings proof on the halting problem, because it is the same technique.

I struggle to parse this. In general the coherency of your reply is poor. Are you by chance using an LLM? 

I apprec... (read more)

1milanrosko
I'd like you thank you though for your engagement: This is valuable. You are doing are making it clear how to better frame the problem.
-2milanrosko
So. Let us step back a bit. I am on your side. You are critically thinking, and maybe my tone was condescending. I read your reply carefully, and make  proposals because I really believe we can achieve something. But be advised: This is a complicated issue. The problem at heart is, self-referential (second-order-logic). That is: Something might be true, exactly because we can't think of it as being true, because it is connected to our ability to think whether something is true or not. I know it sounds complicated, but it coherent. Now let's see... Okay, this is an easy one. The argument follows exactly the same syllogistic structure ("If this, then that") as Turing’s proof. On LLMs: Yes, I sometimes use LLMs for grammar checking—sometimes I don't. But know this: the argument I'm presenting is, formally, too complex for an LLM to generate on its own. However, an LLM can still be used—cautiously—as a tool for verification and questioning. Now, if you're not familiar with Turing’s 1936 proof, it's a fascinating twist in mathematics and logic. In it, Turing demonstrated that a Universal Turing Machine cannot decide all problems—that such a machine cannot be fully constructed. If you are unfamiliar with the proof, I strongly recommend looking it up. It is very interesting and is a prerequisite to understand EN.  I don’t believe EN can be fully understood without an intuitive grasp of how Turing employed ideas related to incompleteness. My argument is very similar in structure—so similar, in fact, that certain terms in my argument could be directly mapped to terms in Turing’s. Now, I’ll wait for your response. This isn't me being condescending. Rather, I’m realizing through these discussions that I often assume people are familiar with proof theory—when, in fact, there’s still groundwork to be laid. Otherwise... If you are familiar with it, just say “yes,” and we’ll proceed. For me, you already demonstrated that you are a critical thinker. You might be the s
1[comment deleted]

First of all, I think you are confusing incompleteness with having false beliefs.

A. Lisa is not a P-Zombie
B. Lisa asserts that she is a not P-Zombie
C. Lisa would be complete: Not Possible ✗

C doesn't follow. Lisa would need to be able to formally prove that she is not P-Zombie, not merely assert that she is not one, so that completeness was relevant at all. Even then it's not clear that Lisa would be complete - maybe there is some other statement that Lisa can't prove which, nonetheless, has to be true?

A. Lisa is a P-Zombie
B. Lisa asserts that she is a not

... (read more)
-9milanrosko

I think picking axioms is not necessary here and in any case inconsequential.

By picking your axioms you logically pinpoint what you are talking in the first place. Have you read Highly Advanced Epistemology 101 for Beginners? I'm noticing that our inferential distance is larger than it should be otherwise.

"Bachelors are unmarried" is true whether or not I regard it as some kind of axiom or not.

No, you are missing the point. I'm not saying that this phrase has to be axiom itself. I'm saying that you need to somehow axiomatically define your individual words... (read more)

2cubefox
I have read it a while ago, but he overstates the importance of axiom systems. E.g. he wrote: That's evidently not true. Mathematicians studied arithmetic for two thousand years before it was axiomatized by Dedekind and Peano. Likewise, mathematical statisticians have studied probability theory long before it was axiomatized by Kolmogorov in the 1930s. Advanced theorems preceded these axiomatizations. Mathematicians rarely use axiom systems in their work even if they are theoretically available. That's why it is hard to translate proofs into Lean code. Mathematicians just use well-known mathematical facts (that are considered obvious or already sufficiently established by others) as assumptions for their proofs. That's obviously not necessary. We neither do nor need to "somehow axiomatically define" our individual words for "Bachelors are unmarried" to be true. What would these axioms even be? Clearly the sentence has meaning and is true without any axiomatization.

Yes, the meaning of a statement depends causally on empirical facts. But this doesn't imply that the truth value of "Bachelors are unmarried" depends less than completely on its meaning.

I think we are in agreement here.

My point is that if your picking of particular axioms is entangled with reality, then you are already using a map to describe some territory. And then you can just as well describe this territory more accurately.

I think the instrumental justification (like Dutch book arguments) for laws of epistemic rationality (like logic and probability) i

... (read more)
2cubefox
I think picking axioms is not necessary here and in any case inconsequential. "Bachelors are unmarried" is true whether or not I regard it as some kind of axiom or not. I seems the same holds for tautologies and probabilistic laws. Moreover, I think neither of them is really "entangled" with reality, in the sense that they are compatible with any possible reality. They merely describe what's possible in the first place. That bachelors can't be married is not a fact about reality but a fact about the concept of a bachelor and the concept of marriage. Suppose you are not instrumentally exploitable "in principle", whatever that means. Then it arguably would still be epistemically irrational to believe that "Linda is a feminist and a bank teller" is more likely than "Linda is a bank teller". Moreover, it is theoretically possible that there are cases where it is instrumentally rational to be epistemically irrational. Maybe someone rewards people with (epistemically) irrational beliefs. Maybe theism has favorable psychological consequences. Maybe Pascal's Wager is instrumentally rational. So epistemic irrationality can't in general be explained with instrumental irrationality as the latter may not even be present. I don't think we have to appeal to reality. Suppose the concept of bachelorhood and marriage had never emerged. Or suppose humans had never come up with logic and probability theory, and not even with language at all. Or humans had never existed in the first place. Then it would still be true that all bachelors are necessarily unmarried, and that tautologies are true. Moreover, it's clear that long before the actual emergence of humanity and arithmetic, two dinosaurs plus three dinosaurs already were five dinosaurs. Or suppose the causal history had only been a little bit different, such that "blue" means "green" and "green" means "blue". Would it then be the case that grass is blue and the sky is green? Of course not. It would only mean that we say "grass is

Ok, let me see if I'm understanding this correctly: if the experiment is checking the X-th digit specifically, you know that it must be a specific digit, but you don't know which, so you can't make a coherent model. So you generalize up to checking an arbitrary digit, where you know that the results are distributed evenly among {0...9}, so you can use this as your model.

Basically yes. Strictly speaking it's not just any arbitrary digit, but any digit your knowledge about values of which works the same way as about value of X. 

For any digit you can exe... (read more)

3jwfiredragon
Oops, that's my bad for not double-checking the definitions before I wrote that comment. I think the distinction I was getting at was more like known unknowns vs unknown unknowns, which isn't relevant in platonic-ideal probability experiments like the ones we're discussing here, but is useful in real-world situations where you can look for more information to improve your model. Now that I'm cleared up on the definitions, I do agree that there doesn't really seem to be a difference between physical and logical uncertainty.

Is there a formal way you'd define this? My first attempt is something like "information that, if it were different, would change my answer"

I'd say that the rule is: "To construct probability experiment use the minimum generalization that still allows you to model your uncertainty".

In the case with 1,253,725,569th digit of pi, if I try to construct a probability experiment consisting only of checking this paticular digit, I fail to model my uncertainty, as I don't know yet what is the value of this digit.

So instead I use a more general probability experime... (read more)

1jwfiredragon
Ok, let me see if I'm understanding this correctly: if the experiment is checking the X-th digit specifically, you know that it must be a specific digit, but you don't know which, so you can't make a coherent model. So you generalize up to checking an arbitrary digit, where you know that the results are distributed evenly among {0...9}, so you can use this as your model. The first part about not having a coherent model sounds a lot like the frequentist idea that you can't generate a coherent probability for a coin of unknown bias - you know that it's not 1/2 but you can't decide on any specific value.  This seems equivalent to my definition of "information that would change your answer if it was different", so it looks like we converged on similar ideas? I'd argue that it's physical uncertainty before the coin is flipped, but logical certainty after. After the flip, the coin's state is unknown the same way the X-th digit of pi is unknown - the answer exists and all you need to do is look for it.
Load More