All of Arturo Macias's Comments + Replies

Fantastic! Finally my paper about "Feedom under Naturalistic Dualism" was accepted in Journal of Neurophilosophy and I wrote this post at EA Forum that you can find interesting. I hope it will be included in the training set too:

https://forum.effectivealtruism.org/posts/5zbmEPdB2wqhyFWdW/naturalistic-dualism

In any case, I will remove the careless "always".

2Jiro
Are you going to remove everything from the rest of the argument which depends on the "always"?  Which seems to be all of it.

https://www.nature.com/articles/nature.2016.19681

 "By delving into ethnographic records, the researchers tried to tease out the relationship between human sacrifice and social hierarchy. They find that the prevalence of sacrifice increased with the degree of social stratification: it occurred in 25% of cultures with little or no stratification, 37% of those with moderately stratified societies, and 67% of those that had a pronounced hierarchy."

Human sacrifice is essential for the construction of large agrarian societies. Now, what percent of the 33% o... (read more)

2Jiro
This is like saying "I think that Rhode Islanders are all murderers.  What percentage of the people that do not murder are from Rhode Island?"  This is illogical; the reasoning is backwards. Do you think that Japan is a hierarchial society?  Do you think that Japan performs human sacrifice?
1Arturo Macias
In any case, I will remove the careless "always".

"I'm sure we could find some sun worshippers or nature worshippers who don't sacrifice any humans"

I am sure of the logic of sacrifice in all cultures: it is how you commit to the belief. In paganism, the world is full of spirits, while Judaism cleaned the world of spirits (not totally, evil ones were still supposed to exist) and forbid any cult to them: it was an early and radical disenchanting ideology.

Of course, nothing is free: monotheism moved sacrifice from the religious to the political realm: from the altar to the battlefield. I prefer the ocassiona... (read more)

2Jiro
You are trying to argue with the real world. I know that idolatry doesn't lead to human sacrifice, because there are actual idolators who don't sacrifice humans. You are just saying "yes it does". No it doesn't. It's not hard to check the real world and see if your pronouncements match reality. They do not.

I miss something about evolutionary game theory, where some of the discrepancies can be rationalized. 

I wrote this tour from game theory to cultural evolution:

https://www.lesswrong.com/posts/xajeTjMtkGGEAwfbw/the-evolution-towards-the-blank-slate

Agree on this criticism for the difference between humans and pigs, but there too many orders of magnitude of difference between shrimp and human to consider detailed measures of computing power very necesary.

Quantifying empathy is intrinsically hard, because everything begins by postulating (not observing) consciousness in a group of beings, and that is only well grounded for humans. So, at the end, even if you are totally successful in developing a theory of human sentience, for other beings you are extrapolating. Anything beyond solipsism is a leap of faith (unlike you find St. Anselm ontological proof credible). 

Illusionism is not a competitor, because consciousness is obviously an illusion. That is immediate since Descartes. That is why you cannot distinguish between "the true reality" and "matrix": both produce a legitimate stream of illusory experience ("you"). 

Epiphenomenalism is physicalist in the sense that it respects the autonomy and closeness of the physical world. Given that we are not p-zombis (because there is an "illusory" but immediate difference between real humans and p-zombies), that difference is precisely what we call “consciousness”.  ... (read more)

Thank you very much for the reference, because I am searching for co-authors for further develpments on SV-PAYW.

Also posted in EA Forum:  https://forum.effectivealtruism.org/posts/uW77FSphM6yiMZTGg/why-not-parliamentarianism-book-by-tiago-ribeiro-dos-santos

That is the whole point of ethical systems, isn't it? To derive all (etical) values from a few postulates. Of course, most of valuations are not ethical (they are preferences or tastes), but this is an excellent agument for rational (systematic) Ethics.

Well, “one feel you can have done otherwise” is the part of the qualia of free will my definition do not legitimize.

When you chose among several options, the options are real (other person could have done otherwise) but once it is “you” who choses, mechanism imply “all degrees of freedom have been used”.

I say: "you are free when you do as you want, not matter how determined are your desires". This is how I define freedom in "Freedom under naturalistic dualism"(and I think that this position is original, so if this is not the case, I would be glad of being corrected).

0TAG
That's just ordinary compatibilism -- as I said, "it’s not libertarian free will." All the work is being done by using a definition of free will that doesn't require indeterministic "elbow room", so none of it is being done by all the physics and metaphysics. If it is valid, it would be just as valid under naturalistic monism, supernaturalistic determinism, etc. And compatibilism isn't universally accepted as the solution to free will because the quale of freedom is libertarian -- one feels that one could have done otherwise. (At least , mine is like that). An additional non physical layer of consciousness might buy you qualia, but delivers no guarantee that they will be accurate... a quale of libertarian free will is necessarily illusory under determinism. An additional non physical layer of consciousness might have bought you downwards causation and libertarian free will.

You cannot know more than  Laplace's demon, and the demon cannot assess consciousness. It is analyzed in detail in "Freedom under Naturalistic dualism".

Still is something that a conscient being superimpose over reality. It is not “there”. This as true for our moral as our mathematical constructions.

https://www.amazon.com/Morality-Mathematics-Justin-Clarke-Doane/dp/0198823665

This is also my intuition: the intensity of experience depends on the integrated information flow or the system and the nature of the experience depends on the software details.

Then iPhones have far more limited maximum intensity experience than ants, and ants maximum experience intensity is only a fraction of that of a mouse.

I mostly agree in the fact that while conscience intensity is the ontological basis of moral weights, there are other relevant layers. On the hand conscience looks to be some function of integrated information and computation in a network.

IIT for example suggests some entropic combinatorial measure, that very likely would explode.

In any case we are trapped in our own existence, so inter subjective comparison is both necessary and mostly depending on intuition.

What about an IPhone? It looks similar to a ant in terms of complexity; Less annoying too…

1Ann
Suppose my intuition is that the 'conscious experience' of 'an iPhone' varies based on what software is running on it. If it could run a thorough emulation of an ant and have its sensory inputs channeled to that emulation, it would be more likely to have conscious experience in a meaningful-to-me way than if nobody bothered (presuming ants do implement at least a trivial conscious experience). (I guess that there's not necessarily something that it's like to be an iPhone, by default, but the hardware complexity could theoretically support an iAnt, which there is it is something that it's like to be?)

Because in the limit your intuition is that the experience of an electron is inexistent. The smaller the brain, the closer to inanimate matter.

1Ann
But that's in the limit. A function of electron = 0, ant = 1, cockroach = 4, mouse = 300 fits it just as well as electron = 0, ant = 1, cockroach = 2, mouse = 2^75, as does electron = 0, ant = 100, cockroach = 150, mouse = 200.

Dear Jameson, as you say the theme is extremely important, but I miss more about Storable Votes: one period Arrovian results deeply change in dynamic voting scenarios. I have recently written two articles about this: one has been published in Journal of Economic Interaction and Coordination, the other is still a pre-print:

https://www.lesswrong.com/posts/5wqFoHBBgpdHeCLS6/storable-votes-with-a-pay-as-you-win-mechanism-a

I also suggest you to read the Casella and Mace review about “vote trading” (there a is Journal version, here you have the pre-print):

https:... (read more)

What I claim, is that with enough agenda setting manipulation you can nullify the properties of any voting system. 

In my opinion, SV-PAYW is the best "voting system" available, but the mechanism has been analyzed under explicit hypoteses on the randomness of issues to be voted. The stream of political issues (represented by the valuation of the participants of an electoral victory) is supposed to be stochastic i.i.d. 

If "deporting rationalists" is possible, and rationalists are not more than half of people, I don't see what security can they rece... (read more)

2Jiro
If deporting rationalists is possible and rationalists are more than half of people, there's still no security they can receive, by your reasoning. After all, you're postulating that it would be possible to deport rationalists before taking a vote on whether to do so. Before the vote, the fact that they're more than half doesn't matter.

Well, if rationalists are a minority, with no external limits on the agenda, they can be deported anyway.

I only have considered a case with external agenda setting (issues with variable relevance exogenously arrive), as is typical to turn voting into a mathematical problem.

The second paper is about the context of voting systems. What I argue there is that the structure of the voting space is more important than the voting system.

What shall people vote? They shall vote among feasible states of the world.

2Jiro
If voting to do X doesn't matter because X could be done anyway without a vote, why wouldn't that apply to other things than just deporting rationalists? The logical endpoint of this is that votes will be useless, because anything that is voted for could be done anyway without a vote. And if some things can't be done without a vote, exactly what are they, and why can't "something that would really harm rationalists" be one of them?
1M. Y. Zuo
Like the parent said "Deport all Rationalists" or even “Deport everyone named Arturo Macias” are entirely feasible to accomplish with available resources… It seems like the more important issue is who gets to decide what to vote on and what is presented for voting? e.g. if the limit is say 1 vote per day, allowing for sufficient time for reflection and study of the issue at hand assuming perfect allocation of time, there’s still way more then 365 possible things a year to vote on.

This is the QV and I find it wrong. With money, at the end pivotal votes are only those of the largest money owners. Who can give money for collective choices? Those that can recover it, because their wealth is so large than individual consequences of collective decision is individually profitable. Keeping the political system separated from general purpose currency is critical (the Casella and Mace review agrees). The system as described in the paper is totally parallel to currency, while it works like it in the sense that you only pay votes when you get ... (read more)

People spend more votes on what they value more. In the original Casella system, every vote you cast, you lose it; my contribution was that you are only charged the votes casted in the winning alternative.

Absolutely incredible nobody suggested this before.

I still recommend you to read (and comment) the second pre- print.

Thank you to everybody for commenting!!

This is the whole point of the mechanism. To allocate victories to those who value them more. In the model there is a stochastic flow of issues with stochastic importance for both players.

The idea is that this system allocates victories to those who value them more.

1Arturo Macias
People spend more votes on what they value more. In the original Casella system, every vote you cast, you lose it; my contribution was that you are only charged the votes casted in the winning alternative. Absolutely incredible nobody suggested this before. I still recommend you to read (and comment) the second pre- print. Thank you to everybody for commenting!!

How durable is money? In this version there is a fixed amount of votes circulating among voters, and votes can be stored indefinitely.

Of course, if this model were successful, versions with “storage costs” could be considered. Let 1000 flowers blossom!

2Dagon
That answer just raises more questions.  How do new voters get votes, and what happens to deceased or newly-ineligible voter's "stored votes"?  Are votes transferable (or sellable)? Money is very rather different from votes; there's zero expectation of "fair distribution" or "equal weight".  That's why we have different things for different purposes.   You COULD just do away with voting and use currency auctions.  I think a lot of people would object.

I am no longer a gifted analyst, but I seriously doubt this. Differential games are well known, with their marvelous fixed point theorems and all the stuff.

In fact, if votes are not divisible you have to lot them, , as you can see in the (clumsy but tractable) discrete version I have analyzed in the paper.

SV PAYW is mainly designed for people to signal both intensity and direction of preferences. My opinion is that it is close to optimal to create conditions for truth telling of preferences.

In the situation considered in the paper there are only two players, so they know how many votes have themselves and the other player and the previous sequence of votes. The “incomplete information” situation means that the true value of wining in a given round is public.

While the voting system is very general, the situation considered is very simple, so recursive Nash e... (read more)

"So it's compatibilist free will, and having a quale of libertarian free will doesn't change that"

Well, in fact the whole point was to legitimize the quale of libertarian free will (as a Hamiltonian, not as a unicorn), so I think at this point all our differences are reconciled :-)

2TAG
But you are not legitimising it as a subjective impression that correctly represents reality... only as an illusion: you can feel free in a deterministic world, but you can't be free in one.

"You have been assuming determinism, and if determinism is true you are not free to move your finger or not as you choose"

I freely chose to move my finger, but my (free) choice is pre-ordained. I can do as a I please (in the set of my "degrees of physical freedom"), so I am free within those bounds; on the other hand, what I want is pre-ordained.

2TAG
So it's not free from determinism. So it's not libertarian free will. You can do only one thing in any particular situation, the thing that is predetermined. So it's compatibilist free will, and having a quale of libertarian free will doesn't change that.

"You have argued that some things that seem real are real because they seem real. The problem is that because the (degrees of) freedom don't really exist"

 There are things I can do (because they are under my conscient control, like move my finger) and others that I cannot do (like altering Earth orbit). I am "free" to move or nor a finger, and I am not "free" to alter Earth orbit. Is there anything irrational in this? Anything illusory?

Of course, the way I use my freedom is determined. "Brain" has degrees of freedom, they are real (Laplace demon can c... (read more)

1TAG
You have been assuming determinism, and if determinism is true you are not free to move your finger or not as you choose. Determinism means that the movement of your finger was pre ordained before you were born. So determinism seems to mean that you can never do anything except the one thing you do. That's the deterministic argument against libertarian free will. But it's pretty counterintuitive that both "cannots" are the same. Compatibilists like Dennett argue that you can move your finger or not in the sense that a very similar version of you, it the same you under slightly different circumstances, would move his finger...but no such slightly different or nearby version of you can change the Earths Orbit. That leaves everything unchanged ... You still lack libertarian free will, you still have compatibilist free will, and having consciousness or qualia still doesn't make a difference. Surely Laplace’s demon wins?

Now two smaller points:

"It's obvious to you that "all physical facts" doesn't include consciousness"

If Laplace demon needs conscience attribution to compute future positions and velocities, I rest my case. That could be possible, if "quantum collapse" is both ontologically real and triggered by a conscient observer. This is obviously over my payroll...

But what about ontologically? Surely that is the gold standard.

Regarding this, I have not better arguments than Bishop Berkeley, who turned the Cartesian epistemological subjectivism into ontological subjectivism.  That is the real birth of anglo-continental divide, while perhaps Occam laid grounds to the tradition in the Middle Age. 

That's the standard argument for compatibilist free will. Compatibilist free will only needs preferences and the ability to act on them. Adding a dualistic layer to physical reality doesn't give you any more compatibilist free will, and it doesn't get you libertarian free will, as you admit. So what is doing?

 

Let’s work over the case of a deterministic physicalist universe, to simplify. You can divide reality in two disjoint arbitrary sets covering the whole universe, called “Brain” and “Rest”. Laplace demon has all information about “Rest” while no i... (read more)

2TAG
From L's D's point of view , everything that your brain does is predictable given Brain+Rest, and in fact, everything your brain does is predictable from the global state of the universe before it existed. So Brain has no degree of freedom. If you consider Brain separately from everything else, then you introduce Knightian Uncertainty: it appears to have degrees of of freedom, because you have neglected a bunch of causal factors. The freedom only seems to exist because of absence of complete information. But it can't, really, because it's mutually causally dependent on everything else. You could make the same argument about anything that isn't a brain+rest. You have argued that some things that seem real are real because they seem real. The problem is that because the (degrees of) freedom don't really exist, the feeling of freedom doesn't imply actual freedom, so the feeling of freedom is one of the illusory feelings. It has the property thats lacking from compatibilist free will (but not libertarian free will) the ability to have happened otherwise, but doesn't have the purposiveness. You're not rescuing compatibilist or feeling-based free will. Oh, dear!
1Arturo Macias
Now two smaller points: "It's obvious to you that "all physical facts" doesn't include consciousness" If Laplace demon needs conscience attribution to compute future positions and velocities, I rest my case. That could be possible, if "quantum collapse" is both ontologically real and triggered by a conscient observer. This is obviously over my payroll... But what about ontologically? Surely that is the gold standard. Regarding this, I have not better arguments than Bishop Berkeley, who turned the Cartesian epistemological subjectivism into ontological subjectivism.  That is the real birth of anglo-continental divide, while perhaps Occam laid grounds to the tradition in the Middle Age. 

We belive this, because Laplace demon has an explanation of all material facts (that is physicalism, isn't it?). What else can you "know", what else can you explain?

The most you can do is to trust is the "neural correlates of conscience" research agenda, but it depends on having a Rosetta stone (=credible accounts of subjective experience), and beyond other humans, we have nothing (while perhaps IA translation of some cetacea will be available, increasing a little bit the "interpretability circle").

But we will never know "What Is It Like to Be a Bat?"

“ What if there was an entity that could consider possible futures conditional on its actions and choose one of them - suiting its goals the best, - and yet this entity completely lacked conscious experience? What properties of free will would such entity lack? Or do you believe that such entity is impossible in our universe (or even in any universe?) thus leaving the possibility for the falsification of your theory?”

I don’t think I am making a “theory”, but more an “interpretation”.

My position is that freedom is a property related to conscious experience,... (read more)

“Mental things are part of a map. Initially when you see a map you are more certain of its existence than the territory that this map describes. And yet the map itself can still be just a part of territory”

Well, this quite metaphorical for a hard materialist … :-) 

Additionally, I cannot compare “map” and territory, because I (subject) can only deal with different maps (I cannot access reality, wherever it means, directly), at most different internal representations of something I believe is “out there”.

“Now you say that we can, if this something consi... (read more)

1Ape in the coat
Were you under a misconception that materialists can't use metaphors because they are not "sciency" enough?) True, the initial model is imperfect. But it's a start. You can improve on it when you understand the initial framework. A model where you are writing your own map based on the other maps or even where you are locked in the infinite recursion of maps referencing other maps, without being able to access the territory in any other way than through a map. And still despite that, the maps can be made from the trees that grow on the territory.  I think I understand your reasoning very well. And it seems obvious to me that if I managed to show you a counter example that I'm talking about, an entity about which I can be quite certain that it can "consider", "choose" and "have goals" despite all the reasons that you brought up, you would have to accept that you made a mistake somewhere. But I want you to explicitly acknowledge this. Sorry for the annoyance, I promise that I'm not doing it just for my own amusement, that I expect it to be more helpful for your this way. So, please, say: "Yes, if you show me such an example it will falsify my theory".

Ape in the coat

“Are you using a different definition of "fundamental"? What I mean by it is an element that is not produced by any other elements”

 

Epistemologically, your subjective experience is more fundamental than physical reality. The entire world could be a simulation, and then Physics would be false; on the other hand, subjective experience and Mathematics is true in absolute and aprioristic grounds. Color red, an orgasm, and natural numbers and the Fermat theorem are true, even if you are trapped in Matrix, under the power of a “malign genius”... (read more)

2TAG
That isn't helpful, because there is no agreement about how real numbers are. I'm an anti realist myself. What you are not doing is arguing against the counter-claims ...that there is a much more robust sense of "real" than "seems real to me", that "seemingly real" is more "seeming" than "real". But what about ontologically? Surely that is the gold standard. That doesn't make a choice free of anything at all. At best, it's an illusion of indeterminism. That's the standard argument for compatibilist free will. Compatibilist free will only needs preferences and the ability to act on them. Adding a dualistic layer to physical reality doesn't give you any more compatibilist free will, and it doesn't get you libertarian free will, as you admit. So what is doing? So being able to do what you want isn't the basis of freedom? There are reasons for being concerned with libertarian free will other than moral responsibility. It's obvious to you that "all physical facts" doesn't include consciousness, it's obvious to Ape that it does. It's pretty circular either way.
1Ape in the coat
I understand the subjective idealist perspective very well as I used to be one myself. I'd recommend you to understand my usage of the word "fundamental" because currently when, you just interchangably use it with "real" you are missing the point I'm trying to make.  Again, try reasoning in terms of map and territory, I suspect it can be enlightning for you as it was for me. Mental things are part of a map. Initially when you see a map you are more certain of its existence than the territory that this map describes. And yet the map itself can still be just a part of territory. Drawn on the wall of a building or on a piece of paper that was produced on a factory that is shown on this exact map.  To explain something is to show how it reduces to something you already understand, making mysterious things not mysterious anymore. We have good understanding how to make one. We still lack in understanding how exactly it works. Interpretability research are ongoing and we are slowly learning more and more about it, filling the blancks in our understanding. I'm not sure why you call an opaque box "the most complete set of plans and physical relations you can dream of" - it's clearly not the case. It's not that you had the pleasure to experience the most perfect physicalist-reductionist explanation. So how can you know that you are not giving up too early? Epiphenomenalism doesn't try to solve the mystery so it won't be able to do it. Had we just assumed a priori that we would never learn anything more about GPT we wouldn't be doing all the interpretability research and as a result it would be a self fulfilling prophecy leaving us less knowledgeble then we are now. I notice a contradiction here. Previously you've said that we can't know whether somthing other than us is conscious. Now you say that we can, if this something considers, chooses and has goals. Or are you claiming that we can't possibly know whether something possess such abilities via materialistic science?

I answer all comments together (with low karma you can only make one comment by hour):

"Consciousness doesn't need to be fundamentally distinct from non-consciousness. Rocks can't monitor their own states at all, but computers can, that doesn't mean that a fundamentally new property was added when you turn a rock into a computer. ". "Consciousness not being fundamental doesn't equal consciousness not existing."

Conscience is "fundamental" in the sense that the philosopher itself is the conscious subject. In fact, the entire physical reality could be unreal, ... (read more)

2TAG
"Fundamental" dosnt have to have a single meaning. From our point of view, we are individually fundamental, from someone else's we are some Joe Schmo who need not have existed. Consider, if you will, dual aspect neutral monism, which is similar, but without the epiphenomenonalism. Doesnt that amount to saying that free will isn't really real,but seems real?
1Ape in the coat
What exactly do you mean by this? Try explaining it without using the words "real", "actual" or "objective", instead think about the issue in terms of "map" and "territory". Are you using a different definition of "fundamental"? What I mean by it is an element that is not produced by any other elements. And in this scenario consciousness isn't fundamental - it's a result of physical process that is manipulating the brain in the vat. It's the dualism of the gaps. The last attempt to redefine idealism and smuggle it inside our worldview. And it still allows to pull the confusion under the rug. Instead of trying to understand the mystery of how consciousness is produced by matter interactions it just postulates that it's a separate entity. There are other possibilities for materialistic worldview. One can say that counsciousness is not fundamental but still real. That it's produced from material interactions in the brain not unlike how computer runs programms. Trees, houses, planes, people - neither of them are fundamental as well as they are made from smaller elements but they are still still pretty real. So I figured. And that's why I invite you to think about it from a bit different angle where only one of the assumption holds. I expect that it can give you a new insight. What if there was an entity that could consider possible futures conditional on its actions and choose one of them - suiting its goals the best, - and yet this entity completely lacked conscious experience? What properties of free will would such entity lack? Or do you believe that such entity is impossible in our universe (or even in any universe?) thus leaving the possibility for the falsification of your theory?

"But conscious states are strongly determined by brain states as far as we can check"

You can only "check" your own mental states, so that is not very far. 

"Consciousness doesn't need to be fundamentally distinct from non-consciousness"

I cannot argue against eliminativism, because perhaps you are nos conscious. Still, I would not eat you because of cultural taboos and legal complications...but no longer for moral reasons! :-)

As commented in the article, this philosopher is conscious for sure, but the regarding the gentle reader, he only can hope. Not even the Laplace demon would know, and my phenomenic knowledge is vastly inferior.

2Ape in the coat
Consciousness not being fundamental doesn't equal consciousness not existing. 

The problem with conscienciouness, is that full scientific knowledge of a phenomenon, tells nothing about it. It has been allways obvious, but now, with neural networks it is even more evident. You have the generative model, that is, the perfect scientic knowledge on a system. Still you know nothing about sentience.

I agree with Chalmers, but I dislike his presentation of dualistic naturalism, because he goes into long mental experiments. This is far more immediate: Laplace demon cannot assess sentience. And Laplace's deamon is the "omniscient materialist"... In this limited (but critical) sense, conscience is not material. 

You dont need to postulate conterfactual zombies. 

2[anonymous]
But conscious states are strongly determined by brain states as far as we can check. The argument that people use to argue against fully identifying the two comes down to deriving the metaphysical nature of qualia from their phenomenological properties. It seems to me that is epistemically problematic to argue against objective claims with intuition about something that we cannot even contrast with anything. We just have our intuition about phenomenology, no conceivable way to track the processes behind the phenomenon from that intuition. This is the reason why people imagine qualia to be individual entities and then think they can remove them ceteris paribus, or that they can't be tracked by Laplace's demons.    Consciousness doesn't need to be fundamentally distinct from non-consciousness. Rocks can't monitor their own states at all, but computers can, that doesn't mean that a fundamentally new property was added when you turn a rock into a computer. If we stop trying to derive metaphysics from phenomenology, the same account can be applied to consciousness. Then whatever processes track with what we feel consciousness to be will be trackable by a Laplace demon. 
2Ape in the coat
"Laplace demon cannot assess sentience" is begging the question just as much as "philosophical zombies are possible"  It's obviously true only if you assume the premise of counsciousness epiphenomenality. NNs do not represent the full scientific knowledge of a system. Also I think you are mistaken where the evidence point due to repetative goalpost shifting that has been happening with the term "counsciousness". It used to be much much bigger concept but everytime we discovered how some part of it worked on a mechanical level, it got redefined to be smaller - the still unknown part of the previous definition. We do know a lot about counsciousness in the original meaning of the term.

Dear all,

I will keep any remaining discussion on the EA Forum. It is the version of the article that has been commented in Marginal Revolution (point 6, second link):

https://marginalrevolution.com/marginalrevolution/2023/04/thursday-assorted-links-400.html

Nuclear winter:

https://climate.envsci.rutgers.edu/pdf/WiresClimateChangeNW.pdf

Electromagnetic pulse would destroy most electronic devices:

https://doh.wa.gov/sites/default/files/legacy/Documents/Pubs/320-090_elecpuls_fs.pdf

"Commercial computer equipment is particularly vulnerable to EMP effects. Computers used in data processing systems, communications systems, displays, industrial control applications, including road and rail signaling, and those embedded in military equipment, such as signal processors, electronic flight controls and digital engine contro... (read more)

But what is the probability that AGI wipes us? Why would AGI be more aggresive than humans? Specially if we carefully nurture her to be our Queen! 

1Seth Herd
That's the alignment problem, the primary topic of this site. Opinions vary and arguments are plentiful. The general consensus is that there's tons of reasons it might wipe us, the informed average something like a 50‰ estimate, and overconfidence is usually from ignorance of those arguments. I won't try to restate them all, and I don't know of a place they're all collected, but they're all over this site.

Why do you think AGI would necessarily be worse than us? I think we really don't know. 

1Seth Herd
If it wiped us out, it will probably wipe them out too.

We would not be destroyed in the first large nuclear war (while effects of radioactivity in the food chains in my view are under researched). But not a single open society would survive. 

A world of malthusian masses, and a military aristocracy desperately trying to keep as much firepower as possible is the natural post nuclear war outcome. Then, history happens again, and in 2000 years luckily we are back into deciding if we allow AGI to be developed. What is the point?

The baseline is that our governance systems are completely unaccurate for nuclear weapons. Even in this fortunate age of hegemonic republics. 

We need to solve the human alignement problem. Do you have any better suggestion than AGI? 

5RHollerith
I find it frustrating to correspond with you. You have become attached to an argument for what we should do. To support this argument, you send out many "soldiers": nuclear war is a potent existential risk; electromagnetic pulse would destroy most electronic devices; not a single open society would survive a nuclear war; nuclear war inevitably leads to more nuclear war; nuclear war will cause widespread societal collapse. And now we have a new soldier, namely, the effect of radiation on the food chain. Each of these soldiers seems plausible if one's epistemology consists mostly in noticing how often something is repeated in the press and online. But I haven't seen a single attempt by you to support any of these assertions / soldiers. When I say that Wikipedia says that most vehicles and cellphones would continue to operate after the electromagnetic pulses of a nuclear war, you ignore that. I offer you an opening to explain why you believe that nuclear war will lead to societal collapse whereas WWI, WWII and the Chinese civil war did not; you decline to engage on that. I still do not know whether you accept the conventional definition of "existential risk" (even after I asked you a direct question): when you wrote that nuclear war is a potent existential risk, maybe you thought that the possibility that half of the human population might die constitutes an existential risk. I.e., maybe you have been using an unconventional definition of existential risk. Your readers (including me) still do not know. If I continue corresponding with you, I expect you would send out a few more soldiers, but it take me a lot more work to explain why a soldier does not in fact support your argument than it takes you to find the next soldier and to send it out. Have you ever tried to learn about the effects of radiation on the food chain, e.g., by typing the phrase into a search engine and spending 5 minutes (as measured by an actual clock or timer) looking at the results? Science kno

Well, after a complete NATO Russia exchange, direct deaths would be in dozens millions in the first week, and the electromagnetic pulse would left the power production systems and the majority of electronics destroyed.

On top of that, you have nuclear winter, that put the deaths in the billions (see link in the text).

And then what social system is left? A second wave of wars would be inevitable, and inevitably nuclear.

4RHollerith
Ah, yes, societal collapse. Where was the societal collapse in Europe during WWI (which unluckily coincided with a flu pandemic that killed a lot of society's most productive members, namely people in their 20s) or WWII? Where was the societal collapse in China during its civil war (the 20th Century's third most deadly war) and then to top it off, during the civil war, Japan invaded China? When you were writing this -- let us be specific: when you were writing, "Despite fears about the alignment of interests between AI and Humanity, in reality what we know for sure is that the most intractable problem is the alignment among humans, and that [the] problem with nuclear weapons is also existential," did you know that "existential risk" is usually used to mean risk of the human population becoming zero? I.e., literally no human left alive whatsoever? If so, you haven't explained how the nuclear war would bring that about. Suppose a nuclear war kills 80% of the human population (which I consider barely possible, but at the extreme tail of the distribution of outcomes of a nuclear war, entailing some vulnerability in human civilization that I am probably currently completely unaware of). What is the mechanism by which all of the remaining 20% die? If for example there is widespread societal collapse (which again I consider very unlikely) how would that bring about the death of literally everyone? Why wouldn't for example some people survive as hunters, gatherers and small-scale farmers? I think that there is a lot of uncertainty over the effects of EMP on electronics because electronics has changed drastically since the end of the Cold War, and when the Cold War ended, the number of very competent and committed people studying nuclear war decreased drastically. But even with this uncertainty, I think we can say that your "the majority of electronics destroyed" is very unlikely: the wikipedia page on nuclear EMP asserts that most vehicles and cell phones would survive n

Well this answer to the "individual well being"; the equal weigths are worth discussing. Do you have any suggestion for different weights?

For ontological reasons! Value is something that consciece attributes to a dead cold indifferent universe. Value is subjetive as mass is inertial. Too fundamental to be discussed, I would say.

2TAG
You are conflating subjective as in "by subjects" with subjective as in "for subjects". A subject can have preferences for objectivity, universality, impartiallity, etc.
1Arturo Macias
Well this answer to the "individual well being"; the equal weigths are worth discussing. Do you have any suggestion for different weights?

I would say in philosophy, but not very much in political philosophy. The "Social welfare" definition is more Ethical than political, the rest is purely "game theoretical". But of course, at the bottom everything has metaphysical hypotheses. The less and more general, the better!

Load More