ygert comments on Harry Potter and the Methods of Rationality discussion thread, part 18, chapter 87 - Less Wrong

4 Post author: Alsadius 22 December 2012 07:55AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (592)

You are viewing a single comment's thread. Show more comments above.

Comment author: ygert 28 December 2012 08:29:20AM *  1 point [-]

Yes, you make good points. You are probably correct in saying that the scenario could go any number of ways. But my most essential point is this: The Unbreakable Vow is literally a perfect coordination system. That is to say, there is no way of Defecting when you made an Unbreakable Vow to Cooperate. Looking at governments around us, compared to a system like that, they look like nothing more then a hodgepodge of inefficient hacks. People hacked up that (comparative) kludge of a system, because there is nothing better. If there was, I think it's unlikely that they would ignore it and set up a kludgy government like ours instead. In fact, someone from that world would probably find our notions of "government" insane and laughable. (And that person would be right. Compared to a network of Unbreakable Vows, it is.)

My point is, this system is not only better then ours, but so much better that ours pales in comparison. Yes, the devil is in the details, but still,what you are proposing is that that everyone ignores the much better option and settles for the kludgey system that we have. May I suggest that perhaps that is nothing more than status quo bias?

And yes, if the Unbreakable Vow was invented after governments were, the government would try to crack down on this system, to preserve its own power if nothing else. But throughout history, many governments have cracked down on many good ideas, and often the good ideas eventually are accepted. I think that it would be especially true for this system, which is, as I said earlier, simply better then any other possible way of solving coordination problems.

(Although, please note that the system we are discussing (with imperiused binders) is actually a bit more complex, and so a bit worse than a form of the Unbreakable Vow which had no cost to the binder or did not require a binder. But my points still stand, as even though this system is not quite perfect, it still is heads and tails better than the systems of governments.)

One last thing: You asked for details of how society with this network would be better than society with a normal government. It is better in a lot of ways, and here I can not give a full listing of them, but think back for a moment in HPMOR to the chapters entitled "Coordination Problems". I think those chapters give a good feel of just how hard coordination problems are to deal with. For some examples of cooperating problems that would affect a nation, here is a short and incomplete list. (By the way, please note that we have for the most part solved these problems pretty decently with laws and governments. But look at the huge room for improvement. Remember that under a system like this one, these all would be absolutely and completely solved problems. There would be nothing left to discus about them.)

  • Crime (Is someone going to jump out at me and steal my stuff or try to kill me?)
  • Trustworthy Business Dealings (When I pay him, will he deliver the goods, or will he try to cheat me?)
  • Public Works (We need this bridge built. If I throw in my share, how can I be sure everyone else will to?)
  • Coups (If we assign this guy to be in charge of this important thing (maybe an army battalion), will he use it for the common good, or will he try to take over?)
  • Treason (How can we know that our citizens are not secretly working for the enemy?)

And I am sure that given this list to start with you can think of many more.

Comment author: Desrtopa 28 December 2012 03:44:15PM *  0 points [-]

But my most essential point is this: The Unbreakable Vow is * literally* a perfect coordination system. That is to say, there is no way of Defecting when you made an Unbreakable Vow to Cooperate.

But on the other hand, you also can't break a vow that turns out after the fact to be a bad idea. Without it, you can adapt to circumstances and then justify your actions as having been appropriate at the time. With it, if you've made a Vow that doesn't adapt well, you're in trouble. A system of Unbreakable Vows is only a perfect coordination system if the vows themselves are perfectly thought out, which people do not achieve by default.

My point is, this system is not only better then ours, but so much better that ours pales in comparison. Yes, the devil is in the details, but still,what you are proposing is that that everyone ignores the much better option and settles for the kludgey system that we have. May I suggest that perhaps that is nothing more than status quo bias?

My issue is that you seem to be assuming that people can just "fall into" a perfect system without giving any details for how they reach that optimum rather than getting stalled at some messy hacks where they are likely to remain due to status quo bias.

What I asked for is not simply a list of ways that such a society, if perfected, would have advantages over our own. I can think of those perfectly well myself. What I asked for was an explanation of the specific steps by which you expect a society would achieve those implementations. For instance, you start out with a regular society, with crime. The Unbreakable Vow is discovered. What steps, specifically, do you believe will occur which result in the endpoint of a society where everyone is bound by a network of Unbreakable Vows to commit no crime?

Just because it seems obvious to you that the end result would be better doesn't mean that people would implement it. In a Tragedy of the Commons, there are often ways that the agents involved could arrange to cooperate among each other (each one could provide collateral which will be returned after a given period if they cooperate, but confiscated if they defect, for instance,) so that everyone will have a greater expected utility if they cooperate than if they do not cooperate, and a higher expected utility than if they did not implement a cooperation scheme. But in practice, people don't usually implement such schemes when left to their own devices. To show that people would be likely to adopt such a system, it's not sufficient to demonstrate its advantages.

Comment author: gwern 28 December 2012 05:07:39PM *  2 points [-]

The Unbreakable Vow is discovered. What steps, specifically, do you believe will occur which result in the endpoint of a society where everyone is bound by a network of Unbreakable Vows to commit no crime?

Words of honor for parole (think prisoners of war etc.) have historically often served as punishments or forms of security, with the major advantage of being light-weight and minimizing costs and suffering. A huge chunk of all crime is committed by repeat offenders. Hence, crime could be cut by something like an order of magnitude just by making UVs a prerequisite for parole.

This requires no special societal shifts, and is in line with existing jurisprudence using things like ankle monitors to deter breaking terms of parole or committing additional crimes.

From this visible success which will save billions of dollars and millions of lives in the long run, can come acceptance and a slippery slope down to more widespread use - perhaps beginning with application upon simple arrest, much like criminal records can begin compilation these days without anyone whining about state security agencies tracking them (as our ancestors surely would have been angry about, but these days no one can even think of why anyone would object to such state tracking).

Comment author: Desrtopa 28 December 2012 06:48:04PM 0 points [-]

I can buy the initiative progressing as far as application of vows upon arrest (although at this point I'm not sure if Ygert is still talking about a system of MoR vows which require the sacrifice of some of a bonder's power, in which case I suspect it wouldn't get that far.) But I find it doubtful that it would progress to the point of everyone being bonded to commit no crimes.

The existence of real life government initiatives which have saved large amounts of money and lives have not led the public to conclude that government initiatives in general are trustworthy and should be expanded, so I'm not convinced that the success of such an initiative would be viewed as a mandate for its expansion.

Comment author: gwern 28 December 2012 09:32:18PM 1 point [-]

But I find it doubtful that it would progress to the point of everyone being bonded to commit no crimes.

The costs is an issue of friction; in a vacuum with a spherical Unbreakable Vow, would everyone be bound? Eventually. Why not?

Given the high reported cost, there will be lots of people it's not worth binding, but the exact trade-off will vary. Given the high cost of security and opportunity costs, the cost will have to be large to justify not binding quite a few people (consider how many scores of thousands of dollars it costs to keep an ordinary criminal in prison one year).

The existence of real life government initiatives which have saved large amounts of money and lives have not led the public to conclude that government initiatives in general are trustworthy and should be expanded

Look at what the public does, not what (some of) it says. Governments keep expanding.

Comment author: Desrtopa 28 December 2012 09:59:35PM *  0 points [-]

Government keeps expanding in some respects, but countries often do not rush to implement programs even when they've proven effective in other countries.

Comment author: ygert 30 December 2012 08:16:47AM *  1 point [-]

I come back here and I find that gwern has made some of the points I wanted to make, and some point even beyond that. As gwern point out, programs similar in goal and expense although lesser in scope exist in the world today. They have been implemented, so saying that in some (or even most) circumstances countries don't implement this kind of program, is, if not a flawed argument, at least an incomplete one.

But on the other hand, you also can't break a vow that turns out after the fact to be a bad idea. Without it, you can adapt to circumstances and then justify your actions as having been appropriate at the time. With it, if you've made a Vow that doesn't adapt well, you're in trouble. A system of Unbreakable Vows is only a perfect coordination system if the vows themselves are perfectly thought out, which people do not achieve by default.

Remember how earlier in HPMOR (chapter 47) Harry swore to take as an enemy whoever it was that killed Narcissa Malfoy? It was no an unbreakable vow, but the same principle applies. Not only was he very careful, with many conditions laid upon the pledge, but the first condition said that Draco could release him from the pledge at any time. There is no danger of a vow like that being not perfectly thought out, because if something goes wrong, you can just have whoever you swore it too annul it. I understand that getting a perfect wording is not trivial, but if you just keep a human in the loop like that, you can avoid most errors.

And a clarification:

(although at this point I'm not sure if Ygert is still talking about a system of MoR vows which require the sacrifice of some of a bonder's power, in which case I suspect it wouldn't get that far.)

In a certain sense I am talking about them, as the whole thing started from a discussion of what would happen if we used a specific method to get around the disadvantage, but in practice I am not really talking about them, as with the downside basically gone, there is no real difference between them and an Unbreakable Vow like in canon, with no downside. In other words, I am talking about Unbreakable Vows with no downside, but that could either be the ones we were talking about (with the downside, but with it overcome) or the simpler version which does not have a downside to start out with, and it does not really matter which.

Comment author: Desrtopa 30 December 2012 03:35:38PM *  0 points [-]

Remember how earlier in HPMOR (chapter 47) Harry swore to take as an enemy whoever it was that killed Narcissa Malfoy? It was no an unbreakable vow, but the same principle applies. Not only was he very careful, with many conditions laid upon the pledge, but the first condition said that Draco could release him from the pledge at any time. There is no danger of a vow like that being not perfectly thought out, because if something goes wrong, you can just have whoever you swore it too annul it. I understand that getting a perfect wording is not trivial, but if you just keep a human in the loop like that, you can avoid most errors.

Harry is one of the most intelligent and rational people in the world, and took great care in designing that oath, (which, as you point out, is not unbreakable,) and he's still in a position for it to screw him over, since if Draco's father has been doing his best to change his son's sympathies, then Draco may not be inclined to release Harry from the Vow even if it turns out Dumbledore burned his mother for good reasons.

If Harry had taken an Unbreakable Vow, then even with the escape clause, he would probably be obligated to treat Dumbledore as his enemy right now, with no way to get Draco to release him from it.

There's plenty of danger in an imperfectly thought out vow, even if you add a clause that someone can release you from it. Having someone who could release you from your vow isn't much help if you're already dead due to having been unable to act in self defense, for instance. Supposing you have to go down to the equivalent of a local police station to get released from a Vow, I would suggest that this probably retains most of the problems of being unable to break the vows at all.

In a certain sense I am talking about them, as the whole thing started from a discussion of what would happen if we used a specific method to get around the disadvantage, but in practice I am not really talking about them, as with the downside basically gone, there is no real difference between them and an Unbreakable Vow like in canon, with no downside. In other words, I am talking about Unbreakable Vows with no downside, but that could either be the ones we were talking about (with the downside, but with it overcome) or the simpler version which does not have a downside to start out with, and it does not really matter which.

If you think it doesn't matter which, I have to suspect that you're not thinking very hard of the implications of the MoR method.

Not everyone can be easily imperiused, nor is everyone capable of casting the spell, and it is probably impossible for a single person to keep a large number of people imperiused at once (canon doesn't say whether it's possible to imperius more than one person at a time, but provides no evidence that it is, and if it were, we could expect people like Voldemort to make extensive use of this.)

If the people being used as binders are not controlled perpetually, then we have a segment of the population which is being victimized in what many humans would regard as one of the most abhorrent ways possible, being routinely mind controlled into performing acts to which they would not consent of their own volition. These people, to put it lightly, do not like the segment of the population which is doing this to them. The people exploiting them need to make arrangements to keep them safely under control, as with chattel slavery. If such arrangements aren't strong enough, they're likely to engage in violent uprisings (although unlikely to succeed if and when they do, they're less powerful and less well coordinated.)

Not only does the society have to invest labor and resources in keeping this segment of the population under wraps, any enemies who want to destabilize this society would do well to target this system. Kind of like the helot system, which was convenient for the Spartans in terms of productivity and military strength, except for the fact that any time they stayed away from home for too long, they were in danger of a revolt, and they had to make all the other city states they dealt with swear to support the system, since it would be so dangerous for them if anyone tried to destabilize it.

You can increase the security by keeping the people shut away somewhere, but then you lose the productivity of the people being used as binders.

Probably the most efficient method would be to force all the binders into unbreakable oaths not to rebel. You are, of course, still losing a significant portion of the total magical powers of the population by using unbreakable vows en-masse like this, and far from other countries seeing and wanting to copy this system, they're liable to see it as either an exploitable weakness or a human rights violation, in which case this society could be facing trade sanctions, embargoes, or even war.

And of course, you still have the issue of how society undergoes the steps to reach this point.

Comment author: Eugine_Nier 31 December 2012 10:16:40PM 1 point [-]

Probably the most efficient method would be to force all the binders into unbreakable oaths not to rebel. You are, of course, still losing a significant portion of the total magical powers of the population by using unbreakable vows en-masse like this, and far from other countries seeing and wanting to copy this system, they're liable to see it as either an exploitable weakness or a human rights violation, in which case this society could be facing trade sanctions, embargoes, or even war.

Look at how effective those are in the real world. You have countries ignoring sanctions and embargoes because there's a lot of money to be made that way. As for wars with large coalitions, you have the inevitable issues of members suspecting other members of not holding up their end of the war, or using the war to unfairly increase their power vis-a-vis the other members of the coalition.

Of course, it's not hard to solve all these problems using unbreakable vows, but well. ;)

Comment author: gwern 31 December 2012 10:30:11PM 0 points [-]

You have countries ignoring sanctions and embargoes because there's a lot of money to be made that way.

But you also have success stories of sanctions and embargos inflicting serious pain: just to name the ones I know of off the top of my head, Japan apparently felt itself forced into WWII by a US embargo of necessary supplies, North Korea remains a hellhole and has trouble selling stuff like it used to which forced it to come to the negotiating table over the bank embargos, and Iran is currently grappling with uncontrollable inflation (which may result in hyperinflation) which is attributed to the existing relatively mild sanctions.

Comment author: ygert 31 December 2012 09:04:17AM 0 points [-]

There's plenty of danger in an imperfectly thought out vow, even if you add a clause that someone can release you from it. Having someone who could release you from your vow isn't much help if you're already dead due to having been unable to act in self defense, for instance. Supposing you have to go down to the equivalent of a local police station to get released from a Vow, I would suggest that this probably retains most of the problems of being unable to break the vows at all.

You are right, Harry did not add enough layers of precautions. As such, he is in a position for it to screw him over. A truly well thought out Vow would have several escape clauses like this, to different people, and also a clause temporarily suspending the Vow while you go to have it removed if you truly believe that the situation warrants its removal.

Even that might not be enough, but remember: Harry thought his oath out in less than a minute. I thought out my additions in not much more. I imagine that if someone smart brainstormed this for a couple of hours, they would figure out even more elaborate and foolproof mechanisms. And once it gets going, there will be people who spend their whole careers on the question, refining the answer even further.

If you think it doesn't matter which, I have to suspect that you're not thinking very hard of the implications of the MoR method.

I think we have a very large difference of opinions here. Remember that in the real world, most societies with slaves lasted quite a long while. Add onto that several additional factors that are greatly to the advantage of the masters and not to the advantage of the slaves, and you see why I think there is not much of a difference.

  • Numbers. In the example you gave, of the Helot system, please not that there were seven times as many helots as non-helots. That's right, seven times as many. In this system, you would not need even nearly a one-to one relationship. I would guess that there would be probably no more then one slave needed for every five or six people. This reduces their ability to revolt by so much that it is nearly impossible to compare it.

  • Magic. I would envision the slaves not having access to wands except when binding a Vow, giving access to wands to only a small fraction of the slave population at a time. Add on to that the fact the the slaves would not get much magical training, and that they have their magic reserves permanently depleted, and you will see that the masters have another insurmountable advantage.

  • The Imperius Curse. During the time when the slaves do have a wand, they would be under the Imperius Curse. This would not need more than one slave to be controlled by someone's Imperius Curse at any one point. And remember, when you say that not everyone can be controlled by this curse: In canon, it was a huge surprise that Harry managed to throw it off so easily, the kind of thing you can only get if you are the hero of the story. Most people resistant to it are only that way due to a large amount of willpower built up over the years. And you can just execute people like that.

  • Unbreakable Vows. I don't think these are needed, as the other factors cover the possibility of a revolt very well, but if needed, some slaves could be forced into an unbreakable vow not to rebel.

far from other countries seeing and wanting to copy this system, they're liable to see it as either an exploitable weakness or a human rights violation, in which case this society could be facing trade sanctions, embargoes, or even war.

Remember that the concept of "human rights violations" are something very new, and they did not stop basically every nation that ever existed from keeping some sort sort of slaves. Remember that for thousands of years, there where, sadly, a lot of slaveholding and other human rights violations. And in no case did this result in the moral outrage from the surrounding countries, and certainly not to the point where they declared war or started trade embargos. (By the way, just thinking about it makes me very much appreciate the moral progress humanity has made in the last few hundred years. It truly is incredible if you think about it.)

And of course, you still have the issue of how society undergoes the steps to reach this point.

We have discussed this a lot, and have provided a lot of explanation about how I do not really consider this an issue, and others have chimed in, adding their views on the subject. After all that, I believe we have provided many different angles of the explanation of why this is. If there is a specific part of it that you object to or want clarified, I am happy to discuss it further, but other than that I am not sure that there is more to discuss.

Comment author: Desrtopa 31 December 2012 04:30:16PM *  1 point [-]

Remember that the concept of "human rights violations" are something very new, and they did not stop basically every nation that ever existed from keeping some sort sort of slaves. Remember that for thousands of years, there where, sadly, a lot of slaveholding and other human rights violations. And in no case did this result in the moral outrage from the surrounding countries, and certainly not to the point where they declared war or started trade embargos. (By the way, just thinking about it makes me very much appreciate the moral progress humanity has made in the last few hundred years. It truly is incredible if you think about it.)

Most civilizations though, did have rules about how you were allowed to treat slaves. The treatment of slaves in antebellum America was worse than in Babylon circa 1700 BC. To get people whose rights are that disregarded by society, you generally need people who're already regarded as an outgroup unworthy of basic respect.

If we're positing that the legal system started in a society with a caste system containing something comparable to the Paraiahs, I could buy this as a natural progression. But what you're suggesting entails rather worse treatment than most civilizations have allowed with respect to their slaves. I find it very strange that you think this is something that would happen so naturally as to need no explanation.

We have discussed this a lot, and have provided a lot of explanation about how I do not really consider this an issue, and others have chimed in, adding their views on the subject. After all that, I believe we have provided many different angles of the explanation of why this is. If there is a specific part of it that you object to or want clarified, I am happy to discuss it further, but other than that I am not sure that there is more to discuss.

Do you think that nobody in this community could think up ways to restructure society that would be more practical than what we have now, without positing elements that don't exist in real life? That nobody could come up with a better education system, or public works system, or so forth? If you think that the fact that a system would be advantageous is sufficient to explain its adoption, that's a natural conclusion, but it's one that I find awfully doubtful.

We have some very suboptimal systems in our world, not just for lack of some fantasy element that would make our job easier, but because humans are not naturally that good at optimizing.

Keep in mind also that these people who have their magic drained and their wands kept away, who're not trusted to be willing contributors to society, are lost productivity from society's perspective. If we say that the binders, plus the people who're employed in overseeing them, add up to a fifth of the population, that's a significant reduction in productivity. Probably not quite 20%, since there's still some work they could do without magic, but considering how magic dependent wizarding society is, it would be pretty minimal compared to what ordinary citizens do.

In what ways, specifically, do you think this system would manage to more-than-account-for this loss of productivity?