This was a really great Petrov day thing-to-do. I clicked on the link basically instinctively, after having a panic about being under time pressure, and about having my preferred outcome not taken, and therefore not being able to think so well about what my actions would actually do. Immediately after clicking, I felt very good, and like I had made the right decision, and then I felt a sinking sensation in my gut as I realized that if I had not taken any action, and nobody else had taken any action, then in a year I'd get to see what LessWrong as a collective decided, and I realized that actually I really wanted to see the result of that Petrov day, even if it meant Petrov day wouldn't be about preventing the end of the world.
For the rest of that day, and into today, I could not be in the world where LessWrong both collectively voted on what they wanted, and collectively refused to overrule the majority. It felt like I had ruined Petrov day. Even if others had still clicked the link in my stead, I still didn't want to have been among the people who ruined Petrov day, and it would feel even worse if I was the first, which I place nontrivial probability on (according to Firefox's his...
I picked "resisting social pressure" and then when I got the second message, I thought "Aha, I was asked if I value resisting social pressure, and now I'm offered the chance of applying social pressure to make things go my way, to see if I will defect against the very virtue I claimed to be in favor of! I'm guessing that there's a different message tailored for each of the virtues, where everyone is offered some action that is actually the opposite of the virtue they claimed to endorse, to see how many people are consistent. Clever! Can't wait to see what the opposite choice for the other virtues is."
Now I'm slightly disappointed that this wasn't the case.
I saw the poll, found it really yucky, and thus didn't answer it. I like LW for mostly staying on low simulacrum levels, and this poll felt like anything but. In more detail:
"Today is Petrov Day! A day celebrating that the world didn’t end, and the virtues that helped it not end. There’s been a lot of discussion." [...]
Virtue A – Avoiding actions that noticeably increase the chance that civilization is destroyed [...]
Virtue D – Resisting social pressure
I didn’t participate in the poll because it didn’t make much sense, the options didn’t seem to cover the possibilities or really contain what I’d pick if asked in free-response form, and the whole thing seemed rather slapdash. Clicking any of the options wouldn’t’ve reliably communicated anything about my beliefs.
(Also, there was a spelling error in the poll option URLs, which said “petroy” instead of “petrov”. This further undermined any confidence I may have had in the poll meaning anything.)
I think answering "how should you behave when you're sharing resources with people with different values?" is one of the projects of contractarian ethics, which is why I'm a fan.
A known problem in contractarian ethics is how people with more altruistic preferences can get screwed over by egalitarian procedures that give everyone's preferences equal weight (like simple majority votes). For example, imagine the options in the poll were "A: give one ice cream to everyone" and "B: give two ice creams, only to the people whose names begin with consonants". If Selfish Sally is in the minority, she'll probably defect because she wants ice cream. When Altruistic Ally is in the minority, she reasons that more total utility is created by option B - since consonant names are in the majority, and they get twice as much ice cream - so she won't defect and she'll miss out on ice cream. Maybe she's even totally fine with this outcome, because she has tuistic preferences (she prefers other people to be happy, not as a way of negotiating with them, simply as an end-in-itself) satisfied by giving Sally ice cream. But maybe this implies that, iterated over many such games, nice altruistic kind people...
First, I clicked the link in the second poll[1]. My thought process looked as follows:
Worse, even after clicking and reading the text again, I misunderstood its content. Somehow, I thought that this year's celebration will be determined by the plurality, whereas next year's will be determined by the fastest minority. This system is strange, but is not obviously defect-y, i.e. not obviously inferior to e.g. using plurality twice in a row, from behind the veil-of-ignorance.
Only after reading the OP and starting composing this comment in my mind, did I understand the actual meaning of the text in the second poll: that only the next year's celebration is decided upon, and only according to a minority (if anyone in a minority cli...
How can you honour your word at all if the premise of the link was false for more than half the respondents? There is no action that is consistent with your words.
I'm the one who picked the particular virtues we displayed, and it seemed good to explain a bit more about where I was coming from. We've had a lot of interesting discussion each year about the True Meaning of Petrov Day.
Eliezer's original post on Petrov Day begins:
Today is September 26th, Petrov Day, celebrated to honor the deed of Stanislav Yevgrafovich Petrov on September 26th, 1983.
Wherever you are, whatever you're doing, take a minute to not destroy the world.
The theme of "Reflect on the fact that the world could have been destroyed, and be the sort of people who don't destroy the world" was a central element most Petrov Day celebrations for years going forward. In 2019, when the LW team first built The Button experiment for LessWrong (where some users could press a button that took down the LessWrong frontpage for a day), we leaned heavily into this framing.
But throughout the years, some people have objected to this being the primary (or at least only) framing of the event. We've had a lot of interesting discussion each year about the True Meaning of Petrov Day.
Some people argued that it's actually kind of confused to celebrate Petrov for the sake of "...
Reasoning through the consequences of removing all virtues but the chosen one, an inability to avoid actions that lead to noticeable increase that civilization was destroyed tended to outweigh the others in expected negatives, so I picked that. It's also traditional, and is the one that makes any sense for the day to be about, though that wasn't what I was asked. I also thought through how the poll link might be a red button in some way but didn't see it.
I was quite puzzled by the second message that my choice to maintain the traditional and expected value...
I voted for correctly reporting your epistemic state. I claim that this is the actual virtue Petrov displayed, and that his primary virtue being "don't take actions which destroy the world" because he decided to buck the chain of command is a mistaken belief. From the Wikipedia article:
...Petrov later indicated that the influences on his decision included that he had been told a US strike would be all-out, so five missiles seemed an illogical start;[3] that the launch detection system was new and, in his view, not yet wholly trustworthy; that the message pass
Yes, we told everyone they were in the minority. It's a "game".
I think this is bad. I mean, it's not that big a deal, but I generally speaking expect messages I receive from The LessWrong Team to not tell falsehoods.
Hmm.
I don't think Avoiding actions that noticeably increase the chance civilization is destroyed is necessarily the most practically-relevant virtue, for most people, but it does seem to me like it's the point of Petrov day in particular. If we're recognizing Petrov as a person, I'd say that was Petrov's key virtue.
Or maybe I'd say something like "not doing very harmful acts despite incentives to do so"—I think "resisting social pressure" isn't quite on the mark, but I think it is important to Petrov day that there were strong incentives against what Petrov did.
I think other virtues are worth celebrating, but I think I'd want to recognize them on different holidays.
I clicked the link in the second email quite quickly--i assumed it was a game/joke, and wanted to see what would happen. If I'd actually thought I was overriding people's preferences, I... probably would have still clicked because I don't think I place enormous value on people's preferences for holiday reasons, and I would have enjoyed being the person who determined it.
There are definitely many circumstances where I wouldn't unilaterally override a majority. I should probably try to figure out what the principles behind those are.
In the first poll I voted "Accurately reporting your epistemic state" because I feel like it is systemically important and sort of a foundation on which other things like not destroying the world can be built (e.g. avoiding actions that noticeably may lead to the destruction of the world is more effective if you are better at sharing information relevant to which actions do or do not destroy the world). However if I had known that it was a poll about the next Petrov day celebration, I would have voted "Avoiding actions that noticeably increase the chance that civilization is destroyed" because I feel like that's the point of Petrov day.
clicked first relative to receiving are the same person! And also that person is from the majority group
A majority member being the initial clicker also isn't terribly surprising because a group being larger means one-or-more of any given sort of person -- in this case, a quick-responder-type -- is likelier to crop up among them.
I would be curious to see what the poll results for Question 1 look like, say, a week from now. I only saw the message in my inbox after Petrov day was over, and still responded.
Ah, for the purposes of responding to the PMs (and writing my explanatory comment) I accepted the truth of the setup mostly without question, but it makes more sense in hindsight that the "Avoiding actions..." virtue was actually a strong majority vote.
About what to do about next Petrov Day, I mostly agree with Vanessa's reasoning, but I don't think it matters too much either way and don't really think it's about "honoring your word".
Once the truth of the setup is violated, it's mostly just about whether you want to do the thing that predictably would have...
I selected "Quickly orienting to novel situations" (QOTNoS) because it's strictly superior to the alternatives:
In essence, QOTNoS (as in being able to make the right decisions in novel situations) is a synonym for general intelligence, and thus is the strongest power.
Okay, I'm one of the unilateralists and I totally haven't thought about poll as "value" choice. I've perceived poll as if it was: "Which ability is the most important to prevent destruction of the world? 1. INT 2. WIS 3. CHA 4. LUK", and question "which virtue has the most impact on chance of world not being destroyed" is a factual question, not value question. If I thought about poll more seriously, I would consider "I'm in minority on factual question on site with smarter than me people, maybe I'm wrong", but I was pretty confident and mostly took it as fun activity, not Very Serious thing.
Also, it can be the matter of language differences: English is not my native, maybe we have different connotations around word "virtue".
To me, the initial poll options make no sense without each other. For example, "avoid danger" and "communicate beliefs" don't make sense without each other [in context of society].
If people can't communicate (report epistemic state), "avoid danger" may not help or be based on 100% biased opinions on what's dangerous.
I never registered that I was being asked to make a decision on behalf of the whole site. I might have considered that interpretation of your second question for a fraction of a second, but then dismissed it as extremely unlikely to be your actual intent.
I spent probably less than 3 seconds on the second question (message). To get me to spend more time than that, your first 25 words or so would have needed to include some sign that something significant was at stake in my response. "I'm prepared to send you 5 dollars," would have done it. So would signs that you sent the message only to me (or only to me and 4 other people) rather than to everyone on the site. (I was able to deduce the latter somehow.)
I didn't list in the main post or say until because I fear that I'm saying it defensively in response to criticism, but to model the design for this year requires knowing that we spent vastly less time on it, deciding to something at the last minute. (We'd been very busy with a massive conference in days before Petrov Day.
At 11am (US West Coast time) we started thinking there was something we could maybe do, and at 12pm we got started. I felt we needed to rush if we were to include European folks at all, so really was looking for something we could get don...
Registering my predictions for which groups clicked the second link most:
Percentagewise, I don't Groups A and C clicked on it that much (though I'd be surprised if the number from each group isn't non-zero), since they picked a choice that indicates that they care about making high-quality decisions and cooperating with the rest of the world. A higher proportion of C probably clicked than A, since a person might decide it's worth it even if they take their time to think it through (I'd disagree, but the commentor you quote fits into that category).
I'd then...
This is not responding to the interesting part of the post, but I did not vote in the poll because I felt like virtue A was a mangled form of the thing I care about for Petrov Day, and non-voting was the closest I could come to fouling my ballot in protest.
To me Petrov Day is about having a button labeled "destroy world" and choosing not to press it. Virtue A as described in the poll is about having a button labeled "maybe destroy world, I dunno, are you feeling lucky?" and choosing not to press it. This is a different definition which seems to have been e...
Was everyone supposed to receive the second message? I only got the poll and not the second message with the unilateralist link.
I modestly propose that eating babies is more likely to have good outcomes, including with regard to the likelihood of apocalypse, compared to the literal stated goal of avoiding the apocalypse.
A Review of Petrov Day 2023, according to the four virtues. First a check on the Manifold predictions for the day:
LessWrong avoided creating a big red button that represents destroying civilization. This is symbolic of Virtue A actions like "don't create nuclear weapons" and "don't create a superintelligenc...
This was fun thank you!
There must be a hiccup in the data because you show < 30 total group b pickers in the first chart, but say there are 40 group b pickers in the "unilaterally make your virtue the focus" chart.
When Stanislav Petrov's missile alert system pinged, the world was not watching. Russia was not watching. Perhaps a number of superiors in the military were staying in the loop about Stanislav's outpost, waiting for updates. It wasn't theatre.
In contrast, LessWrong's historical Petrov Day celebrations have been pretty flashy affairs. Great big red buttons, intimidating countdown timers, and all that. That's probably not what the next "don't destroy the world" moment will look like.
It's also the case that some of the biggest moral dilemmas don't come clearly labeled as such, and don't have the options clearly marked as "cooperate" or "defect". (I think in Petrov's case, it was clear it was a big decision. Unclear to me how it easy it was for him to make and why.)
Matching the spirit of the above, this year's LessWrong commemoration was a little more one-on-one. It started with a poll. In previous year's, the LessWrong team has unilaterally decided the meaning of Petrov Day, often facing objections. So why not get a sense of what people actually think matters most?
We sent the following private message to anyone who'd been active on LessWrong in the previous 24 hours:
252 people responded to the survey at the time I started work on this post, and the results are pretty clear:
The Most Important Value of Petrov Day
Note: We did not actually spend much time thinking about the options in this poll, their framing, etc. Like under 10 minutes. Feel free to discuss in the comments.
Results are not significantly different for users with 1000+ karma:
Unilaterally pushing your own values over the collective?
I don't know whether what really was going on was genuinely idealistic as opposed to symmetrical fighting over resources, but a lot of the US<>Russia conflict seemed to be about values and beliefs about what was right. Capitalism, communism, etc.
This raises some good questions. What are the legitimate ways to promote your own values over other people? This is where the follow-up poll question took us.
Users were divided on the most important virtue (we don't know their opinions on the other virtues listed re Petrov Day), but it seemed reasonable that next year we'd go with the majority (or at least plurality) as a focus.
However, part of the Petrov Day experience (imo) is individuals being options to unilaterally change how things go for everyone else. Such an option we did kindly provide.
The plain value choice, according me, is faced with a values difference (or belief difference?) to go along with the majority, or to decide that unilaterally you'll take the opportunity to promote what you think is correct.
I find myself thinking about Three Worlds Collide scenarios where you come across others with different values, and possibly there are power differentials. What do you do confronted by
baby eaterspeople who prioritize communicating your epistemic status clearly above other things, and you have the power to defeat them?It's interesting to think about.
Unilateralists
Here's what happened: 31 out of 181 users clicked the link to promote their own favored value over what the collective would have chosen.
Note that I sent out the second follow-up message in batches, and some people responded to the first message after the last batch, and they did not get this opportunity. 181 did. That's 17% of people willing to unilaterally promote their value.
I'm not sure of people's reasoning here. Oliver Habryka said he almost instinctively clicked the link because of how it was displayed. Many people click first, read later. Unfortunately, though I attempted to place the link in spoiler block, that didn't work.
Perhaps people reason that it's inevitable that someone clicks the link, so might as well be them. (But be the algorithm you want to see in the world??)
One user, Max H, did explain his reasoning in response to a shortform question I asked:
He thought about it! I won't dive into discussing this here, but curious to hear from other link-receivers why they did or didn't click.
Which virtue-promoter group is the most unilateralist-y?
Before you hover/click into the spoiler text, please take a moment to register your predictions about which Virtue group clicked the "unilaterally make your virtue the focus" button the most.
Well, that really does make a lot of sense, frankly. Watch out for them nonconformist types, they don't care what you want!
EDIT: Oops, no, data error. I mismatched the values and it is not the case that "Resist social pressure" group "defects" at a higher rate.
So which virtue actually wins?
The very first click was from someone in group A, after 1 minute and 31 seconds had elapsed since they received the message.
But I think it's unfair to base this on literally the first click, since the message contain the link was sent out in a very staggered way, in a few rounds.
In the first round, Group A got the message several minutes earlier than B, then C, etc. Then there was a subsequent round. Group A is the largest so might have had a clicker.
We can look here and see for each group, how long did the people who clicked the unilateralist link take to do so after they received the message.
Dun dun dun...
And well, fittingly perhaps, the person who clicked first in absolute terms and the person who clicked first relative to receiving are the same person! And also that person is from the majority group Avoiding actions that noticeably increase the chance civilization is destroyed.
And since they are from the majority group and they clicked the link, they and thier group are disqualified! Meaning we go with the second largest group, Resisting social pressure! Congrat Group D! You're the most defect-y, but you win.
No, I joke. There's no disqualification of your entire group. If I have say in next year's LessWrong celebrations, I think we should honor our word[1] and go with the majority/person who clicked the link first, which is Avoiding actions that noticeably increase the chance civilization is destroyed!!!! Woooo. Good work.
That's the most important message of Petrov Day. An absolute majority of 57% of respondents confirm it.
EDIT: Vanessay Kosoy points out in the comments that what I actually wrote was:
And since many people clicked, the winner should be the first click from a minority group. This would be someone who selected Accurately reporting your epistemic state.
I find this reasoning compelling, but will allow myself to think/hear other arguments.
In all seriousness, I am pretty interested in question of how to behave when you're sharing resources with people with differing values, including resources that determine which values get promoted more.
Majority vote is a basic standard of fairness, but maybe if you can "cure" the babyeaters, you do so by force when given the chance. Or there are lots of other things that play into it, as Max H's reasoning is above. I'm quite curious, please share your experience and thoughts from the other end.
I twinge slightly that for the sake of the "game" we sent the majority group a message falsely saying they were in the minority. This was mostly that it was faster to not special-case it.