Okay, this comment's for stuff I found. Will edit this post with things as I find them.
MC&D when they burn millions to acquire keter items https://i.imgur.com/GlTx4HQ.png
I guess they must be a loss leader, it's not like their only source of anomalous stuff is stealing from the Foundation.
I'm filtering out any items which have more than five bits on in the binary section. Two rows are likely corrupted by infohazards - I thought it might have been time travel, but seeing as they also have every bit set to 1 EXCEPT for the infohazardous bit, they stand out like a sore thumb. I found those first two by plotting SCP number VS time and noting the outliers. They're also the only times an item was acquired when no team was sent. There are others that I'm on the fence about but I think eliminating those with excessive intersections is a reasonable data cleanup decision. Plotting year VS row number has a few jumps back but time travel's a thing in this setting so whatever.
Not sure where the nonlinearity here comes from. Maybe the simulation has a certain number of SCP numbers assigned at any given time, and then randomly draws from them as targets.
Splitting cumulative profits out by both SEK classification and site number shows variations between sites, though I'm not normalising here for the number of times a site was targeted or the SEK distributions at any given site.
Findings:
Final allocations:
Paramilitary units target SCP-3339, SCP-4625, and SCP-5136
Infiltration units target SCP-4390, SCP-2719, and SCP-537
I was debating having the legal teams stay home, but if I point them away from Keter stuff they may actually help the company's bottom line for a change, so . . . they can target SCP-3850, SCP-3212, and SCP-4957.
Thoughts on the Long Game:
MCD's legal department are a bunch of incompetent, possibly-corrupt clowns who keep losing their company money. I should probably retain some lawyers of my own and see what they have to say about this NDA I signed ASAP.
...odd to see characters I created being used by someone on LessWrong, and references to my stories to boot.
I liked the surprises scattered throughout the dataset - which, for the curious, can be pretty easily identified by just scrolling through and noting which lines stand out.
woah info hidden behind a blackbox this is just like scp again
also I think MC&D has stolen a few items before they got their designations, and that the rows are in order of execution - which, when time travel is possible, is not necessarily temporal order.
also "We would prefer to acquire, oh, say, the magical pills that can cure any illness" marshall you haven't tried to get SCP-500 since 1927, and I know that one's canon in this puzzle because SCP-682 is also very conspicuously missing from the dataset
I don't know what parts of it specifically you've written, but yes, I've gleefully stolen leveraged a lot of things from the SCP wiki and related works in writing this. Thank you for your assistance!
[DATA EXPUNGED]
I wrote the wiki's MC&D hub, designed the modern MC&D logo, and coined the given names that you used here during a contest back in 2014. Thank you for making the puzzle - I have found some interesting things so far!
Such as the virtual predatory organic-mechanical mobile replicating humanoid locations, which are for sure accurate representations of the real world and are definitely not infohazardous, since the data said it wasn't.
Within the SCP canon, 'MC&D' is 'Marshall, Carter & Dark,' start e.g. here. I've tried to be faithful to the image in the story above - a quick summary would be 'very rich, very upper-class, and very very capitalist people who want to use SCP objects as things to sell to the rich and powerful.' Start with investment bankers, as they are envisaged by the far left, and then throw in a dash of SCP stuff.
If you want a few things to read, my recommendations for the short things you can read that are most MC&D-ish in my head are:
https://scp-wiki.wikidot.com/thank-you-for-your-time
https://scp-wiki.wikidot.com/scp-604 (trigger warning: yes)
In that case this is the closest I'll ever be to interacting with a celebrity, that's awesome. I love MC&D.
Notes on found & todos:
Data cleanup reveals everyone is super sinister.
Searching for obvious anomalous data reveals there is likely one data-munging SCP and checking surrounding entries narrows its id to a very small range.
Checking for missing SCPs reveals the id of the above anomaly. Truncating data past various times suggests that the foundation finds and numbers SCPs in numerical order, at some point SCPs become inaccessible perhaps by destruction or superb lockdown or otherwise, at some point (how?) MCD becomes aware of them, and randomly (how?) known available SCPs are potentials during each quarter.
(Very WIP) checking for teams sent, seems very variable? But generally at least 2 of each? But not quite always? But now I'm suspicious that some of our data has been erased?
Next steps: evaluate teams sent for patterns and in particular missing teams. Model finding and losing access to SCPs. Figure out how we allocated teams in the past, otherwise acquisition and profit will be (?) unacceptably selection biased. I guess maybe at some point try to figure out how likely various acquisitions and profits will be and what to do about the incentives. ;)
I didn't make much progress on next steps. There does seem to be a large time-dependency on perf, so probably MCD is going through allocators pretty fast :( or maybe certain teams are really good at what they do and stick around?
My solutions. Probably won't get any reasonable chance to revise them.
Plan: become invaluable, see more data, find a way to escape eventually.
Legal, SCP-1282
Legal, SCP-2122
Legal, SCP-4370
Paramilitary, SCP-3212
Paramilitary, SCP-3936
Paramilitary, SCP-4834
Infiltration, SCP-4449
Infiltration, SCP-3273
Infiltration, SCP-1466
Plan: poison MCD against ever using "data driven" approaches.
Legal, SCP-3781
Legal, SCP-4036
Legal, SCP-2626
Paramilitary, SCP-1838
Paramilitary, SCP-2116
Paramilitary, SCP-3577
Infiltration, SCP-3279
Infiltration, SCP-2178
Infiltration, SCP-4654
Plan: try to escape, but try to be valuable given my immediate escape desires.
Legal, SCP-1282
Legal, SCP-4370
Legal, SCP-3936
Paramilitary, SCP-2883
Paramilitary, SCP-2797
Paramilitary, SCP-4004
Infiltration, SCP-3668
Infiltration, SCP-4931
Infiltration, SCP-5117
Method, sadly, was just:
clean the data
compute smoothed fraction of acquisitions per attempts for each team type given set values for two tags; average over all pairs of set values
same but mean profit given successful acquisition
handpick best expected profit, worst expected profit, and best expected profit for infohazards that seem maybe useful or volatile
It is very rare that I can't resist being "that person", but Safe, Euclid and Keter refer to required containment resources, not danger level.
I don't think that's consistently true across the wiki? SCP-668 or SCP-2317 spring to mind as examples of objects whose classification appears to be based on danger level rather than on required containment resources? SCP-2521 is also a Keter-class object, despite the fact that its containment procedures consist entirely of
I came in pretty late, so I haven't gotten much to share.
I split my analysis into expected-profit-if-obtained and chance-of-obtaining-per-team. It probably isn't true, but assuming that team selection does not directly affect profit simplifies things a lot.
Final allocations
My method:
I assigned a score to each target-team pairing based on average profit gained/lost by that team type attempting similar items. Specifically, I summed a site score, a classification score and nine flag scores where each sub-score is the average profit of attempts by that team type for targets sharing that attribute. I excluded team-attribute pairings that are rare in the dataset (legal teams targeting humanoids, infiltration teams targeting locations), which I guess would predictably fail to acquire for obvious reasons. I also noted that paramilitary teams are extraordinarily bad at acquiring virtual targets even though they attempt fairly often. I would have excluded these if it was relevant.
I want to find the overall team assignment that maximizes/minimizes the sum of the scores for each target, but there are 24.8 trillion possible team assignments. To make the problem tractable, I first reduced the target set to "viable" targets, which are the nine top scorers for each team type. Some of these overlap, so this reduced the target list from 60 to just 13 minimal targets and 17 maximal targets (1.2 million and 70.8 million possible assignments respectively). I iterated over these reduced target lists to find the best/worst overall assignments.
Maximal assignment:
Infiltration: (SCP-1466, SCP-3339, SCP-5117)
Legal: (SCP-1282, SCP-3850, SCP-5136)
Paramilitary: (SCP-3212, SCP-3936, SCP-4834)
Minimal assignment:
Infiltration: (SCP-2116, SCP-2178, SCP-3279)
Legal: (SCP-2626, SCP-3781, SCP-4036)
Paramilitary: (SCP-1838, SCP-3577, SCP-4654)
Possible data error:
1933Q2,SCP-1604 shows a profit even though the team wasn't successful. Is this an error?
The row in the file is definitely what the dataset says.
To clarify a potential minor misinterpretation of the dataset - in actual fact that row shows a team being successful (a 1 in the column 'Acquisition Successful'), a profit being made (1.3M in the Profit column), but no team being sent ('None' in the column 'Team Sent'). This does indeed seem very strange. Nevertheless that is what the dataset your character has been given shows.
Specific numbers of SCPs do not match up with those in canon. If you see a row for SCP-255 in this data, you should not look up SCP-255 on the SCP Foundation wiki and assume that it is the same thing.
I guess math's been contaminated.
I haven't finished my analysis yet, but Darke et al. will find that their particular mixture of positive and negative reinforcement yields rather different results from what they are expecting. I hope that my successor feels the same way.
Attempts to minimize rather than maximize the payoff function will be accepted* and marked as such on the leaderboard.
*Well, they will be accepted by me as the author. They probably won't be accepted by MC&D within-story.
STORY (somewhat longer than usual, still skippable)
When you graduated top of your class from Data Science School, you didn't care where you ended up working, you just wanted to find the highest-paid job possible. (Your student loans may have had an impact on this decision).
(Yes, I know a past scenario background has also begun this way. It's a versatile backstory. And one that I think may resonate with many of my players.)
Somewhat surprisingly, at the last minute Goldman Sachs was outbid by a firm you'd never heard of before called "Marshall, Carter and Dark Ltd." They hired you (for a substantially higher salary than anyone else was offering) to analyze sales data for "our ultra-exclusive chain of clubs, facilities, and banking services, catering to the finest gentlemen since 1952".
You've been working for them for several years now, in the course of which you've seen a variety of...very strange objects pass through their firm. It seems that, in addition to their upper-class business, they acquire and sell a variety of items that don't strictly seem to obey the laws of physics.
In the course of the last few years, you have excelled beyond your employers' expectation at all the technical aspects of your job...while perhaps performing less well on the social aspects.
It might have been turning down an invitation to drinks with your boss Mr. Alden because you don't like alcohol...
...or spending forty-five minutes explaining a particularly interesting piece of your data methodology to a client who had asked an innocuous question (how were you supposed to know he would be such a philistine as to find that boring?)...
...or asking a few too many questions about the various strange items that passed through the firm...
...or (what seemed based on your colleagues' reactions to be worst of all) pointing out that when you acronym "Marshall, Carter and Dark" to "MC&D" it looks very like "McDonald's".
Whatever the reason, when you were called into the office of Mr. Marshall for a private interview, you assumed you were going to be fired.
(You weren't too worried. You're a data scientist. You can find another job in less time than it'll take you to leave the building. And given the severance package in your contract, firing you would basically amount to paying you a large bonus.)
With your usual level of social acumen, as soon as the door to Mr. Marshall's office closed you asked him: "Am I being fired?"
He looked surprised to hear you say that (which would have fooled you three years ago, but since then you've learned that the top-tier client-facing staff of MC&D change expressions the way you change clothes.) "Fired? Of course not! Mr. Alden speaks very highly of your technical ability."
"My technical ability yes, my non-technical ability...uh...not so much." (You're sure a salesperson would have said that in a better-sounding way).
Marshall puts on a smile that you couldn't imitate if you spent months in front of a mirror. "Quite so! In fact, that's why you're here." He steeples his hands and leans forward slightly. "It's come to our attention that you're being...under-utililized in your current role. As you say, your salesmanship skills are...perhaps a point for future improvement. However, your technical skills are top-notch, and we think they're being wasted in your current position. And as it happens, we have a recent opening as head of Acquisitions that my colleagues and I think would benefit from a more data-driven approach."
You blink in confusion. It sounds like they're...promoting you? That can't be right...can it?
"I'm pleased to inform you that this position would come with a 20% base salary increase over your current compensation, with the additional potential for a noticeable element of performance-based bonus compensation. Additionally, I know you've shown interest in some of our more esoteric offerings," he smiles again, "and I'm happy to say this position will offer you a role dealing directly with them, which I'm sure you'll find fascinating. If you'll sign this non-disclosure agreement, I can give you more detail."
You sign, and he smiles again. It might be your imagination, but it looks like a different smile, with less warmth, like the smile of a shark that's just wandered into the middle of a school of tasty, slow-moving fish.
"Marshall, Carter and Dark is a globally connected firm. Among the advantages this lets us offer our clients is our knowledge of certain esoteric artefacts that act in manners beyond our current understanding of physics - or, in some cases, in manners outright foreclosed by our current understanding of physics. We seek out such objects from across the world and acquire them for our clients, or in some cases for direct usage by ourselves. While this is a source of revenue for us, and your performance as head of Acquisitions will be evaluated principally by revenue generated, the true benefits lie largely downstream from that - the connections thereby formed and relationships generated with our clients provide returns in excess of the initial sale price."
Blah blah client relationship blah blah. You get it. How do you find these anomalous items anyway? Perhaps some kind of analysis of mana flows underlying the world? That sounds like the sort of problem you could turn your data science skills to.
"The majority of such anomalous objects are secured before we can identify them, by an extralegal organization referring to themselves as 'the SCP Foundation'. They consider it their mission to 'Secure, Contain and Protect' - to locate these artefacts, priceless relics that offer unique capabilities or even a chance to advance human technology, and sit on them lest anyone do anything productive or profitable with them. As such, the main role of Acquisitions lies in identifying items currently in the custody of the SCP Foundation that we can realistically acquire and put to better use."
"Wait, you're stealing them?" Surely he can't be trying to-
"I would prefer to say we're using these objects in a more efficient manner. The market indicates a substantial demand for these items, and by removing them from circulation the Foundation is-"
"No. This is obviously illegal. I'm not helping you do it. I'm calling the police."
He's still smiling, and it's freaking you out. "I do seem to recall that less than two minutes ago you signed an agreement not to disclose-"
"An NDA to cover up a crime isn't enforceable."
He sighs, and sounds genuinely disappointed. "A crime? What crime?"
"You just told me-"
"Told you that you were going to help steal 'magical' objects from a clandestine organization no-one has ever heard of. Strange physics-breaking artefacts that no-one believes exist. By all means. Call the police. I'm sure everyone will be quite distressed to hear that a valued employee of Marshall, Carter and Dark has suffered a nervous breakdown." He sounds genuinely sympathetic. "It must have been the strain of the job. Of course we would never dream of overworking our employees, but the young always think themselves invincible. Don't worry, officers - under the circumstances Marshall, Carter and Dark won't be pursuing any cause of action for slander."
You look down at the phone in your hand, with a slow realization that maybe you did not entirely think this through.
"Secondly, I think you are underestimating the capabilities of Marshall, Carter and Dark in a litigation environment." He smiles, and it's all teeth, white and cold as a winter mountain. "Under the choice-of-law clause in both your employment agreement and the nondisclosure agreement you just signed, you agree for issues between you and the firm to be resolved first by our in-house arbitration committee, and should that fail by escalation to courts in our corporation's home jurisdiction. The firm is incorporated in the Cayman Islands. There are a grand total of four judges in the Cayman Islands. Three of the four are former employees of Marshall, Carter and Dark, still drawing generous pensions whose value is based on the company's stock price. The fourth golfs with me on weekends." He lowers his voice conspiratorially. "I usually let him win, you know. It's good for building relationships."
"And thirdly." His voice has gone cold now, matching the smile. "Under ordinary circumstances our retrieval teams are employed to locate and acquire anomalous objects. Highly valuable artefacts, defended by a quasi-governmental agency with a vast budget, anomalous resources and weapons of its own, and very few constraints on its actions. And in more than half of cases, a team sent to acquire such an object succeeds." He leans forward, locks eyes with you. "While the firm would of course prefer to avoid any unpleasantness, should it prove necessary one or more of those teams can be redirected to...resolving a loose end before it can grow into a potential legal and public-relations issue for the whole corporation."
"Now sit back down."
"Good."
"Your main role as head of Acquisitions will be selecting targets for our retrieval teams. You see, despite our frictions with the SCP Foundation, we believe that they are doing good work. Many of the anomalous objects they contain in fact should be contained. We are interested only in that subset of objects whose value outweighs their danger. So by all means let them continue to contain the giant indestructible reptile driven solely by hatred for humanity. We would prefer to acquire, oh, say, the magical pills that can cure any illness."
"Sadly, our information about SCP objects is limited. We have access only to the Foundation's internal classification system, identifying objects by their danger level and a few tags. In the past this has led to certain unfortunate incidents where Acquisitions in fact imposed costs on the rest of the firm, to clean up the messes caused by acquiring something we rather shouldn't have."
"You will be supplied with a list of all SCP objects identified as targets by our teams, and we have also collated for you a comprehensive history of our past attempts and how successful they were. As I understand your latest soliloquy on the matter, that should provide enough information for you to employ data science tools, and hopefully to identify targets more effectively. I wish you more luck of it than your late predecessor."
"One last thing. Our firm's assets are our employees, our capital, and our reputation. If any of these is ever diminished, the last is the most difficult to restore. Marshall, Carter and Dark has grown on the back of our reputation as an acquirer of anomalous items. However, recent ineptitude in the Acquisitions department has led to very poor performance. Our firm's reputation has suffered."
"I and my fellow partners appreciate competence in our employees. Turn around the lackluster performance of the Acquisitions department, restore our firm's reputation, and we will see you well rewarded. Fail in this, and...well." He sighs. "Mister Glover is a major client, with several billion dollars invested with our banking subsidiary. He found your long explanation of recent machine learning advancements tedious in the extreme, and has expressed his displeasure to us. I'm sure a successful quarter in Acquisitions will give us interesting objects to demonstrate and renew his pleasant relationship with the firm. Failing that, perhaps he would settle for the ability to express his displeasure upon you in a more personal fashion."
"Security will show you to your new desk." He gestures behind you, where two men each larger than the room's doorway have somehow managed to enter without making any noise. "Don't let me keep you, I'm sure you're anxious to get to work!"
DATA & OBJECTIVE
NOTE ON SOURCE MATERIAL
This scenario is based (per request from simon, winner of the PVP competition in an earlier scenario) on the SCP Foundation canon.
A few brief comments on what you should and should not assume to hold from that canon in this scenario:
I'll aim to post the ruleset and results on February 21st (giving one week and both weekends for players). If you find yourself wanting extra time, comment below and I can push these deadlines back.
Thank you to abstractapplic for providing feedback on a draft of this! For clarification, abstractapplic has no inside information on the scenario and is still free to play it.
As usual, working together is allowed, but for the sake of anyone who wants to work alone, please spoiler parts of your answers that contain information or questions about the dataset. Given that this scenario is SCP-canon-based, this rule is more important than usual.