All of halinaeth's Comments + Replies

So grateful to Ben, Aella, and Ronny for hosting and for all the people with whom I had lively debates with this past Saturday! Like Matt it was my first in person rat event, and I really enjoyed meeting everyone and seeing how open everyone is to friendly debate and probing questions.

I really hope these meetups continue- happy to help & support to help make it possible.

Thanks again everyone, cheers to many fun connections to come in 2025!

Even things like biological limits which turned out to be mental (the idea a 4 minute mile was impossible, for instance). 

I wonder if we just told people the problem was solved, and ask them to find the solution, would the mere fact of confidence there is a solution lead to greater chances of finding a solution? I remember the story of the mathematician to which this exact thing happened (he accidentally was assigned a famous unsolved problem as homework, and solved it). 

Someone feel free to correct if that was a myth or a real incident.

Reminds me of how @visakanv (on X) said he's very happy with a day's work if he got in 3-4 hours of good solid work. And how over the timescale of years, it compounds much more than anyone would believe. 

Definitely gives me optimism, and appreciate the two definitions of "impossible" you've outlined too.

Fascinating post, like a version of prions on an orthogonal axis, but with way more possibility to expand. 

Wonder if other fields have a version of this, where by inverting or adjusting a basic principle you unlock a whole field as rich and diverse as the original. Perhaps imaginary numbers are analogous?

I'd love to, would you be open to being a "beta reader" for my post? Appreciate the encouragement!

Loved reading this! Suspected the premise based on title, but nevertheless great to see the premise fleshed out in a short story. And the pov “plot twist” was really fun, thanks for the thought experiment!

Comments have great nuance i.e. "systems/processes greatly expand word count". 

But I'd say assuming lack of system & a randomly selected audience, the author's point stands. After all, in media there's a reason they value "sound bites" so much- and those are more like 5 syllables. 

Think, "grab em by the ****" and "nasty woman" from the 2016 election.

Would love to be corrected though!

Makes me think of the concept of "reality distortion fields" as it applies to overconfidence in leaders (I read about this applied to Steve Jobs specifically- his ability to get people to also believe in & work towards the impossible). 

Does anyone have the link to what I'm referring to? But overall, I do believe charisma has a lot to do with letting go of the need to have an accurate "map" of yourself and your strengths/shortcomings. 

Excellent summary! Would be interested in a list of corollaries to this, i.e.:

a) If "condemned" X is necessary for "prestigious" Y, people with Y will mislead and lie to the public about how they achieved Y, despite wanting others to attain success at Y too. Furthermore, the narrative of their path to achieving Y without anything to do with X will be extremely uniform & coordinated despite any huge differences amongst people with Y. For example, some Y people have X, some don't, some hope for others to attain Y, some don't- but the "public narrative" a... (read more)

Jimmy phrased it really well- the "lizardmen" don't want to let anyone know precisely because they won't be perceived by you as rational/moral humans as you would've without knowing, but rather "lizardmen". 

"how one might ever become justifiably confident a particular piece of dark matter really doesn't exist or is as rare as you'd suspect it is" - as someone in a "lizardman" community myself (commented regarding my own experience), probably one of the only ways to know for sure is to join as a lizardman. Any other way, you'll be inundated with misinf... (read more)

Okay hopefully the layering worked to hide the answer- 

The X I was talking about is being extremely thin- model thin. And the social dark matter is "anorexia".

I've always wanted to be model-thin, and slender women online would say to eat healthy, moderate portions, exercise, drink water, don't starve or be unhealthy, etc. And emphasize to avoid eating disorder behaviors (putting big red stop signs around even the borders of ED territory!) because during the height of the "fat acceptance" movement anyone even giving weight loss advice would get ED accu... (read more)

(did you guess & comment X?)

5halinaeth
Okay hopefully the layering worked to hide the answer-  The X I was talking about is being extremely thin- model thin. And the social dark matter is "anorexia". I've always wanted to be model-thin, and slender women online would say to eat healthy, moderate portions, exercise, drink water, don't starve or be unhealthy, etc. And emphasize to avoid eating disorder behaviors (putting big red stop signs around even the borders of ED territory!) because during the height of the "fat acceptance" movement anyone even giving weight loss advice would get ED accusations thrown at them- which would then often get them deplatformed, demonetized, etc. It's only once I got fed up never reaching my goal weight, that I decided "eff it" and crossed the huge red stop signs into ED forums to see what they spoke about. And since then I've made rapid progress & easily broke past barriers I'd never been able to in 10+ years to listening to "mainstream" advice. In this "social dark matter" community, everyone talks about doing everything they can to hide the truth from their friends & family, and plan what lies they can say to maintain the image of natural or effortless thinness. I've never suspected anyone I knew of EDs in the past, but now I see several people who say things straight out of the "playbook"- it's like a united "public narrative" of what people can say if accused of EDs or anorexia. As with your "law of extremity", people immediately think "eating disorder" means you look like a wartime victim on the brink of death. But really most women in that community have society's "perfect" body type.  (I have so much to say on how my mindset and understanding of the "map" of weight loss changed after unlocking the secret community I was told to avoid at all costs, but unsure if anyone would be interested given this forum's likely male majority.) Anyways, this experience made me rather skeptical of instances where all people of X prestigious trait claim the same story about how

(open if you've guessed X already)

1halinaeth
(did you guess & comment X?)

Love how you named this "Social Dark Matter", I recently came across an instance of this that you didn't mention

It came in the form of "group of people prestigious in X way". I really wanted to join that group with X trait, and so studied what "X people" had to say about how they got that way & their journey, advice, pitfalls to avoid, etc. Only after 10+ years did I stumble across the fact that almost all people with the highest X actually attained it through going deep into the very "pitfall" they advised to steer clear of. But because of the ... (read more)

1halinaeth
(open if you've guessed X already)

Wow, this part really resonated with me:

This is why "build a 10% better mousetrap" is a legitimate goal, but "build a 10% better web portal for artists" is not. The 10% improvement means nothing if the community accuses you of being a greedy selfish bastard who only cares about money and not about art, and they blacklist you and everyone who cooperates with you. And yes, if you understand how the game is played, the initiators of the backlash are those who profit from the existing system. But you can't say this out loud; it would only prove that you care a... (read more)

3Viliam
Well, if you figure out something, I would be happy to read a post about it. I usually understand these things only after it is too late to do something about it. Would be nice to get faster at understanding it.

This is so fascinating! Your "competent villain" example definitely resonates with me- I also had to learn the hard way to be assertive when it comes to tiny things like domain ownership which could have huge power dynamic impacts down the line.

Yeah. To your founder point, it's very very possible as they are VC backed and even the VCs' interests aren't very well aligned with the community.

In terms of coup, given VC backed nature + other factors it's nearly impossible to take over. But a ideological split/fork might certainly be possible!

Now I'm curious as ... (read more)

4Viliam
In my experience, I only remember one example of a successful "coup". It was a private company that started small, and then became wildly successful. Two key employees were savvy enough to realize that this is not necessary a good news for them. The founders, those will definitely become rich. But a rich company will hire more employees, which means that a relative importance of each one of them will decrease. And the position of the founders towards those two will probably become something like: "okay guys, you spent a decade working hard to make all of this happen, but... you got your salaries, so we don't owe you anything; what have you done for us recently?". So those two guys joined forces and together blackmailed the founders: "either you make both of us co-owners, right now, or we both quit". And the company couldn't afford to lose them, because one of them wrote like 90% of the code used by the company, and the other had all the domain expertise the company needed. (Now imagine how different the power balance could be one year later, if the company had maybe three new employees understanding the code, and three more employees to learn the domain knowledge.) So the original founders grudgingly accepted the deal. I think there were some symbolic concessions like "but we have spent our money to build this company, so you will have to pay that part back from your future profits", but that was completely unimportant, because until now the company was small, and soon it became huge and rich, so the money was probably paid back in a few months, and the two guys are millionaires now. (More generally, I get the impression that early employees in companies often get a bad deal, because first they are told "the company is still small, it may not even survive, so you need to work harder and we can't afford to pay you better... but think about the bright future if the company succeeds", and then it turns out that the future is bright for the owners, and the burned out

Ah, good point! Over a long enough time period, not promising anything denies you the opportunity to showcase that you have a low "breaking promises" rate- hadn't factored that into the false negative/positive scenarios.

I see, these are great examples "destruction paths", thank you! What I'm hearing is essentially:

- in communities which gain prestige, infighting which causes collapse
- members dying out over time

I think these are different than what I'm observing in my community. Thinking about it, two patterns jump to mind:

- as our community gained prestige, members would start tearing down or attacking "rival" communities to gain in-group points. But this gives us a bad reputation & deters new members from wanting to join, so community doesn't gain "new blood" and ca... (read more)

3Viliam
Yes. A bit more cynically, sometimes you have a community with no infighting and you think "that's because we are nice people", but the right answer happens to be "that's because infighting isn't profitable yet". And I think this is much more likely to happen over money rather than prestige; prestige is just a possible way to get funding. Prestige itself is less fungible and less zero-sum. For example, imagine that the two of us would start an artistic web project together: we buy a web domain, install some web publishing software, and then each of us posts two or three nice pictures each week. We keep doing it for a few months, and we acquire a group of fans. And suppose that I happen to be the one of us who has the admin password to the software, and also the web domain is registered to my name. It didn't seem important at the beginning; we didn't expect our relationship to go bad, we probably didn't really even expect the project to succeed, and I just happened to be the person with better tech skills or maybe just more free time at the moment. Anyway, the situation is such that I could remove you from the project by clicking a button, should I choose to do so. At first, you just never thought about it, and probably neither did I. (Though it seems to me that some people have the right instincts, and always try to get this kind of a role, just in case.) So, I could remove you by a click of a button, but why would I do that? I am happy to have a partner. A website with twice as many pictures is more likely to get popular. The effect is probably superlinear, because posting a picture every day will make the fans develop a habit to check out website the first thing every morning. Also, we have slightly different styles; some fans prefer my art, some prefer your art. And if I kicked you out, you could just start your own website, and your fans would follow you there. Three years later, we get so popular that some art grant agency notices us, and decides to give us

Yes to both! The lying model is great to have especially on the internet where everyone trolls for fun. But to Nathan's point especially as cost of intellectual labor goes to zero, the net benefits of investigating these cases would keep increasing. Seems worth a try to find some obscure low hanging fruit!

 

True or not, wouldn't you say the idea it illustrates is sound? No matter how small a percentage of the time, a nonzero number of people claiming ridiculous things are telling the truth (just framing it in a ridiculous way with wrong correlations).

If as a society we investigated these cases more often instead of dismissing them, would it lead to a net positive for humanity? For example, if everyone heard "drinking mud soup in this specific part of the world consistently cures X affliction", and dismissed it- wouldn't most pharmaceutical companies not have ... (read more)

If investigating things was was free, sure. But the reason we don't investigate things is that doing so takes time, and the expected value of finding something novel is often lower than the expected cost of an investigation. To make it concrete, the story as presented is an insane way to run a company and would result in spending an enormous number of engineer hours on wild goose chases. If I as the CEO found out a middle manager was sending out engineers on four day assignments to everyone who writes us a crazy-sounding letter, I would tell him to immedia... (read more)

Love this example! 

Reminds me of the "haunted apartment" case in Korea, where dogs kept going insane near a certain spot by the entrance of the apartment complex, and eventually investigators realized there was a malfunction that caused an electric current on the entrance floor, which the dogs' paws could feel but humans with shoes couldn't detect.

I wonder what other phenomena we're too quick to dismiss because they're framed in a way that sounds absurd.

How to Poison the Water?

I think we've all heard the saying about the fish and the water (the joke goes, and old fish asks young fish about the water, and the the young fish ask "what's water?).

I'm curious the key failure modes or methods that tend to "poison the water", or destroy/alter an organization/scene's culture or norms negatively. Are there major patterns that communities tend to fall into as they self destruct? 

Would love for anyone to share resources or general reflections on this- I'm currently part of a (unrelated) community where I see th... (read more)

9Viliam
No idea whether this applies to your community, but a pattern I have noticed is that when the community is small and faces existential threats, people stick together, but when the community becomes successful, high status members start to fight against each other, which sometimes leads to a collapse of the community. It's because when the community is successful, infighting becomes more profitable. In context of business, I don't know whether this is actually supported by statistics, but a friend who is an entrepreneur told me that he knows a few examples of companies where the founders cooperated as best friends and worked hard for a few years to make the company profitable... and when the company was ready to make its first million, suddenly each founder was like: "wait a moment, why should I split all that money with these guys? if I could somehow get rid of them and replace them by employees, I could pay the employees peanuts and keep the million for myself!" (But maybe that's a cultural thing in Slovakia, dunno.) I have seen similar things in art. People working together to start an art journal, or an artistic competition, doing their best to gain some recognition (and grant money), and once the recognition and the grant money is there, three members conspire to kick out the fourth one, then two of them conspire to get rid of the third, etc. The project usually survives (the artistic grants are probably not very flexible; it is difficult to get them, but once you do, they probably stay for a long time), but becomes completely static, as the remaining person or a very small group of people are unable to make it grow, and probably have no motivation to do so; they just extract the rent (in money and prestige). Another way for a community to fall apart is to be taken over by another. Could be a culture war, but could be simply another hobby. First you have a group that does X. Then new people join who like X but also Y. At first no one sees a problem, or the fi

This example is super helpful! When people might take your information and act on it as assurance aka a "promise", you should stick to purely "information" style phrasing or be vague to avoid "promising".

Can you think of any instance where a "false negative" has been an issue, i.e. where people take an assurance as information, and that caused problems? Or is the main failure mode to look out for the "false positive"?

4Gordon Seidoh Worley
I can't think of a time where such false negatives were a real problem. False positives, in this case, are much more costly, even if the only cost is reputation. If you never promise anything that could be a problem. Same if you make promises but no one believes them. Being able to make commitments is sometimes really useful, so you need to at least keep live the ability to make and hit commitments so you can use them when needed.

This a super helpful framework, thank you! 

How often would you say to stare at the abyss regarding job/career trajectory in general? Is annually too often? And how can you tell if your failure mode is staring too often vs not enough (staying somewhere too long vs not investing enough time to succeed)?

In general, if you're not happy with your level of success/achievement in life thus far and have tried several paths (about a year each), would you say generally one should keep pivoting each year? In other words, generally if you're not happy with the ve... (read more)

Makes sense, thanks for the new vocab term!

Hi! New to the forums and excited to keep reading. 

Bit of a meta-question: given proliferation of LLM-powered bots in social media like twitter etc, do the LW mods/team have any concerns about AI-generated content becoming an issue here in a more targeted way?

For a more benign example, say one wanted to create multiple "personas" here to test how others react. They could create three accounts, and respond to posts always with all three accounts- one with a "disagreeable" persona, one neutral, and one "agreeable".

A malicious example would be if someone

... (read more)
5Screwtape
Not a member of the LessWrong team, but historically the site had a lot of sockpuppetting problems that they (as far as I know) solidly fixed and keep an eye out for.

Thank you for this detailed process outline! I've been wanting to "learn by writing" for quite a while now (inspired by PG essays actually), yet never took the time out thus far. Your outline is extremely helpful to cut down time wondering "is my process any good/how will I learn through writing", and go straight to the learning (and writing)!

Regarding step 8 "get[ing] to the point where I can no longer easily tear apart my own hypothesis", I'm curious what your level of "Openness" is in your Big 5 personality traits. As someone with nearly off the charts ... (read more)

Thanks for linking these! Found my next reading list :)

Good point about how LLMs making "brain dumping" on a computer very different than before. 

I can see how your proposal might be helpful for heads of nation states/billionaires/CEOs who worry about espionage, but for the average person writing in a journal & storing it in a safe place seems sufficient, no?

Even for myself, I'd probably write all my non-journaling notes (those I'd like to be able to search & organize & refer to later) in one of the usual solutions (notes app, maybe Google drive for more organization). Even if all my notes wer... (read more)

Thank you! So much to explore :))

Found this site when I was a kid (hi HPMOR) & realized it wasn't all a fever dream when I got onto X a decade later! Really excited to read through posts, learn new things, and hopefully build a thinking-deeply-through-writing habit myself.

3habryka
Welcome! Hope you have a good time here.