In response to comment by ScottL on Wicked Problems
Comment author: Elo 20 August 2016 10:30:10PM -2 points [-]

this document agrees with my hypothesis about how to solve wicked problems. it says:

  1. Lock down the problem definition. Develop a description of a related problem that you can solve, and declare that to be the problem. Specify objective parameters by which to measure the solution’s success.
  2. Cast the problem as ‘just like’ a previous problem that has been solved. Ignore or filter out evidence that complicates the picture.
  3. Give up on trying to find a good solution. Just follow orders, do your job and try not to get in trouble.
  4. Declare that there are just a few possible solutions, and focus on selecting from among them. A specific way to do this is to frame the problem in ‘either/or’ terms, such as ‘Should we attack Iraq OR let the terrorists take over the world?’
In response to comment by Elo on Wicked Problems
Comment author: ScottL 31 August 2016 12:54:16AM 0 points [-]

Actually, if you read further the above is described as taming the problem, which is bad, and is not solving it.

Taming a wicked problem is a very natural and common way of coping with it. Instead of dealing with the full wickedness of the problem, people simplify it in various ways to make it more manageable and solvable

While it may seem appealing in the short run, attempting to tame a wicked problem will always fail in the long run. The problem will simply reassert itself, perhaps in a different guise, as if nothing had been done; or worse, the tame solution will exacerbate the problem.

For a further explanation, see this document

There is a variety of ways that organisations try to tame wicked problems by handling them too narrowly. The most common way is locking down the problem definition. This often involves addressing a sub-problem that can be solved. If the problem is how to reduce violence in schools, for example, policy makers may focus on the more tractable, narrow problem of how to install metal detectors in school entrances. Or, if the problem is obesity in children, the more tractable but narrow problem could be removing unhealthy food from school canteens.

If policy and performance measures are limited to the sub-problem rather than the wicked problem, the problem can appear solved at least in the short-term. If the performance measure is that school canteens no longer offer unhealthy foods, for example, this may be achievable. An unintended consequence and a reassertion of the wicked problem may be that more children no longer buy their lunch at school canteens but instead miss lunch, save their lunch money, and buy junk food at the shops on the way home from school. This is also a good example of how a tame solution can exacerbate the problem—some children may now eat more unhealthy food than they did previously, and they miss their lunch! It is also another illustration of the unintended consequences that can result from interventions to address wicked problems. Unintended consequences tend to occur even more frequently if the problem has been artificially tamed, that is, it has been too narrowly addressed and the multiple causes and interconnections not fully explored prior to measures being introduced. This does not mean that at some stage in the policy formulation process it will not be necessary to identify the components of the wicked problem and possible practical solutions as part of a comprehensive and coordinated set of measures to address the problem. Obviously, the type of food offered in school canteens is part of the solution to childhood obesity. But this fragmentation of the wicked problem would ideally occur after all the interconnections and social complexities have been identified, discussed and addressed as part of a coordinated strategy.

In response to Wicked Problems
Comment author: ScottL 16 August 2016 12:04:05PM 1 point [-]

Quotes from post and this: http://www.cognexus.org/Rotman-interview_SharedUnderstanding.pdf

It took me a while to realise what a wicked problem was. It is evil. It's a challenge.

"Wicked" in this context means resistance to resolution, rather than evil.

I looked to cooking. No two ingredients are the same. Even if you are cooking a thing for the 100th time, the factors of the day, the humidity, temperature, it's going to be different.

This doesn’t sound like a wicked problem to me. I think a more “wicked” problem would be something like where you have to create a meal for a whole hall full of people. Now, you want to make a meal that everyone will like and you have a limited amount of resources, so you can’t create separate meals for everyone, but some people might be vegetarians, some might have allergies, some might want one type of meal in particular etc. There is a social complexity aspect to this problem. You cannot come up with a best meal because there are different stakeholders with strongly-held beliefs about what the problem is.

As a current example there is global warming and energy policy where people from the developed world have one set of views about what needs to be done, and the developing world has a completely different set of views. Nobody ‘owns’ the problem and no-one has a clear idea of how to work out the answers


The problem is not understood until after the formulation of a solution.

This is less about quantifying things and more about how requirements change or are only realized after the solution of the problem or part of the problem is implemented. For example, let’s say you are renovating a house and there are 10 people involved. Every time you change something like a chair you need to check that it still aligns with everything else. You might need to go through many iterations of having to change and rechange things.

Every solution that is offered exposes new aspects of the problem, requiring further adjustments to the potential solutions. There is no definitive statement of ‘the problem’: these problems are ill-structured and feature an evolving set of interlocking issues and constraints.


Wicked problems have no stopping rule.

How do you make sufficient stopping rules when there are conflicts over what the problem is?

Since there is no definitive ‘the problem’, there is also no definitive ‘the solution.’ The problem-solving process ends when you run out of resources such as time, money or energy, not when an optimal solution emerges.


Every solution to a wicked problem is a 'one shot operation.'

Developing models, trying scenarios etc. all take effort and send you down a particular track in terms of the conception of the problem. I think that wicked problems are like the conglomeration of multiple problems or people's conception of the problem. Each time you try to move forward on one part of the problem you kind of entrench yourself in seeing the problem that particular way and it also spawns new problems directly related to only that one conception of the problem.

Every attempt has consequences. This is the ‘Catch 22’ of wicked problems: you can’t learn about the problem without trying solutions, but every solution is expensive and has lasting consequences that may spawn new wicked problems.


Wicked problems have no given alternative solutions.

A host of potential solutions may be devised, but another host that are never even thought of. Thus it is a matter of creativity to devise potential solutions, and a matter of judgement to determine which should be pursued and implemented.

Comment author: ScottL 17 July 2016 03:33:15AM 1 point [-]

For rationality related concepts, see this page

Comment author: ScottL 25 May 2016 01:31:23PM *  3 points [-]

Yet how is a lichen 'more than the sum of fungus and alga'?

I don't know anything about lichen, but the below is what I assume "more than the sum of" in this context means:

"The symbiosis between the mycobiont and the photobiont creates an organism that is more than the sum of its parts, in other words, a lichen is an emergent property. Lets take a step back to examine this statement. On the one hand, neither the photobiont nor the mycobiont can withstand intense UV radiation, dessication, or extreme temperatures. But on the other hand, when the photobiont and mycobiont work together within the context of the lichen symbiosis, they create an organism that can withstand living in outer space – thats more extreme temperature and radiation (not to mention vacuum exposure) than is experienced on Earth! Lichen can even grow within rocks (endolithic lichen)! These are conditions that would kill a fungus or algae."

In response to comment by ScottL on May Outreach Thread
Comment author: Viliam 13 May 2016 02:04:13PM *  0 points [-]

Yeah, properly done, this would be a lot of text.

My wish is to create rationalist communities which are emotionally healthy, capable of action, and successful in life. So the content of the book would be "all knowledge that is important for wannabe rationalists to become this kind of community". But I suspect that it would be a lot of material; not just to give people the necessary skills, but also to combat existing myths.

By emotionally healthy I mean that the group wouldn't fall apart immediately because of some inconsequential squabble, but also wouldn't become some kind of a cult. That the people inside the group would be happy and would achieve their personal dreams, and the people outside of the group would be mostly positively impressed. That the group as a whole and its individuals would be rational, but not suffering from akrasia.

When you look at the existing Sequences, you see that Eliezer not only spends a lot of time arguing against supernatural stuff, but he also needs to turn around and argue against the overenthusiastic "fans of evolution", and explain that actually evolution is stupid, it can lead to extinction, and the group selectionism mostly doesn't work. I expect that the similar kind of hedging both ways would also be necessary for this topic. That people often try to avoid an extreme by running into the opposite extreme -- "if I agree with everything, it means I am a sheep; therefore I will disagree with everything" or "acting without thinking is stupid; therefore I will always think and never act" or "people often disregard their own reason because they want to fit in the group; therefore I need to be abrasive and cynical about everything" -- and it will be necessary not only to navigate them properly, but also make them notice when someone else promotes an extreme form of behavior.

I agree that the palette of the most frequent social/emotional mistakes is probably wider that the palette of the most frequent cognitive errors. But people are less unique than they imagine. For example, read Games People Play -- this book describes about a dozen patterns of dysfunctional human interaction, and most people are shocked to find their own story described there. A therapist or a religious confessor probably mostly hears the same few stories over and over again. Also, Games People Play after each pattern contains an advice "what to do if you find youself stuck in this pattern".

Something like this?

In that direction, yeah. The guide contains a lot of dense "do this, do that, don't do this, don't do that", which I get is compressed to make a long text short, but I would like to read the longer version with explanations and stories that would make it easier to memorize. (Reading all the recommended literature on the last page would probably do it.) Also, the guide is about making a successful meetup, which is a great thing, but "meetup" still feels to me like "inside the lab", and I would like something that goes beyond the time and space limitations of the meetup. Similarly how the Sequences are not about "how to think rationally during a meetup", but how to think rationally in general.

Well, there are still some things I am not sure about, so... that's one of the reasons why I am not trying to write that text myself right now. I don't see exactly how the things are connected. I never was a community leader, so this would be outside my experience. There are still skills that I don't have, and problems that I can't solve even theoretically. (For example one of my big concerns is that I think that successful groups sooner or later attract psychopaths who will try to get into positions of power and exploit the whole thing for themselves. No idea how to prevent this, though. I think I have a heuristic for detecting that it already happened: it's when people are afraid to speak openly with each other; but that is too late, if your goal is to prevent that thing from happening in the first place. I suspect that some of the seemingly irrational traditional rituals, such as "getting drunk together" could actually have been designed for this purpose; but maybe I'm completely wrong.)

In response to comment by Viliam on May Outreach Thread
Comment author: ScottL 13 May 2016 04:25:03PM 0 points [-]

My wish is to create rationalist communities which are emotionally healthy, capable of action, and successful in life. […] Similarly how the Sequences are not about "how to think rationally during a meetup", but how to think rationally in general.

Is your wish actually to create rationalist communities which are emotionally healthy, capable of action, and successful in life so that you can become these things?

That people often try to avoid an extreme by running into the opposite extreme […] and it will be necessary not only to navigate them properly, but also make them notice when someone else promotes an extreme form of behavior.

I think the problem here is that the underlying problem that caused these people to take on an extreme view in the first place is still there and so when they do change their view they just tend to adopt another similarly extreme view. For example you mentioned PUA before; I have noticed that there are some men who have a strong level of neediness and so become ‘nice guys’ in the worst sense. They then read some of the PUA stuff and instead of doing good things like: developing genuine confidence, self-respect, a healthy sense of boundaries etc. they take a shortcut. They just change their perspective on women. The neediness is still there, however, and so they adopt a view where they objectify women. They essentially become ‘assholes’. In both the ‘asshole’ and the ‘nice guy’ cases there is a sense in which these people are giving up or altering part of who they are. This is what I think these people would actually need to solve if they were going to make an improvement in their situation.

But people are less unique than they imagine. For example, read Games People Play -- this book describes about a dozen patterns of dysfunctional human interaction, and most people are shocked to find their own story described there.

That’s probably true, but I was trying to say that unlike with cognitive errors, which most people can relate to, most people would only be able to relate to a few of the games and would find the others to be largely irrelevant for them.

one of my big concerns is that I think that successful groups sooner or later attract psychopaths who will try to get into positions of power and exploit the whole thing for themselves. No idea how to prevent this

I would expect that any group like the one you propose would have a very flat hierarchy of power. In fact, if people become dependent on the group or find themselves seeming to need the group to improve then the group probably isn’t working too well. You reduce dependency by maximizing the free exchange of information and the ability for people to improve outside of the group.

Comment author: Viliam 10 May 2016 09:01:56PM 1 point [-]

Something like that, yeah, but instead of reading one full book, I would prefer reading a compilation of the important ideas from multiple books of multiple authors.

Similarly to how e.g. one LW post tells you about the concept of "belief in belief" instead of giving you a link to a several hundred pages long book from Dennett. Most of the Sequences could be replaced by a list of 20 or 50 books to read, and they would certainly provide much more information, but reading all those books would take me a few years, while the whole Sequences can be read in a month or two. And if I want to communicate the whole thing to someone else, giving them one e-book is better than telling them to read 20 or 50 books.

Just like that, I would like to see 10 or 20 books on human social behavior compiled into a single book (of course, with links to the original sources for those who want to read more). To have the option of giving someone one book and saying: "This is the kind of community I want to create; would you like to join?"

It is also important (I haven't read the specific book you linked, so I am not sure if this applies) to have some ideas actionable.

To explain what I mean, think about books like "Predictably Irrational" which contain the information that human behavior is often wrong, but all you get from them is the idea "humans are stupid". Possibly true, but it doesn't help you become stronger. On the other hand, in the Sequences there is often a hint towards a strategy that could reduce a specific bias. Because the spirit of LW is not pointing fingers towards others and laughing, but looking at the mirror and thinking strategically.

Then of course there is the whole PUA industry that tries to be actionable, and that specific aspect I admire, but they are horrible from the epistemic point of view: "schools proliferating without evidence", overgeneralizations, confirmation bias, etc. What I'd like to see is someone who gives a correct explanation, supported by science, and then a few actionable ideas for people who want to improve themselves. Focusing on general human interaction (not just seeking one-night stands in loud pubs), considering also long-term consequences. But then I'd like to see people taking those ideas seriously.

Another important part would be debunking the existing myths; e.g. showing that human morality is more then mere cooperation in iterated prisoners' dilemmas (why do tourists tip in foreign restaurants even if they are unlikely to ever return there again?).

A few books that come to my mind are "The Theory of Moral Sentiments", "The Mating Mind", "Nonviolent Communication", "Games Prople Play", "Creating a Life Together", maybe even "Don't Shoot the Dog". I probably forgot something important.

In response to comment by Viliam on May Outreach Thread
Comment author: ScottL 12 May 2016 01:38:48PM 2 points [-]

I have an idea about a sequence I would love to see, but only if it is written well (because it would be very easy and tempting!!! to make it wrong in various ways): Starting with scientifically describing human emotions, social behavior, and sexual behavior.

This seems way too broad. If it was done right, I don’t think it would end up being a single sequence.

How much have you looked into this already and do have any more concrete ideas on where you would want the sequence to go?

Progressing to social skills.

I think there are two main problems with trying to do a sequence on this:

  • I think that the problems that people have with social skills are more individualistic than the heuristics and biases that are normally discussed on this site. They are largely due to ingrained perspectival and strategical problems, which are in constrast, to say, the representativeness heuristic which we can all relate to. A consequence of this is that most people are going to find a lot of the content to not be applicable for them. I would guess that this problem could be overcome by creating more of a debug guide like if you have problems expressing yourself go to post 3 or you could also go meta and let people realize their own problems.
  • As you mention, it is important: “to have some ideas actionable”, but I think it is also especially important for these type of skills that they be easily able to be put into action and that there are opportunities available to easily put them into action. In this area, I would think that most of the ideas that would make an impact in people lives are not going to seem particularly insightful or revolutionary, in fact, they may at first appear to be incredibly obvious. It is only when they are put into practice that people come to recognize their importance. I would think that simulation of these skills is not as useful or as interesting as it is for the other content on this site.

And culminating with community building.

Something like this?

Comment author: Gyrodiot 05 April 2016 01:17:36PM *  1 point [-]

(meta: I'm not sure if I should make a Discussion post for this, so I'm posting here. Feedback most welcome)

I'm exploring the following hypothesis : sometimes, you have to give up constructive actions for the sake of focus.

Most productivity methods suggest the obvious, to keep wasteful activities in check. It could be gaming, chatting, checking news websites. They all share a common trait: you don't gain any significant utility (nor money, nor fun, nor rest) for spending more time on it. You achieve the same result by spending a little time on it, rather than a full day.

With productive activites, time spent and value created aren't proportional. Sometimes you're lacking energy, inspiration, and it's okay: you don't have to work yourself ragged.

If you have multiple tasks to be achieved in parallel, you should treat them as sequential anyway. Focusing on one task at a time yields better results than task switching all the time.

Problems arise when you find inspiration, or a sudden peak of interest for a certain task which is, useful in isolation, but which doesn't fit in your schedule. Maybe a discussion with a friend sparked the idea of a story to write. Maybe you're considering moving some furniture because you're well-rested and full of energy.

Even if you could be maximally productive for a given useful task, you should treat it as a wasteful activity if you have something else you planned to do. If the idea sounds good, write it down. If it's really good, hype will come back another time. If you're energetic, do the most physical thing you had planned to do. Energy will come back another time.

The goal is not to add another task on your current schedule and mess with the plan you've set for the day, like you'd do with "classical" wasteful activities. You can convince yourself easily that news websites can wait another day. The unintuitive part is this also holds with most productive activities, even though you're training yourself to not defer work!

Comment author: ScottL 07 April 2016 11:56:10AM *  0 points [-]

I'm exploring the following hypothesis : sometimes, you have to give up constructive actions for the sake of focus.

I would try to make the hypothesis a bit more concrete. Something like: flow, immersion and engagement are all important factors in productivity. An implication of this is: (your hypothesis here). You should of course look at the literature and explain what flow, engagement etc. is and how it relates to productivity.

If you want this to be interesting, then you should probably also try to find some implications that people normally don't think about because they're not strategic. Maybe, things like that you should: remove clutter, have the right perspective, exercise, practice, gamify things, learn how to beat akrasia, learn when its a good idea to relax etc.

The cfar class called turbo charging training which I described here seems to be related to your hypothesis . The underlying idea of it is the rule of intensity which states that the experience of intensity or effort that you are expending to learn something corresponds with the rate at which you are learning it.

Comment author: Lumifer 06 April 2016 07:19:00PM *  2 points [-]

At some point the Internet decided it didn't feel like using a standard protocol for discussion anymore

That's an interesting point. What are the reasons NNTP and Usenet got essentially discarded? Are some of these reasons good ones?

Comment author: ScottL 07 April 2016 02:31:13AM 3 points [-]

This from here seems pretty accurate for Usenet:

Binary groups being a great big cost sink would be the main thing.

The store and forward protocol required quite some disk space at the time.

The network relied on "control" messages to create/delete groups automatically (as opposed to manual subscription), which due to the lack of authentication/encryption in the protocol, were very easy to spoof. A gpg-signing mechanism was later put into place, so that nodes peering with each other could establish a chain of trust by themselves. This was pretty nice in retrospect (and awesome by today standards), but the main problem is that creating new groups was a slow and painful approval-based process: people often wanted small groups just for themselves, and mailing lists offered the "same" without any approval required.

Having a large open network started to become a big attractor for SPAM, and managing SPAM in a P2P network without authentication is a harder problem to solve than a locally managed mailing list.

running a local server became so easy and cheap, that running mailing list offered local control and almost zero overhead. People that had niche groups started to create mailing lists with open access, and people migrated in flock. Why share your discussions in comp.programming.functional where you could create a mailing list just for your new fancy language? (it's pretty sad, because I loved the breadth of the discussions). Discussions on general groups became less frequent as most of the interesting ones were on dedicated mailing lists. The trend worsened significantly as forums started to appear, which lowered the barrier to entry to people that didn't know how to use a mail client properly.

For NNTP for LessWrong, I would think that we have to also take into account that people want to control how their content is displayed/styled. Their own separate blogs easily allow this.

Comment author: Lumifer 06 April 2016 03:40:43PM 1 point [-]

We are facing similar problems now. A lot of people have their own sites where they host their own content.

The solution to reading all that content is RSS. The solution to, basically, cross-linking comments haven't been devised yet, I think.

websites could be created that act like views in a database. They would show only the content from a particular group or author.

So, that's Reddit with more freedom to set up custom CSS for subreddits? Or there are deeper differences?

Comment author: ScottL 07 April 2016 01:29:58AM 2 points [-]

As far as I see it, there are 2 basic classes of solutions.

The first type of solution is something like reddit or Facebook's newsfeed which involves two concepts: linkposts which are links to or cross posts of outside content and normal posts which are hosted by the site itself. Making use of RSS or ATOM can automate the link posts.

The second type of solution is something like the Blogger API with extended functionality to allow you to access any content that has been posted using the API. Other things it would include would be, for example, the ability the list top pages based on some ranking system.

In the first type of solution, LessWrong.com is a hub that provides links to or copies of outside content. Smooth integration of the comments and content hosted outside of this site would, I think, be hard to do. Searching of the linked content and handling permissions for it nicely would be difficult as well.

In the second type of solution LessWrong.com is just another site in the LessWrong Sphere. The functionality of all the sites in this sphere would be driven by the API. You post and retrieve using the API which means that all posts and comments regardless of their origination sites can be available globally. Creating a prototype for this type of solution shouldn't be too hard either which is good.

So, that's Reddit with more freedom to set up custom CSS for subreddits? Or there are deeper differences?

The deeper difference is the elimination of linkposts. All content posted using the API can be retrieved using the API. It is not linked to. It is pulled from the one source using the API.

Comment author: ScottL 06 April 2016 06:12:35AM *  2 points [-]

Is this a good summary of your argument?

NNTP was a great solution to a lot of the problems caused by mailing lists. The main ones being:

  • content duplication - mailing lists are bad because everyone gets their own copy of each article.
  • reduced content accessibility - mailing lists suck because you miss out on great articles if they were sent before you were part of the mailing list.

We are facing similar problems now. A lot of people have their own sites where they host their own content. We either miss out on great content if we don't trawl through a ton of different sites or we try to make lesswrong a central source for content and face problems with:

  • content duplication - through needing to cross post content (essentially duplicating it)
  • harder content accessibility - the alternative to cross posting is providing a link, but this is an annoying solution that can be jarring as you need to go to an entirely different site to access the content you want.

NNTP would solve the problems we have now in a similar way to how it solved the problems with mailing lists. That is, it would provide a central repository for content and a way to access this content.


I am currently thinking that the best way to think about the last point is that it means that we should set up a Web API similar to the Blogger Web API. Discussing NNTP, at least to me, is making the solution appear a lot more complicated than it needs to be. Although, I don't know much about NNTP, so I could be overlooking something very important and am interested about what your future posts will explore.

With a Less Wrong Web API, websites could be created that act like views in a database. They would show only the content from a particular group or author. This content would, of course, be styled according to the style rules on the website.

These websites could be free, dns name and web development costs aside, using services like github pages. This is because there should be no need for a back-end as the content and user information is all hosted on Less Wrong. You post, retrieve content and vote using the API. It should also be fairly easy to create more complicated websites that could aggregate and show posts based on user preferences or even to create mobile applications.

View more: Next