V_V comments on Leaving LessWrong for a more rational life - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (268)
How do they measure whether they are actually making people more rational?
There are hundreds, maybe thousands self-help/personal development groups in the world. From the secular ones (e.g. Landmark, which is in some ways the spiritual ancestor of CFAR), to traditional religions, to mumbo jumbo new age stuff. From the "outside view", how can I distinguish CFAR from these ones?
I think they did a bit of polling but I'm no good person to speak about the details. I haven't attended one of their courses yet.
A core difference is that CFAR intends to publish papers in the future that show effectiveness of techniques. The others that you listed don't. I also understand that doing work to getting techniques into a form were you can test them well in a study takes time.
In a lot of New Age frameworks there the belief that everything happens as it's supposed to be. If a person get's ill the day after a workshop, it's because they are processing negative emotions or karma. You can't do any science when you assume that any possible outcome of an experiment is by definition a good outcome and the challenge is about trusting that it's a good outcome.
The importance of trusting the process is also a core feature of traditional religion. If your prayer doesn't seem to be working, it's just because you don't understand how god moves in mysterious ways. Trust isn't inherently bad but it prevents scientific learning.
I don't know Landmarks position on trust and skepticism.
Landmark does practices like creating an expectation that participants invite guests to the Evening Session that I'm uncomfortable with. The might be effective recruiting tools but they feel culty.
Is it correct to compare CFAR with religions and mumbo jumbo? Most of self-help on the Web is crap exactly because they don't have even minimally good epistemology. I'd automatically trust CFAR more simply because they're standing on rationalist basis, which is a massive step forward. It's just this massive step forward not enough to start doing impact. It's more correct, I think, to compare CFAR with current research in CBT.
I think it is. CFAR could be just a more sophisticated type of mumbo jumbo tailored to appeal materialists. Just because they are not talking about gods or universal quantum consciousness it doesn't mean that their approach is any more grounded in evidence.
Maybe it is, but I would like to see some replicable study about it. I'm not going to give them a free pass because they display the correct tribal insignia.
This comment confuses the heck out of me. Of course that's not why their approach is any more grounded in evidence, the fact that the particular brand of self-help they're peddling is specifically about rationality which is itself to a large degree about what is grounded in evidence is why the methods they're promoting are grounded in evidence.
What are you looking for, exactly? The cognitive biases that CFAR teaches about and tries to help mitigate have been well known in social psychology and cognitive science for decades.
If you're worried that trying to tackle these kinds of biases could actually makes things worse, then yes, we know that knowing about biases can hurt people, and obviously that's something CFAR tries to avoid. If you're worried that trying to improve rationality isn't actually a particularly effective form of self-help, then yes, we know that extreme rationality isn't that great, and trying to find improvements that result in real practical benefits is part of what CFAR tries to do. But the fact that they're specifically approaching areas of self-improvement that come from well documented to be genuinely real-world phenomena like cognitive biases makes them clearly significantly different to those that are centred around less sound ideas, for example, gods or universal quantum consciousness. Or at least, I would have thought so anyway.
I think what V_V is saying is: show me the evidence.
Show me the evidence that CFAR workshop participants make better decisions after the workshop than they do before.
Show me the evidence that the impact of CFAR instruction has higher expected humanitarian benefit dollar-for-dollar than an equivalent donation to SENS, or pick-your-favorite-charity.
I don't think they do, but I don't think we were comparing CFAR to SENS or other effective altruist endorsed charities, I was contesting the claim that CFAR was comparable to religions and mumbo jumbo:
I mean, they're literally basing their curricula on cognitive science. If you look at their FAQ, they give examples of the kinds of scientifically grounded, evidence based methods they use for improving rationality:
So I just don't know where someone can be coming from when they suggest that CFAR's methods are comparably grounded in evidence to religion and mumbo jumbo, when they're literally grounding their methods on evidence as a rule and religion and mumbo jumbo are grounded on other things, like universal quantum consciousness and gods.
It's also well known in cognitive science that mitigating biases is hard. Having studies that prove that CFAR interventions work is important for the long term.
Keith Stanovich (who's a CFAR advisor) got a million dollar (or $999,376 to be exact) from the John Templeton Foundation to create a rationality quotient test that measures rationality in the same way we have tests for IQ.
If CFAR workshops work to increase the rationality of their participants, that score should go up.
The fact that you try doesn't mean that you succeed and various people in the personal development field also try to find improvements that result in real practical benefits.
In Willpower psychology professor Roy Baumeister makes the argument that the God idea is useful for raising Willpower. Mormons have been found to look healtier.
That is an extremely misleading sentence. CFAR cannot give Stanovich's test to their students because the test does not yet exist.
It's only misleading if you take it out of context.
I do argue in this thread that CFAR is a promising organisation. I didn't say that CFAR is bad because they haven't provided this proof.
I wanted to illustrate that meaningful proof of effectiveness is possible and should happen in the next years.
The fact that CFAR is unable to do this till now because of unavailability of the test doesn't mean that there's proof that CFAR manages to raise rationality.
I also don't know the exact relationship between Stanovich and CFAR and to what extend his involvement in CFAR is more than having his name on the CFAR advisor page. Giving CFAR participants a bunch of questions that he considers to be potentially usefully for measuring rationality could be part of his effort to develop a rationality test.
The text being publically available isn't a necessary condition for a version of the text being used inside CFAR.