Geoff_Anders comments on Introducing Leverage Research - Less Wrong

30 Post author: lukeprog 09 January 2012 07:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread. Show more comments above.

Comment author: Geoff_Anders 10 January 2012 03:45:21PM 8 points [-]

Short answer: Yes, CT is falsifiable. Here's how to see this. Take a look at the example CT chart. By following the procedures stated in the Theory and Practice document, you can produce and check a CT chart like the example chart. Once you've checked the chart, you can make predictions using CT and the CT chart. From the example chart, for instance, we can see that the person sometimes plays video games and tries to improve and sometimes plays video games while not trying to improve. From the chart and CT, we can predict: "If the person comes to believe that he stably has the ability to be cool, as he conceives of coolness, then he will stop playing video games while not trying to improve." We would measure belief here primarily by the person's belief reports. So we have a concrete procedure that yields specific predictions. In this case, if the person followed various recommendations designed to increase his ability to be cool, ended up reporting that he stably had the ability to be cool, but still reported playing video games while not trying to improve, CT would be falsified.

Longer answer: In practice, almost any specific theory can be rendered consistent with the data by adding epicycles, positing hidden entities, and so forth. Instead of falsifying most theories, then, what happens is this: You encounter some recalcitrant data. You add some epicycles to your theory. You encounter more recalcitrant data. You posit some hidden entities. Eventually, though, the global theory that includes your theory becomes less elegant than the global theory that rejects your theory. So, you switch to the global theory that rejects your theory and you discard your specific theory. In practice with CT, so far we haven't had to add many epicycles or posit many hidden entities. In particular, we haven't had the experience of having to frequently change what we think a person's intrinsic goods are. If we found that we kept having to revise our views about a person's intrinsic goods (especially if the old posited intrinsic goods were not instrumentally useful for achieving the new posited intrinsic goods), this would be a serious warning sign.

Speaking more generally, we're following particular procedures, as described in the CT Theory and Practice document. We expect to achieve particular results. If in a relatively short time frame we find that we can't, that will provide evidence against the claim "CT is useful for achieving result X". For example, I've been able to work for more than 13 hours a day, with only occasional days off, for more than two years. I attribute this to CT and I expect we'll be able to replicate this. If we end up not being able to, that'll be obvious to us and everyone else.

Thanks for raising the issue of falsifiability. I'm going to add it to our CT FAQ.

Comment author: Emile 10 January 2012 09:55:22PM 12 points [-]

For example, I've been able to work for more than 13 hours a day, with only occasional days off, for more than two years. I attribute this to CT and I expect we'll be able to replicate this. If we end up not being able to, that'll be obvious to us and everyone else.

It's not an infrequent occurrence that someone comes up with a self-help technique that works for himself, but then doesn't work nearly as well for others - but then if he's say selling a book he may still be able to find 5 people out of 500 on which it works to add their testimony on the back cover!

So far, I see no reason to think that CT would be any better (either for prediction or self-improvement) than say Neuro-Linguistic Programming, which is also an alternative theory that claims impressive results and has a pretty big following.

I think it is possible some alternative psychology model will help people improve themselves and make humanity better etc. - but there are many candidates (including tings like Scientology), and much potential for self-delusion or misunderstanding or death spirals ...

Comment author: CronoDAS 12 January 2012 12:55:37AM *  2 points [-]

What I've heard is that, when they try to do studies, all types of therapy seem to be about as good as every other type; one study found that talking to a teenage girl with no training in particular was about as effective as talking with a professional therapist. (On the other hand, they also all tend to be better than nothing.)

(Note that this is all vague "what I remember hearing" stuff, so there's probably something more definitive to be found if you Google it.)

Comment author: CarlShulman 12 January 2012 02:32:48AM *  6 points [-]

You're likely thinking of Dawes, at least in part. Obligatory Less Wrong link.

Comment author: CronoDAS 12 January 2012 02:33:15PM 0 points [-]

Thanks.

Comment author: John_Maxwell_IV 02 August 2014 07:20:10AM 2 points [-]

For example, I've been able to work for more than 13 hours a day, with only occasional days off, for more than two years. I attribute this to CT and I expect we'll be able to replicate this. If we end up not being able to, that'll be obvious to us and everyone else.

Any updates?

Comment author: [deleted] 11 January 2012 03:27:52AM *  2 points [-]

For example, I've been able to work for more than 13 hours a day, with only occasional days off, for more than two years. I attribute this to CT and I expect we'll be able to replicate this.

I enthusiastically offer myself as a test subject.

Comment author: Craig_Heldreth 10 January 2012 08:10:20PM 2 points [-]

Do you have html for those documents? PDF is OK for me, but my guess is html is more openly accessible.

Comment author: Emile 10 January 2012 09:42:30PM 3 points [-]

Seconded, I find pdf annoying, especially on my home computer where they don't open in a browser tab, but in a separate application. I don't see any benefit at all to pdf, except for stuff that needs to be printed out so you can write on it or something.

Comment author: Incorrect 11 January 2012 05:37:23AM 1 point [-]

For example, I've been able to work for more than 13 hours a day, with only occasional days off, for more than two years. I attribute this to CT and I expect we'll be able to replicate this. If we end up not being able to, that'll be obvious to us and everyone else.

But what quality of work? Organizing my closet is very different than reading a dense academic paper with full concentration.

Comment author: Geoff_Anders 11 January 2012 03:25:40PM 1 point [-]

I can usually do any type of work. Sometimes it becomes harder for me to write detailed documents in the last couple hours of my day.