You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Elo comments on Weirdness at the wiki - Less Wrong Discussion

7 Post author: NancyLebovitz 30 November 2015 11:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: Elo 02 December 2015 08:18:17PM 0 points [-]

this is a very important question!

This is a nicety; while appreciated it looks like you are trying to suck up to Nancy.

(taking into account what Lumifier said about the app) in your description;

We also intend to run randomized control studies on our content's impact, as described in our theory of change. We have written up proposals for those studies, and are currently trying to get funding for these studies.

Is the only thing you said are doing to be checking on what you're actually teaching. And it's something that has not happened yet. (granted these things take time). I read the entire post as; "nothing yet, but we want to - in these ways...".

randomized control studies on our content's impact

depending on the method (if done with web content) could be described as A/B split testing. Which is standard these days for internet behaviour of groups spreading clickbait, not an accountable test.

Comment author: Gleb_Tsipursky 03 December 2015 04:23:11AM *  0 points [-]

I would suggest not taking Lumifer's description of his initial impression of the sign-up page as indicative of the app itself. I think there's sufficient evidence of Lumifer being not unbiased in describing Intentional Insights content. So consider checking out the app itself.

Here are the study proposals themselves, which you can evaluate yourself for whether they are A/B split testing: 1, 2.

EDIT Forgot to mention, my comment on the nature of NancyLebovitz's question had to do with my own desire to signal that this is a very important question to me, not give praise.