Elo comments on Less Wrong Karma Chart Website - Less Wrong

21 Post author: ScottL 15 February 2016 12:36PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (24)

You are viewing a single comment's thread.

Comment author: Elo 17 February 2016 05:15:29AM 0 points [-]

Any chance at getting all comments and posts on one of those graphs? For all users over time? I'd like to see which posts score >=5 and <5 karma..

Comment author: ScottL 18 February 2016 10:56:46AM *  0 points [-]

I don't think so. See Vaniver's comment which describes what the site is doing. I don't know the process, but maybe you can submit a DB request to the trike apps team for this data.

Comment author: Elo 18 February 2016 10:59:21AM 1 point [-]

script should be able to be run on http://lesswrong.com/comments/ without much modification...

Comment author: ScottL 18 February 2016 11:57:52AM *  0 points [-]

You are probably right. I would assume that I can also get the post information from this: http://lesswrong.com/r/all/recentposts/ . A graph with this much data probably wouldn't be useful as it would be too busy. I will look into writing something else to get this data into a usable format.

Edit: Your link only has the main comments, not the discussion ones. I'm not sure what to get all the comment information from.

Comment author: Elo 18 February 2016 08:46:32PM 0 points [-]

maybe 3 months worth; for the past 3 years? 12 graphs in total; showing the trend...?

I figured that with the zoom it would be able to be use-able. but separate graphs work too.

Comment author: Vaniver 22 February 2016 03:00:31PM 0 points [-]

Yeah, I recommend against scraping LW that way instead of making a DB request / building a page that makes that DB request.

Comment author: Lumifer 22 February 2016 03:54:57PM 0 points [-]

instead of making a DB request

Can one? In general, is there an available (and working) API to LW?

Comment author: Vaniver 22 February 2016 04:21:20PM 0 points [-]

The following is what I had in mind for that section:

maybe you can submit a DB request to the trike apps team for this data.

There is an API but I think it doesn't have the ability to do everything that we'd like it to. See this issue as an example of a missing feature.

But if you have the ability, building that feature and submitting it as a pull request is better than doing it the long way (since it also helps everyone else who wants to do that sort of thing in the future).

Comment author: Lumifer 22 February 2016 05:14:35PM 3 points [-]

building that feature

A feature that allows anyone on the 'net to bang on your backend database is not something to be taken lightly :-)

I think LW first needs a coherent API spec, then a framework (including thing like auth tokens, rate limiters, etc.), and only then specific abilities to e.g. ask for all comments of a particular user.