ThrustVectoring comments on Open Thread, November 23-30, 2013 - Less Wrong

4 Post author: passive_fist 23 November 2013 06:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (295)

You are viewing a single comment's thread. Show more comments above.

Comment author: Viliam_Bur 27 November 2013 01:57:00PM 5 points [-]

We could test this theory by using it on the existing data and selecting the best comments under this theory. I would be interested in reading the "top 20 (or 50) LW comments ever" found by this algorithm, posted as a separate article. It could give us an approximate idea of what exactly the new system would incentiize.

Comment author: ThrustVectoring 27 November 2013 04:14:15PM 3 points [-]

Is there a good canonical source for all LW comments ever? I'm interested in importing the data into Python and playing around with ranking algorithms. (I'm not sure what disclaimer to use to keep others from not doing the same just because I publicly said that I'm interested in it, but yeah, feel free to duplicate work and come up with other interesting analyses)

Comment author: Viliam_Bur 28 November 2013 12:36:50PM 0 points [-]

Is there a good canonical source for all LW comments ever?

You could ask matt to send you the necessary parts of the database.

Comment author: Gabriel 27 November 2013 08:36:31PM 0 points [-]

There's this and this. Maybe they allow you to go all the way back to the beginning.

Comment author: ThrustVectoring 27 November 2013 09:08:08PM 1 point [-]

It's probably doable to use those to scrape comments and put them into some kind of list or database, but spending time looting LW comments that way seems like wasted effort compared to getting a full dump from an official source.