All discussion post titles, points, and dates as an excel sheet

by Alexandros1 min read3rd Jun 201410 comments


Personal Blog

You can find it here.

Earlier today I wanted to quantify whether lesswrong has stopped being a well kept garden. So I wrote a scraper to produce the above dataset, so that anyone that wants to do the analysis, can.

All data is as of a few minutes ago.

For programmers: You can see the source here, it's made to run on scraperwiki, but it will time out after about 3000 articles. At that point you need to adjust the initial value of the uri variable to be the last uri printed. Repeating this process once more will allow you to reach the end. Have fun.