This is a special post for quick takes by sjadler. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Is there an easy way to download all the Rejected Posts from LessWrong, either in aggregate or according to certain filters?
I've been scrolling through the moderation log and Showing More, but I'd rather not try to scrape these, for various reasons. Maybe @Raemon or another LW team member knows?
We can probably send you a dump? You can also download them directly using the graphQL API.
Just go to lesswrong.com/graphiql and use the following query:
{
posts(selector: {rejected:{}}) {
results {
title
}
}
}
(Adding whatever other post fields you need next to title)
This won't literally be all of them, but should be like 2,000 or so.
Through limit I could specify the number of records (useful to test with limit: 1 to make sure a query did what I wanted before running it larger), and through offset... (read more)