Scraping websites currently free due to coronavirus

by emmab1 min read14th Apr 20203 comments

15

World Optimization
Personal Blog

Some sites are free due to the coronavirus and we should scrape them. Please list any temporarily-free websites you know of, such as https://www.uptodate.com/

To download sites I recommend https://github.com/ArchiveTeam/grab-site

Consider whether you want to use --no-offsite-links. Otherwise it will pull every linked page and its resources (and sometimes even embedded videos).