Skip to content

Instantly share code, notes, and snippets.

@hornc

hornc/get-ol-data.sh

Created June 1, 2020 21:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hornc/84c2c59059fee76d774f3cdaee5184fa to your computer and use it in GitHub Desktop.
Save hornc/84c2c59059fee76d774f3cdaee5184fa to your computer and use it in GitHub Desktop.
Download ZIP
Raw
get-ol-data.sh
#!/bin/bash
# Openlibrary.org data dumps are generated at the end of each month, this downloads them.
# This will save the separate dump files with the redirected filename containing dates.
wget --trust-server-names https://openlibrary.org/data/ol_dump_authors_latest.txt.gz
wget --trust-server-names https://openlibrary.org/data/ol_dump_works_latest.txt.gz
wget --trust-server-names https://openlibrary.org/data/ol_dump_editions_latest.txt.gz
gunzip *.gz
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment