Skip to content

Instantly share code, notes, and snippets.

@neilkod

neilkod/gist:2868503

Created June 4, 2012 13:48
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save neilkod/2868503 to your computer and use it in GitHub Desktop.
Save neilkod/2868503 to your computer and use it in GitHub Desktop.
Download ZIP
bash one-liner to download the google books 1-gram data
Raw
gistfile1.txt
nkodner@hadoop4 ~$ for i in {0..9}; do curl -O http://commondatastorage.googleapis.com/books/ngrams/books/googlebooks-eng-all-1gram-20090715-${i}.csv.zip; done
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 196M 100 196M 0 0 8514k 0 0:00:23 0:00:23 --:--:-- 16.0M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 196M 100 196M 0 0 16.6M 0 0:00:11 0:00:11 --:--:-- 14.1M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 196M 100 196M 0 0 15.9M 0 0:00:12 0:00:12 --:--:-- 12.3M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 14.8M 0 0:00:13 0:00:13 --:--:-- 21.5M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 14.7M 0 0:00:13 0:00:13 --:--:-- 12.3M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 196M 100 196M 0 0 13.7M 0 0:00:14 0:00:14 --:--:-- 21.9M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 18.7M 0 0:00:10 0:00:10 --:--:-- 26.5M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 18.5M 0 0:00:10 0:00:10 --:--:-- 21.0M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 13.0M 0 0:00:15 0:00:15 --:--:-- 13.2M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 195M 100 195M 0 0 6478k 0 0:00:30 0:00:30 --:--:-- 9419k
nkodner@hadoop4 ~$ ls -ltrh googlebooks*
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:44 googlebooks-eng-all-1gram-20090715-0.csv.zip
-rw-r--r-- 1 nkodner staff 197M Jun 4 09:44 googlebooks-eng-all-1gram-20090715-1.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:44 googlebooks-eng-all-1gram-20090715-2.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:45 googlebooks-eng-all-1gram-20090715-3.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:45 googlebooks-eng-all-1gram-20090715-4.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:45 googlebooks-eng-all-1gram-20090715-5.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:45 googlebooks-eng-all-1gram-20090715-6.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:45 googlebooks-eng-all-1gram-20090715-7.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:46 googlebooks-eng-all-1gram-20090715-8.csv.zip
-rw-r--r-- 1 nkodner staff 196M Jun 4 09:46 googlebooks-eng-all-1gram-20090715-9.csv.zip
nkodner@hadoop4 ~$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment