Skip to content

Instantly share code, notes, and snippets.

@vasi

vasi/gist:5365782

Created April 11, 2013 18:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vasi/5365782 to your computer and use it in GitHub Desktop.
Save vasi/5365782 to your computer and use it in GitHub Desktop.
Download ZIP
Sample contents of GDELT
Raw
gistfile1.txt
$ ./httpfs2-mt http://eventdata.psu.edu/data.dir/GDELT.1979-2012.reduced.zip mnt
file name: GDELT.1979-2012.reduced.zip
host name: eventdata.psu.edu
port number: 80
protocol: http
request path: /data.dir/GDELT.1979-2012.reduced.zip
auth data: (null)
./httpfs2-mt: HEAD: invalid time
Wed, 03 Apr 2013 05:14:40 GMT
file size: 667748833
$ unzip -l mnt/GDELT.1979-2012.reduced.zip
Archive: mnt/GDELT.1979-2012.reduced.zip
Length Date Time Name
-------- ---- ---- ----
0 03-31-13 15:57 GDELT.1979-2012.reduced/
6148 03-31-13 15:57 GDELT.1979-2012.reduced/.DS_Store
0 03-31-13 15:58 __MACOSX/
0 03-31-13 15:58 __MACOSX/GDELT.1979-2012.reduced/
197 03-31-13 15:57 __MACOSX/GDELT.1979-2012.reduced/._.DS_Store
1171 08-02-12 16:59 GDELT.1979-2012.reduced/.Rapp.history
197 08-02-12 16:59 __MACOSX/GDELT.1979-2012.reduced/._.Rapp.history
119 07-30-12 17:37 GDELT.1979-2012.reduced/.~lock.ISRLEB.Gold.txt#
197 07-30-12 17:37 __MACOSX/GDELT.1979-2012.reduced/._.~lock.ISRLEB.Gold.txt#
13027525 03-31-13 15:47 GDELT.1979-2012.reduced/1979.reduced.txt
17233655 03-31-13 15:47 GDELT.1979-2012.reduced/1980.reduced.txt
21396048 03-31-13 15:47 GDELT.1979-2012.reduced/1981.reduced.txt
24539846 03-31-13 15:47 GDELT.1979-2012.reduced/1982.reduced.txt
26524795 03-31-13 15:47 GDELT.1979-2012.reduced/1983.reduced.txt
27319141 03-31-13 15:47 GDELT.1979-2012.reduced/1984.reduced.txt
29462258 03-31-13 15:47 GDELT.1979-2012.reduced/1985.reduced.txt
30415281 03-31-13 15:47 GDELT.1979-2012.reduced/1986.reduced.txt
29341463 03-31-13 15:47 GDELT.1979-2012.reduced/1987.reduced.txt
30286918 03-31-13 15:47 GDELT.1979-2012.reduced/1988.reduced.txt
27787691 03-31-13 15:47 GDELT.1979-2012.reduced/1989.reduced.txt
29881815 03-31-13 15:47 GDELT.1979-2012.reduced/1990.reduced.txt
40071759 03-31-13 15:47 GDELT.1979-2012.reduced/1991.reduced.txt
28840520 03-31-13 15:47 GDELT.1979-2012.reduced/1992.reduced.txt
34782681 03-31-13 15:47 GDELT.1979-2012.reduced/1993.reduced.txt
50971711 03-31-13 15:47 GDELT.1979-2012.reduced/1994.reduced.txt
57411713 03-31-13 15:47 GDELT.1979-2012.reduced/1995.reduced.txt
84835275 03-31-13 15:47 GDELT.1979-2012.reduced/1996.reduced.txt
109940099 03-31-13 15:47 GDELT.1979-2012.reduced/1997.reduced.txt
124521372 03-31-13 15:47 GDELT.1979-2012.reduced/1998.reduced.txt
145931908 03-31-13 15:47 GDELT.1979-2012.reduced/1999.reduced.txt
143026926 03-31-13 15:47 GDELT.1979-2012.reduced/2000.reduced.txt
160533498 03-31-13 15:47 GDELT.1979-2012.reduced/2001.reduced.txt
146627227 03-31-13 15:48 GDELT.1979-2012.reduced/2002.reduced.txt
176052607 03-31-13 15:48 GDELT.1979-2012.reduced/2003.reduced.txt
150500439 03-31-13 15:48 GDELT.1979-2012.reduced/2004.reduced.txt
118566011 03-31-13 15:48 GDELT.1979-2012.reduced/2005.reduced.txt
189743162 03-31-13 15:48 GDELT.1979-2012.reduced/2006.reduced.txt
253024275 03-31-13 15:48 GDELT.1979-2012.reduced/2007.reduced.txt
322157494 03-31-13 15:48 GDELT.1979-2012.reduced/2008.reduced.txt
524786348 03-31-13 15:49 GDELT.1979-2012.reduced/2009.reduced.txt
466383888 03-31-13 15:49 GDELT.1979-2012.reduced/2010.reduced.txt
633156222 03-31-13 15:49 GDELT.1979-2012.reduced/2011.reduced.txt
343071588 03-31-13 15:49 GDELT.1979-2012.reduced/2012.reduced.txt
3556 08-02-12 11:43 GDELT.1979-2012.reduced/eventcount.Levant.plot.r
248 08-02-12 11:43 __MACOSX/GDELT.1979-2012.reduced/._eventcount.Levant.plot.r
578 08-02-12 11:00 GDELT.1979-2012.reduced/files.list.txt
248 08-02-12 11:00 __MACOSX/GDELT.1979-2012.reduced/._files.list.txt
5413 03-31-13 15:38 GDELT.1979-2012.reduced/GDELT.counts.py
248 03-31-13 15:38 __MACOSX/GDELT.1979-2012.reduced/._GDELT.counts.py
4256 03-30-13 15:23 GDELT.1979-2012.reduced/GDELT.reduced.documentation.txt
248 03-30-13 15:23 __MACOSX/GDELT.1979-2012.reduced/._GDELT.reduced.documentation.txt
6275 01-19-13 14:52 GDELT.1979-2012.reduced/GDELT.select.py
248 01-19-13 14:52 __MACOSX/GDELT.1979-2012.reduced/._GDELT.select.py
197 03-31-13 15:57 __MACOSX/._GDELT.1979-2012.reduced
-------- -------
4612182703 54 files
$ unzip -p mnt/GDELT.1979-2012.reduced.zip GDELT.1979-2012.reduced/1990.reduced.txt | head -n 20
Day Actor1Code Actor2Code EventCode QuadCategory GoldsteinScale Actor1Geo_Lat Actor1Geo_Long Actor2Geo_LatActor2Geo_Long ActionGeo_Lat ActionGeo_Long
19900101 AFG AFGELI 1013 3 -5.0 32.2417 67.7136 32.2417 67.7136 32.2417 67.7136
19900101 AFG AFGELI 173 4 -5.0 32.2417 67.7136 32.2417 67.7136 32.2417 67.7136
19900101 AFG AFGGOV 190 4 -10.0 31.9256 73.8641 34.5167 69.1833 34.5167 69.1833
19900101 AFG AFGRAD 190 4 -10.0 33 65 33 65 33 65
19900101 AFG AFGREB 130 3 -4.4 32.2417 67.7136 32.2417 67.7136 32.2417 67.7136
19900101 AFG AFGREB 173 4 -5.0 33.3395 69.9204 33.3395 69.9204 33.3395 69.9204
19900101 AFG BUS 043 2 2.8
19900101 AFG MIL 100 3 -5.0 33.3395 69.9204 33.3395 69.9204 33.3395 69.9204
19900101 AFG MLI 010 2 0.0 33.3395 69.9204 17 -4 17 -4
19900101 AFG PAK 010 2 0.0 32.2417 67.7136 33.7 73.1667 33.7 73.1667
19900101 AFG REB 130 3 -4.4 32.2417 67.7136 32.2417 67.7136 32.2417 67.7136
19900101 AFG REB 182 4 -9.5 33.3395 69.9204 32 53 33.3395 69.9204
19900101 AFG REB 190 4 -10.0 33.3395 69.9204 32 53 32 53
19900101 AFGGOV PAK 0841 1 7.0
19900101 AFGRAD AFG 190 4 -10.0 33 65 33 65 33 65
19900101 AFR SDN 030 2 4.0 15 30 15 30 15 30
19900101 AFR ZAF 013 2 0.4 -33.9167 18.4167 -33.9167 18.4167 -33.9167 18.4167
19900101 ALB ROU 020 2 3.0 -26.2 28.0833 -26.2 28.0833 -26.2 28.0833
19900101 ATH RUS 173 4 -5.0 55.7522 37.6156 55.7522 37.6156 55.7522 37.6156
$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment