Skip to content

Instantly share code, notes, and snippets.

@migurski
Created January 13, 2015 01:53
Show Gist options
  • Save migurski/8fe9d98e760795eaa1a7 to your computer and use it in GitHub Desktop.
Save migurski/8fe9d98e760795eaa1a7 to your computer and use it in GitHub Desktop.
Socrata HTTP Gripes
% curl -sIL 'https://data.acgov.org/api/geospatial/8e4s-7f4v?method=export&format=Original'
HTTP/1.1 405 Method Not Allowed
Server: nginx
Date: Tue, 13 Jan 2015 01:52:36 GMT
Connection: keep-alive
Access-Control-Allow-Origin: *
X-Error-Code: method_not_allowed
X-Error-Message: HEAD not allowed
X-Socrata-Region: production
Age: 0
% curl -sIL https://data.sfgov.org/download/kvej-w5kb/ZIPPED%20SHAPEFILE
HTTP/1.1 302 Found
Server: nginx
Date: Tue, 13 Jan 2015 01:51:36 GMT
Content-Type: text/html; charset=utf-8
Connection: keep-alive
X-Frame-Options: SAMEORIGIN
X-UA-Compatible: IE=Edge,chrome=1
Cache-Control: no-cache
X-Request-Id: a79b2f973b7f46e4292a4dd1ca6b555f
Set-Cookie: _socrata_session_id=BAh7BkkiD3Nlc3Npb25faWQGOgZFRiIlNmQ5NGQ2YTNiN2I4Y2ZjN2UyMzRjN2Y0MGMwODM5YjU%3D--d8c873bdb9117ef5c10134a8ebf188095cfeea17; path=/; HttpOnly; secure
Set-Cookie: logged_in=; path=/; expires=Thu, 01-Jan-1970 00:00:00 GMT
Location: http://apps.sfgov.org/datafiles/view.php?file=sfgis/eas_addresses_with_units.zip
Status: 302
Vary: Accept-Encoding,User-Agent
X-Socrata-Region: production
Age: 0
HTTP/1.1 200 OK
Date: Tue, 13 Jan 2015 01:51:37 GMT
Server: Apache/2.2.3 (CentOS)
X-Powered-By: PHP/5.2.10
Pragma: public
Expires: 0
Cache-Control: must-revalidate, post-check=0, pre-check=0
Content-Disposition: attachment; filename=eas_addresses_with_units.zip;
Content-Transfer-Encoding: binary
Content-Length: 8300106
Content-Type: application/download
@dedan
Copy link

dedan commented Feb 24, 2015

I currently try to download datasets from SFgov using CURL or WGET. I receive a file, but when I try to unzip it, it converts into a .cpgz file, which converts into a .zip file, which converts into a .cpgz file, ...

Is this related to the above mentioned problem?

@migurski
Copy link
Author

Thanks @chrismetcalf, very useful background! I’ll see if I can follow up with SF to get a better HTTP response out of them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment