Skip to content

Instantly share code, notes, and snippets.

View michaelcolenso's full-sized avatar

michael colenso michaelcolenso

View GitHub Profile
@michaelcolenso
michaelcolenso / grab-commons-images-sh
Created January 19, 2023 05:21 — forked from loleg/grab-commons-images-sh
Download images and metadata from a Wikimedia Commons category or results page
#!/bin/bash
#
# Download images from a Wikimedia Commons category
#
# Highest preview resolution and metadata in XML format will be saved in subfolders.
# Usage: execute this script on a Linux command line, providing the full URL to the category page.
#
# Shell tools required for this script: wget sed grep
#
@michaelcolenso
michaelcolenso / wget.sh
Created June 11, 2020 22:49 — forked from Dammmien/wget.sh
wget cheat sheet
# POST a JSON file and redirect output to stdout
wget -q -O - --header="Content-Type:application/json" --post-file=foo.json http://127.0.0.1
# Download a complete website
wget -m -r -linf -k -p -q -E -e robots=off http://127.0.0.1
# But it may be sufficient
wget -mpk http://127.0.0.1
# Download all images of a website
#PeriscopeProfileJson.sh
#Returns User Profile Json from Web Profile
#Version 1.0: Initial Release
#Version 1.1: Fixed quoting characters, optimize perl statements
#Version 1.2: Update parsing for changes in profile page
#replace myuser with the user you want to query
#line breaks added for readability
USR=myuser; curl -sq https://www.periscope.tv/$USR \
<!DOCTYPE html>
<meta charset="utf-8">
<head>
<style>
.node {
stroke: #000;
stroke-width: 1.5px;
}
.link {
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@michaelcolenso
michaelcolenso / gist:10fa8bd7fb0f453d2981
Created June 4, 2015 21:12
king county recent sales
This file has been truncated, but you can view the full file.
{"displayFieldName":"Sellername","fieldAliases":{"PIN":"PIN","ADDRESS":"ADDRESS","ExciseTaxNum":"ExciseTaxNum","SaleDate":"SaleDate","SalePrice":"SalePrice","PerPropPrice":"PerPropPrice","RecNumber":"RecNumber","RecVolume":"RecVolume","RecPage":"RecPage","PlatNumber":"PlatNumber","PlatType":"PlatType","PlatLot":"PlatLot","PlatBlock":"PlatBlock","Sellername":"Sellername","selleradd1":"selleradd1","selleradd2":"selleradd2","buyername":"buyername","buyeradd1":"buyeradd1","buyeradd2":"buyeradd2","Property_Type":"Property_Type","Principal_Use":"Principal_Use","ForestLand":"ForestLand","CurrentUseLand":"CurrentUseLand","NonProfitUse":"NonProfitUse","HistoricProperty":"HistoricProperty","Property_Class":"Property_Class","PLIBRARY.PROPERTY.PARCEL_SALES3YR_AREA.fid":"fid","shape.area":"shape.area","shape.len":"shape.len"},"geometryType":"esriGeometryPolygon","spatialReference":{"wkid":102100,"latestWkid":3857},"fields":[{"name":"PIN","type":"esriFieldTypeString","alias":"PIN","length":10},{"name":"ADDRESS","type":"esr
This file has been truncated, but you can view the full file.
{"displayFieldName":"ZIPCODE","fieldAliases":{"OBJECTID":"OBJECTID","ZIP":"ZIP","ZIPCODE":"ZIPCODE","COUNTY":"COUNTY","ZIP_TYPE":"ZIP_TYPE","Shape.area":"Shape.area","Shape.len":"Shape.len"},"geometryType":"esriGeometryPolygon","spatialReference":{"wkid":102100,"latestWkid":3857},"fields":[{"name":"OBJECTID","type":"esriFieldTypeOID","alias":"OBJECTID"},{"name":"ZIP","type":"esriFieldTypeInteger","alias":"ZIP"},{"name":"ZIPCODE","type":"esriFieldTypeString","alias":"ZIPCODE","length":5},{"name":"COUNTY","type":"esriFieldTypeString","alias":"COUNTY","length":3},{"name":"ZIP_TYPE","type":"esriFieldTypeString","alias":"ZIP_TYPE","length":10},{"name":"Shape.area","type":"esriFieldTypeDouble","alias":"Shape.area"},{"name":"Shape.len","type":"esriFieldTypeDouble","alias":"Shape.len"}],"features":[{"attributes":{"OBJECTID":1,"ZIP":98001,"ZIPCODE":"98001","COUNTY":"033","ZIP_TYPE":"Standard","Shape.area":526629263.79629451,"Shape.len":146572.3858552727},"geometry":{"rings":[[[-13606574.231878271,6000010.869083791],[-
@michaelcolenso
michaelcolenso / zclipped.json
Created June 1, 2015 06:59
seattle geoJSON
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@michaelcolenso
michaelcolenso / untitled
Created May 31, 2015 05:10
ogr2ogr seattle parcel data
ogr2ogr -f GeoJSON -t_srs EPSG:3857 seattlegeoparcels.json "./seattle_parcels.json" OGRGeoJSON