Skip to content

Instantly share code, notes, and snippets.

View flibbertigibbet's full-sized avatar

Kathryn Killebrew flibbertigibbet

60 followers · 40 following
View GitHub Profile
@flibbertigibbet
flibbertigibbet / cyclephilly_geojson_generator.py
Created June 12, 2014 23:14
Build GeoJSON of CyclePhilly tracks from MySQL database
#!/usr/bin/env python
import pymysql
import geojson
from geojson import FeatureCollection, Feature, LineString, Point
dt_fmt = '%Y-%m-%d %H:%M'
db = pymysql.connect(host='', user='', passwd='', db='')
@flibbertigibbet
flibbertigibbet / recurse_ftp.py
Last active June 23, 2020 20:22
Recursively fetch files from an FTP server directory. Here, it's downloading all the zip files found in or beneath the parent directory.
#!/usr/bin/env python
from ftplib import FTP
from time import sleep
import os
my_dirs = [] # global
my_files = [] # global
curdir = '' # global
@flibbertigibbet
flibbertigibbet / query_places.py
Created December 14, 2013 06:03
Finds the centroids of 50km hexagons to tile a bounding box and writes the coordinates to a file. Then, creates a bash script to query Google Places for each point and write the responses to files. (There's some overlap between the queried areas, but it should be minimal.) Here, it's searching for grocery stores in New Jersey.
#!/usr/bin/env python
import csv
from math import cos, pi
# API key for Google Places
api_key= 'YOUR_KEY_GOES_HERE'
outf = open('njpoints.csv','w')
w = csv.writer(outf)
@flibbertigibbet
flibbertigibbet / example.js
Created March 10, 2015 18:26
Example standalone Windshaft configuration
var Windshaft = require('./lib/windshaft');
var _ = require('underscore');
var tablename = 'YOUR TABLENAME HERE';
var style = '#' + tablename + ' { ' +
'line-color: #EFF3FF; ' +
'line-width: 2; ' +
'} ';
@flibbertigibbet
flibbertigibbet / census_fetcher.py
Created December 23, 2013 06:20
Download TIGER/Line data from the Census FTP server based on state FIPS code. Here, pulls EDGE data for four states.
#!/usr/bin/env python
from os import walk
from ftplib import FTP
from time import sleep
# 10 - DE
# 34 - NJ
# 36 - NY
# 42 - PA
@flibbertigibbet
flibbertigibbet / FeedFetcher.py
Last active June 14, 2017 02:25
Checks for new GTFS feeds, then downloads and validates them. Fetches feeds for SEPTA, NYC MTA, NJ TRANSIT, CTTRANSIT, Delaware First State, NJ/NY PATH, and PATCO. Dependencies: Python requests, BeautifulSoup, git, and Google's transit feed validator. NJ TRANSIT developer login credentials required to download from that agency. Cannot check for …
#!/usr/bin/python
import requests, os, pickle, datetime, zipfile, subprocess, csv
from bs4 import BeautifulSoup
class FeedFetcher():
def __init__(self, ddir=os.getcwd(), get_nj=True, nj_username='', nj_pass=''):
self.ddir = ddir
self.get_nj = get_nj # whether to fetch from NJ TRANSIT or not
self.tc = {} # time checks for GTFS fetches
@flibbertigibbet
flibbertigibbet / index.html
Created December 10, 2016 15:41 — forked from DaisyDream/index.html
Portfolio
<link rel="stylesheet" href="//maxcdn.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.min.css" />
<body class="container-fluid">
<div class="topnav" id="topnav">
<ul>
<li><a href="#About">About</a></li>
<li><a href="#Portfolio">Portfolio</a></li>
<li><a href="#Contact">Contact</a></li>
</ul>
</div>
@flibbertigibbet
flibbertigibbet / devtools.md
Created September 9, 2016 06:49

Chrome Developer Tools at I/O 2016

About the I/O presentation and demo app

The Chrome DevTools team gave this presentation at Google I/O 2016.

The code for the exact demo app used in their presentation apparently isn't public, but was based on the progressive web app CodeLabs demo, the code for which is here, in the 'final' directory.

Progressive web apps have a responsive design and define a manifest.json, which gives URLs for launcher icons and the start URL for the app. With the manifest.json in place, users can add the web app to their device home screen and launch it directly. Another common feature of progressive web apps is their use of service workers to cache resources, which allows them to load quickly, cut down on network use, and potentially work offline.

@flibbertigibbet
flibbertigibbet / TorqueTalk.md
Last active April 9, 2016 00:46
How to Use Torque Outside of a Full CartoDB Setup

What is Torque?

Torque is an open-source JavaScript library from CartoDB for time series map visualization.

How are Torque Visualizations Created?

  • The simplest way to create a Torque time-lapse animation is to upload the data to a CartoDB account,
@flibbertigibbet
flibbertigibbet / ned_fetcher.py
Last active January 1, 2016 04:29
Downloads GFloat National Elevation Dataset data from USGS, converts to GTiff, then merges to a single tif. Expects a file 'ned_links.html' in the same directory that has the HTML contents of the email from USGS containing the download links for the GFloat zip files. Depends on BeautifulSoup and gdal; expects to be on a unix-y system.
#!/usr/bin/env python
from bs4 import BeautifulSoup
import requests, os, subprocess
from time import sleep
download_dir = os.getcwd()
soup = BeautifulSoup(open('ned_links.html','rb'))
of = open('just_ned_links.txt', 'wb')