Skip to content

Instantly share code, notes, and snippets.

View driki's full-sized avatar

Matt MacDonald driki

View GitHub Profile
@driki
driki / gist:3259474
Created August 4, 2012 19:26
Document for Somerville, MA
{
took: 3,
timed_out: false,
_shards: {
total: 5,
successful: 5,
failed: 0
},
hits: {
total: 1,
@driki
driki / gist:3259436
Created August 4, 2012 19:16
Elasticsearch Mapping
{
municipalities: {
document: {
properties: {
classification: {
type: "string",
index: "not_analyzed"
},
content_url: {
type: "string",
@driki
driki / gist:1867250
Created February 20, 2012 02:10
Snippet to generate open-budget-data stubs for csv docs.
Organization.order(:state).each do |org|
org_dir = "#{org.state.downcase}/#{org.name.downcase.gsub(/[^[:alnum:]]/,'_').gsub(/-{2,}/,'_')}/#{Time.now.year}"
expense_file = "#{org.slug}-#{Time.now.year}-expense.csv"
revenue_file = "#{org.slug}-#{Time.now.year}-revenue.csv"
FileUtils.mkdir_p(org_dir)
File.new("#{org_dir}/#{expense_file}", "w+").close
File.new("#{org_dir}/#{revenue_file}", "w+").close
end
@driki
driki / gist:1176346
Created August 28, 2011 07:13
Retrieve town council meeting notes.
require 'rubygems'
require 'typhoeus'
require 'nokogiri'
require 'uri'
require 'json'
require 'calais'
BASE_URL = 'http://www.ci.watertown.ma.us'
# the request object
@driki
driki / gist:1169914
Created August 25, 2011 03:27
A simple scraper for geo-coding Watertown, MA building permits
require 'rubygems'
require 'csv'
require 'typhoeus'
require 'json'
GOOGLE_GEO_URL = "http://maps.googleapis.com/maps/api/geocode/json?sensor=false&address="
# Create the output file
CSV.open("geo-coded-permits.csv", "wb") do |csv|