Skip to content

Instantly share code, notes, and snippets.

View tobyjsullivan's full-sized avatar

Toby Sullivan tobyjsullivan

View GitHub Profile
/**
* Based on the S3N RDD gist from Jeremy Pierre https://gist.github.com/j14159/d3cbe172f7b962d74d09
*
* Modified to use Jets3t
*/
package net.tobysullivan.spark.rdd
import java.io.{BufferedInputStream, BufferedReader, InputStreamReader}
import java.util.zip.GZIPInputStream
@tobyjsullivan
tobyjsullivan / gist:9bcef70406df23b1d7b7
Last active August 29, 2015 14:15
NP2 CuRL Responses
// ---- LOGIN
curl 'http://triton.ironhelmet.com/arequest/login' -H 'Origin: http://triton.ironhelmet.com' -H 'Accept-Encoding: gzip, deflate' -H 'Accept-Language: en-US,en;q=0.8' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.111 Safari/537.36' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' -H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'Referer: http://triton.ironhelmet.com/' -H 'X-Requested-With: XMLHttpRequest' -H 'Connection: keep-alive' --data 'type=login&alias=tobyjsullivan&password=<URL_ENCODED_PASSWORD>' --compressed
// Response:
Adding handle: conn: 0x7fd9c9004400
* Adding handle: send: 0
* Adding handle: recv: 0
* Curl_addHandleToPipeline: length: 1
* - Conn 0 (0x7fd9c9004400) send_pipe: 1, recv_pipe: 0
* About to connect() to triton.ironhelmet.com port 80 (#0)
// Request: Fetch properties in Vancovuer
curl 'http://www.realtor.ca/api/Listing.svc/PropertySearch_Post' -H 'Pragma: no-cache' -H 'Origin: http://www.realtor.ca' -H 'Accept-Encoding: gzip, deflate' -H 'Accept-Language: en-US,en;q=0.8' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.101 Safari/537.36' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' -H 'Accept: */*' -H 'Cache-Control: no-cache' -H 'Referer: http://www.realtor.ca/Map.aspx' -H 'Cookie: GUID=abbeab92-dcc7-40ae-9755-29c946d3ed90; CookieConverted=TRUE; TargetPage=/Map.aspx#CultureId=1&ApplicationId=1&Longitude=-124.917999267578&Latitude=49.7136993408203&PropertyTypeId=300&TransactionTypeId=2&PriceMin=0&PriceMax=0&BedRange=0-0&BathRange=0-0&ZoomLevel=12&undefined; TermsOfUseAgreement=ACCEPTED; __utmt=1; _dc_gtm_UA-12908513-11=1; _gali=Label1; __utma=134851954.1582663285.1427615646.1427615646.1428641581.2; __utmb=134851954.4.9.1428641603962; __utmc=134851954;
@tobyjsullivan
tobyjsullivan / nasdaqlist.csv
Last active April 18, 2016 16:41 — forked from huangt/nasdaqlist.csv.py
list of stock symbol on Nasdaq
Symbol Name LastSale MarketCap ADR TSO IPOyear Sector industry Summary Quote
FLWS 1-800 FLOWERS.COM, Inc. 5.27 336424668.5 n/a 1999 Consumer Services Other Specialty Stores http://www.nasdaq.com/symbol/flws
FCTY 1st Century Bancshares, Inc 7.6 70281022.8 n/a n/a Finance Major Banks http://www.nasdaq.com/symbol/fcty
FCCY 1st Constitution Bancorp (NJ) 10.13 60727141.66 n/a n/a Finance Savings Institutions http://www.nasdaq.com/symbol/fccy
SRCE 1st Source Corporation 26.8 653265946 n/a n/a Finance Major Banks http://www.nasdaq.com/symbol/srce
FUBC 1st United Bancorp, Inc. (FL) 7.37 252695602.7 n/a n/a Finance Major Banks http://www.nasdaq.com/symbol/fubc
VNET 21Vianet Group, Inc. 15.97 943028500 n/a n/a Technology Computer Software: Programming, Data Processing http://www.nasdaq.com/symbol/vnet
JOBS 51job, Inc. 66.49 1954129996 n/a 2004 Technology Diversified Commercial Services http://www.nasdaq.com/symbol/jobs
EGHT 8x8 Inc 9.805 713472326.3 n/a n/a Public Utilities Telecommunications Equipment http
@tobyjsullivan
tobyjsullivan / S&P500Dividends.csv
Created April 18, 2016 16:42 — forked from adamcrosby/S&P 500 Dividends
S&P500Dividends.csv
Symbol Name Dividend/Share Earning/Share Dividend Yield
MMM 3M Company Common 2.45 6.34 2.11
ABT Abbott Laboratori 0.6641 2.507 1.85
ANF Abercrombie & Fit 0.75 3.077 1.52
ACE Ace Limited Commo 2.47 7.825 2.61
ADBE Adobe Systems Inc 0.00 1.125 N/A
AMD Advanced Micro De 0.00 -1.137 N/A
AES The AES Corporati 0.12 -1.567 0.94
AET Aetna Inc. Common 0.775 4.841 1.20
ACS ACS N/A N/A N/A
@tobyjsullivan
tobyjsullivan / MIC.csv
Created April 18, 2016 16:46 — forked from elvinio/MIC
MIC or Market Identifier Code from ISO10383 uniquely identifies exchanges and trading platforms. The list is from the MIC ISO page: http://www.iso15022.org/MIC/homepageMIC.htm
MIC COUNTRY ISO COUNTRY CODE (ISO 3166) OPERATING MIC O/S NAME-INSTITUTION DESCRIPTION ACRONYM CITY STATUS DATE
360T GERMANY DE 360T O 360T FRANKFURT SEPTEMBER 2007
AATS UNITED STATES OF AMERICA US AATS O ASSENT ATS JERSEY CITY OCTOBER 2011
ACEX INDIA IN ACEX O ACE DERIVATIVES & COMMODITY EXCHANGE LTD MUMBAI APRIL 2011
AFET THAILAND TH AFET O AGRICULTURAL FUTURES EXCHANGE OF THAILAND BANGKOK JANUARY 2008
AIXE SWITZERLAND CH AIXE O AIXECUTE BERNE OCTOBER 2013
ALDP UNITED STATES OF AMERICA US XNYS S NYSE ALTERNEXT DARK AMEXDARK NEW YORK MAY 2011
ALTX SOUTH AFRICA ZA XJSE S JSE ALTERNATE EXCHANGE ALTX JOHANNESBURG APRIL 2015
ALXA THE NETHERLANDS NL XAMS S EURONEXT - ALTERNEXT AMSTERDAM AMSTERDAM MAY 2015
ALXB BELGIUM BE XBRU S EURONEXT - ALTERNEXT BRUSSELS BRUSSELS APRIL 2015
@tobyjsullivan
tobyjsullivan / vim.md
Created May 28, 2016 18:25
Uji's VIM Session at PolglotConf 2016

Polyglot Conference 2016

Agenda

10:47 Current Vim topic 10:59 Vim plugins / Basic Vim editing 11:15 Buffer 11:30 :wq!

  1. Knows everything in vimtutor
Taken from: https://www.google.com/js/th/xcoWlAKVx6cl2goeDVagdx3OJQvQ3hwXRwBhFWqI9A0.js
@tobyjsullivan
tobyjsullivan / format-preserving-scrubber.sql
Created July 6, 2016 21:23
The Worst FP-scrubber ever
select
REPLACE(
REPLACE(
REPLACE(
REPLACE(
REPLACE(
REPLACE(
REPLACE(
REPLACE(
REPLACE(

Keybase proof

I hereby claim:

  • I am tobyjsullivan on github.
  • I am tobyjsullivan (https://keybase.io/tobyjsullivan) on keybase.
  • I have a public key whose fingerprint is 83B7 3260 0458 4279 4822 08B3 6841 6B6A C3FD 5E88

To claim this, I am signing this object: