Benjamin Smedberg bsmedberg
bsmedberg
/ saveonerecord.pig
Created
August 9, 2012 18:56
pig problem, can I do scalar assignments?
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| REGISTER 'socorro-toolbox-0.1-SNAPSHOT.jar' | |
| REGISTER 'lib/akela-0.4-SNAPSHOT.jar' | |
| SET pig.logfile saveonerecord.log; | |
| SET default_parallel 2; | |
| SET pig.tmpfilecompression true; | |
| SET pig.tmpfilecompression.codec lzo; | |
| uuid = '$uuid'; | |
| date = SUBSTRING(uuid, 30, 36); |
bsmedberg
/ improveskiplist.pig
Created
August 10, 2012 18:04
How do I use INDEXOF to filter in pig?
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| REGISTER 'socorro-toolbox-0.1-SNAPSHOT.jar' | |
| REGISTER 'lib/akela-0.4-SNAPSHOT.jar' | |
| SET pig.logfile improveskiplist.log; | |
| SET default_parallel 2; | |
| SET pig.tmpfilecompression true; | |
| SET pig.tmpfilecompression.codec lzo; | |
| DEFINE JsonMap com.mozilla.pig.eval.json.JsonMap(); | |
| DEFINE LookupFirstSourceFrame com.mozilla.socorro.pig.eval.LookupFirstSourceFrame(); |
bsmedberg
/ Plugin Video - sample.bug1123888.ipynb
Created
January 21, 2015 17:26
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
bsmedberg
/ gist:9f7cdc6e51034f0bc31c
Created
September 11, 2015 14:32
Something wrong with get_pings or properties
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| pings = get_pings(sc, app="Firefox", channel=["nightly", "aurora", "beta"], , fraction=0.05) | |
| props = get_pings_properties(pings, ["environment/build/xpcomabi", | |
| "environment/build/version", | |
| "environment/build/buildId", | |
| "environment/settings/update/channel", | |
| "environment/settings/e10sEnabled", | |
| "payload/info/subsessionStartDate", | |
| "payload/info/subsessionLength", | |
| "payload/keyedHistograms/SUBPROCESS_ABNORMAL_ABORT"]) |
bsmedberg
/ KeyedAccumulator.ipynb
Created
September 11, 2015 20:21
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| SELECT | |
| buildversion, | |
| buildid, | |
| buildarchitecture, | |
| channel, | |
| os, | |
| osversion, | |
| osservicepackmajor, | |
| osservicepackminor, | |
| locale, |
bsmedberg
/ Hello World.ipynb
Last active
December 10, 2015 22:24
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import psycopg2 | |
| import os | |
| import sys | |
| import csv | |
| from datetime import datetime, date, timedelta | |
| from utils import S3CompressedWriter | |
| from summarize import summarize | |
| # How many days "back" do we look for activity? | |
| latency_interval = 10 |
bsmedberg
/ addon-distribution.ipynb
Created
February 12, 2016 14:22
addon-distribution .take(20) issue
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
bsmedberg
/ addon-distribution.ipynb
Created
February 19, 2016 03:49
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
OlderNewer