Skip to content

Instantly share code, notes, and snippets.

View noahgift's full-sized avatar
🎯
#mlops

Noah Gift noahgift

🎯
#mlops
View GitHub Profile
@noahgift
noahgift / Jenkins-Pylint-Report
Created August 27, 2011 23:33
Jenkins-Pylint-Report
Report
======
171 statements analysed.
Messages by category
--------------------
+-----------+-------+---------+-----------+
|type |number |previous |difference |
+===========+=======+=========+===========+
@noahgift
noahgift / CoberturaNoAnt.txt
Created November 27, 2011 22:30
CoberturaNoAnt
$/Users/noahgift/Downloads/cobertura-1.9.4.1/examples/basic ant test
Buildfile: /Users/noahgift/Downloads/cobertura-1.9.4.1/examples/basic/build.xml
init:
compile:
[javac] /Users/noahgift/Downloads/cobertura-1.9.4.1/examples/basic/build.xml:36: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
test:
@noahgift
noahgift / build.xml
Created November 29, 2011 17:38
Cobertura Example Build Path
<property file="build.properties" />
<path id="cobertura.classpath">
<fileset dir="${cobertura.dir}">
<include name="cobertura.jar" />
<include name="lib/**/*.jar" />
</fileset>
</path>
@noahgift
noahgift / trackeback_wyndor
Created April 10, 2012 01:41
Wyndor trackeback
$Day-Walker.local:/Users/noahgift/Downloads pyomo --debug wyndor1.py
[ 0.00] Setting up Pyomo environment
[ 0.00] Applying Pyomo preprocessing actions
DEBUG: "[base]/coopr/pyomo/base/sets.py", 263, construct
Constructing _SetContainer, name=WeeklyProd_index, from data=None
DEBUG: "[base]/coopr/pyomo/base/var.py", 479, construct
Constructing Variable, name=WeeklyProd, from data=None
DEBUG: "[base]/coopr/pyomo/base/objective.py", 223, construct
Constructing objective obj
DEBUG: "[base]/coopr/pyomo/base/sets.py", 263, construct
@noahgift
noahgift / gist:2347841
Created April 10, 2012 01:42
Wyndor traceback
$Day-Walker.local:/Users/noahgift/Downloads pyomo --debug wyndor1.py
[ 0.00] Setting up Pyomo environment
[ 0.00] Applying Pyomo preprocessing actions
DEBUG: "[base]/coopr/pyomo/base/sets.py", 263, construct
Constructing _SetContainer, name=WeeklyProd_index, from data=None
DEBUG: "[base]/coopr/pyomo/base/var.py", 479, construct
Constructing Variable, name=WeeklyProd, from data=None
DEBUG: "[base]/coopr/pyomo/base/objective.py", 223, construct
Constructing objective obj
DEBUG: "[base]/coopr/pyomo/base/sets.py", 263, construct
#! /usr/bin/env python
from optparse import OptionParser
import smtplib
from smtplib import SMTP_SSL as SMTP
from email.mime.multipart import MIMEMultipart
from email.mime.text import MIMEText
from boto.opsworks.layer1 import OpsWorksConnection
if ($lastexitcode -ne 0) {
throw $errorMessage
}
[{"sport":"nfl","external_id":"BUF","name":"Bills","location":"Buffalo","abbreviation":"BUF","conference":"AFC","division":"AFC_EAST","subdivision":"none"},{"sport":"nfl","external_id":"MIA","name":"Dolphins","location":"Miami","abbreviation":"MIA","conference":"AFC","division":"AFC_EAST","subdivision":"none"},{"sport":"nfl","external_id":"NYJ","name":"Jets","location":"New York","abbreviation":"NYJ","conference":"AFC","division":"AFC_EAST","subdivision":"none"},{"sport":"nfl","external_id":"NE","name":"Patriots","location":"New England","abbreviation":"NE","conference":"AFC","division":"AFC_EAST","subdivision":"none"},{"sport":"nfl","external_id":"CIN","name":"Bengals","location":"Cincinnati","abbreviation":"CIN","conference":"AFC","division":"AFC_NORTH","subdivision":"none"},{"sport":"nfl","external_id":"CLE","name":"Browns","location":"Cleveland","abbreviation":"CLE","conference":"AFC","division":"AFC_NORTH","subdivision":"none"},{"sport":"nfl","external_id":"BAL","name":"Ravens","location":"Baltimore","ab
@noahgift
noahgift / gist:8249609
Created January 4, 2014 00:30
count uniq teams
root@rejigger1:/var/log# less sqor-rejigger-console.log.0 | grep sportsdata | grep nfl | grep ft_sportsdata:sync_team_players | cut -f 8 -d " " | cut -f 2 -d = | tr -d '<<>>"' | sort | uniq | wc -l
32
>
import sys
from pyspark.sql import SQLContext, SparkSession
from pyspark import SparkContext, SparkConf
Command took 0.07 seconds -- by noah.gift@18birdies.com at 12/28/2016, 1:57:21 PM on dev-dp-mongo-etl
>
sparkConf = SparkConf().setMaster("local").setAppName("MongoSparkConnectorTour").set("spark.app.id", "MongoSparkConnectorTour")