Skip to content

Instantly share code, notes, and snippets.

Russell Jurney rjurney

Block or report user

Report or block rjurney

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
@rjurney
rjurney / git.txt
Last active Aug 29, 2015
Unable to push local commits to remote?
View git.txt
Russells-MacBook-Pro:azkaban2 rjurney$ git remote -v
origin https://github.com/azkaban/azkaban2.git (fetch)
origin https://github.com/azkaban/azkaban2.git (push)
rjurney git@github.com:rjurney/azkaban2.git (fetch)
rjurney git@github.com:rjurney/azkaban2.git (push)
Russells-MacBook-Pro:azkaban2 rjurney$ git branch -v
master cb88bf7 [ahead 60] Merge branch 'master' of https://github.com/azkaban/azkaban2
* remotes/origin/release-2.5 963a85f All my hacks to Azkaban.
v cb88bf7 Merge branch 'master' of https://github.com/azkaban/azkaban2
@rjurney
rjurney / test.sh
Created Jun 23, 2014
Failed checkout
View test.sh
Russells-MacBook-Pro:spark rjurney$ git checkout -b pyspark-inputformats mlnick/pyspark-inputformats
fatal: Cannot update paths and switch to branch 'pyspark-inputformats' at the same time.
Did you intend to checkout 'mlnick/pyspark-inputformats' which can not be resolved as commit?
@rjurney
rjurney / jruby.rb
Created Jun 26, 2014
Phoenix JDBC connection never returns...
View jruby.rb
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.Statement;
import com.salesforce.phoenix.jdbc.PhoenixDriver
Java::com.salesforce.phoenix.jdbc.PhoenixDriver
DriverManager.registerDriver("com.salesforce.phoenix.jdbc.PhoenixDriver")
conn = DriverManager.get_connection("jdbc:phoenix:hiveapp1,hiveapp2:2181")
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
@rjurney
rjurney / grails.fail
Created Jun 26, 2014
Unable to run Lipstick server
View grails.fail
[hivedata@hivedev1 lipstick-server]$ ./grailsw run-app
| Running Grails application
| Error 2014-06-26 15:14:08,239 [localhost-startStop-1] ERROR context.GrailsContextLoader - Error initializing the application: Error creating bean with name 'transactionManagerPostProcessor': Initialization of bean failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'transactionManager': Cannot resolve reference to bean 'sessionFactory' while setting bean property 'sessionFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'sessionFactory': Cannot resolve reference to bean 'hibernateProperties' while setting bean property 'hibernateProperties'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hibernateProperties': Cannot resolve reference to bean 'dialectDetector' while setting bean property 'properties' with key [hibernate.dialect]; nested
@rjurney
rjurney / udfs.py
Last active Aug 29, 2015
How can I optimize this Python code?
View udfs.py
from pig_util import outputSchema
import sys, os, re
@outputSchema('matches:bag{t:tuple(name:chararray)}') # I am a pig schema
def match_names(one_name, all_names): #all_names is an array with 150,000 string elements
match_pairs = []
for name_tuple in all_names:
name = name_tuple[0]
match = one_name.find(name)
if match >= 0:
@rjurney
rjurney / happiness.pig
Last active Aug 29, 2015
How can I increase the parallelism of the happiness relation? Specifically the STREAM operation that defines the 'happiness' relation.
View happiness.pig
grouped = GROUP links BY (sourceNameOrIp, destinationNameOrIp, $filter);
sorted_grouped = FOREACH grouped {
sorted_datetimes = ORDER links BY date_time;
GENERATE FLATTEN(group) AS (sourceNameOrIp, destinationNameOrIp, $filter),
sorted_datetimes.(date_time) AS sorted_datetimes,
sorted_datetimes.(log_hash) as sorted_loghashes;
};
sorted_grouped = FOREACH sorted_grouped GENERATE sourceNameOrIp, destinationNameOrIp, $filter, sorted_datetimes, sorted_loghashes;
has_beacons = FILTER sorted_grouped by SIZE(sorted_datetimes) > 1;
has_beacons = FOREACH has_beacons GENERATE SIZE(sorted_datetimes) AS total;
@rjurney
rjurney / web_proxy_mef.json
Created Aug 12, 2014
Web Proxy MEF - raw records
View web_proxy_mef.json
{
u'applicationProtocol': u'http',
u'bytesIn': 1095,
u'bytesOut': 10733,
u'cefSignatureId': u'200',
u'destinationAddress': None,
u'destinationDnsDomain': u'on24.com',
u'destinationHostName': u'webcast.on24.com',
u'destinationMacAddress': None,
u'destinationNameOrIp': u'webcast.on24.com',
View dhcp.json
{
u'cefSignatureId': u'DHCPACK',
u'destinationAddress': u'45.102.1.162',
u'destinationDnsDomain': u'cathedraticumunwedded',
u'destinationHostName': u'cathedraticumunwedded',
u'destinationMacAddress': u'2b: f5: 32: b8: 92: 99',
u'destinationNameOrIp': u'cathedraticumunwedded',
u'destinationNtDomain': None,
u'deviceAddress': None,
u'deviceDnsDomain': None,
@rjurney
rjurney / foo.json
Created Aug 12, 2014
Time Series Example
View foo.json
{
count: 63,
group: {
type: "cefSignatureId",
groupField: "206",
periodSeconds: 600
},
timeSeries: [
{
bitsOutPerSecond: 338021.6,
@rjurney
rjurney / foo.json
Created Aug 12, 2014
Time Series Example
View foo.json
{
count: 63,
group: {
type: "cefSignatureId",
groupField: "206",
periodSeconds: 600
},
timeSeries: [
{
bitsOutPerSecond: 338021.6,
You can’t perform that action at this time.