Skip to content

Instantly share code, notes, and snippets.

View gist:beba4ee3886e4ae2a83d3b20e854912e
Verifying my Blockstack ID is secured with the address 17A8NXPtwsHgbvVrRjiRBk7inPah6H8avS https://explorer.blockstack.org/address/17A8NXPtwsHgbvVrRjiRBk7inPah6H8avS
View cake.scala
trait ThingRepository {
def findThing(id: String): Try[Option[Thing]]
}
trait ThingService extends ThingRepository {
def doSomething(id: String): Unit = {
findThing(id) //then do something else...
}
}
View BulkProcessorIndexer.java
package org.apache.flink.streaming.connectors.elasticsearch2;
import org.elasticsearch.action.bulk.BulkProcessor;
import org.elasticsearch.action.ActionRequest;
public class BulkProcessorIndexer implements Elasticsearch2Indexer {
private final BulkProcessor bulkProcessor;
public BulkProcessorIndexer(BulkProcessor bulkProcessor) {
this.bulkProcessor = bulkProcessor;
View gist:0fc76242702fb803c0c1
2015-04-12 14:51:13,231 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1428864489761_0001_000001
2015-04-12 14:51:13,487 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-04-12 14:51:13,501 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-04-12 14:51:13,600 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-04-12 14:51:13,616 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@787582d3)
2015-04-12 14:51:13,627 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 1. Attempt num: 1 is last retry: false
2015-04-12 14:51:13,634 INFO [main] org.
View gist:b6eddaea76343baebad9
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-12T18:49:10,051 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-12T18:49:10,123 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-12T18:49:10,810 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remoteRepositories=[https://repo1.maven.org/m
View gist:56c77860fb75bb844f80
bash-4.1# bin/hadoop fs -ls /druid-working/classpath | grep hadoop
-rw-r--r-- 3 root supergroup 126192 2015-04-11 13:10 /druid-working/classpath/druid-indexing-hadoop-0.7.1.1.jar
-rw-r--r-- 3 root supergroup 16778 2015-04-11 13:10 /druid-working/classpath/hadoop-annotations-2.3.0.jar
-rw-r--r-- 3 root supergroup 17036 2015-04-11 13:10 /druid-working/classpath/hadoop-annotations-2.4.1.jar
-rw-r--r-- 3 root supergroup 49920 2015-04-11 13:10 /druid-working/classpath/hadoop-auth-2.3.0.jar
-rw-r--r-- 3 root supergroup 50524 2015-04-11 13:10 /druid-working/classpath/hadoop-auth-2.4.1.jar
-rw-r--r-- 3 root supergroup 2559 2015-04-11 13:10 /druid-working/classpath/hadoop-client-2.3.0.jar
-rw-r--r-- 3 root supergroup 2831223 2015-04-11 13:10 /druid-working/classpath/hadoop-common-2.3.0.jar
-rw-r--r-- 3 root supergroup 1510793 2015-04-11 13:10 /druid-working/classpath/hadoop-common-2.4.1-tests.jar
-rw-r--r-- 3 root supergroup 2850191 2015-04-11 13:10 /druid-worki
View gist:0d72c2dd45d23842b2a1
2015-04-11 12:04:51,486 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1428768036084_0001_000001
2015-04-11 12:04:51,779 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-04-11 12:04:51,793 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-04-11 12:04:51,864 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-04-11 12:04:51,887 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-04-11 12:04:51,935 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@3628d98d)
2015-04-11 12:04:51,957 INFO [
View gist:7b70f447a99bd7e9aded
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-11T16:01:28,229 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-11T16:01:28,299 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-11T16:01:29,011 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remot
View gist:fca6a58e3736ed97d3c2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-11T15:08:28,550 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-11T15:08:28,595 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-11T15:08:29,325 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remot
View gist:44e35eb369c26491fe8f
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-11T13:40:15,661 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-11T13:40:15,747 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-11T13:40:16,469 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remot