This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
diff --git a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
index 30551b989f1..b119bc7af67 100644 | |
--- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
+++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
@@ -50,10 +50,10 @@ | |
<property> | |
<name>hadoop.http.filter.initializers</name> | |
<value>org.apache.hadoop.http.lib.StaticUserWebFilter</value> | |
- <description>A comma separated list of class names. Each class in the list | |
- must extend org.apache.hadoop.http.FilterInitializer. The corresponding |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
val version = getCurrentVersionFromConnector | |
val appId = getCurrentAppIdFromConnector | |
val txn = startTxn() | |
val versionInTxn = txn.txnVersion(appId) | |
if (version <= versionInTxn) { | |
// Skip the write that's done | |
return | |
} | |
// write files and commit |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package rx.android.observables; | |
import rx.Observable; | |
import rx.Observable.OnSubscribe; | |
import rx.Subscriber; | |
import rx.android.subscriptions.AndroidSubscriptions; | |
import rx.functions.Action0; | |
import android.content.BroadcastReceiver; | |
import android.content.Context; | |
import android.content.Intent; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
watermark = 1 hour | |
First batch (max event time = null): | |
2017-06-07 10:00:00.000 | |
StateStore will store 2017-06-07 10:00:00.000 | |
Second batch (max event time = 2017-06-07 10:00:00.000): | |
2017-06-07 11:00:00.000 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Pig: | |
org.apache.pig.newplan.logical.relational.LogicalPlan | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans.MROperPlan | |
org.apache.pig.parser.QueryParserDriver.parse(String) | |
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(LogicalPlan,Properties) | |
org.apache.pig.PigServer.launchPlan(PhysicalPlan,String) | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.compile(PhysicalPlan,PigContext) | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(MROperPlan,MapReduceOper,Configuration,PigContext) | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(MROperPlan,String) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Observable.just(1) | |
.doOnSubscribe(() -> System.out.println("before 1st doOnSubscribe: " + Thread.currentThread().getName())) | |
.subscribeOn(Schedulers.newThread()) | |
.doOnSubscribe(() -> System.out.println("before 2nd doOnSubscribe: " + Thread.currentThread().getName())) | |
.subscribeOn(Schedulers.io()) | |
.doOnSubscribe(() -> System.out.println("before 3rd doOnSubscribe: " + Thread.currentThread().getName())) | |
.subscribeOn(Schedulers.computation()) | |
.doOnSubscribe(() -> System.out.println("before subscribe: " + Thread.currentThread().getName())) | |
.subscribe(new Subscriber<Integer>() { | |
@Override |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package streaming.app | |
import java.util.UUID | |
import scala.util.Random | |
import scala.util.control.NonFatal | |
import org.apache.commons.io.IOUtils | |
import org.apache.hadoop.fs.{Path, FileSystem} | |
import org.apache.spark.sql.SQLContext |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import rx.lang.scala.Observable._ | |
import rx.lang.scala.JavaConversions._ | |
import rx.lang.scala.ImplicitFunctionConversions._ | |
import rx.util.async.Async | |
import java.util.concurrent.Executors | |
import rx.schedulers.Schedulers | |
object Test extends App { | |
val executor = Executors.newFixedThreadPool(10) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
apply plugin: 'scala' | |
apply plugin: 'eclipse' | |
sourceCompatibility = JavaVersion.VERSION_1_6 | |
targetCompatibility = JavaVersion.VERSION_1_6 | |
eclipse { | |
classpath { | |
downloadSources = true | |
downloadJavadoc = false |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash -e | |
set -e |
NewerOlder