This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
| index 30551b989f1..b119bc7af67 100644 | |
| --- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
| +++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | |
| @@ -50,10 +50,10 @@ | |
| <property> | |
| <name>hadoop.http.filter.initializers</name> | |
| <value>org.apache.hadoop.http.lib.StaticUserWebFilter</value> | |
| - <description>A comma separated list of class names. Each class in the list | |
| - must extend org.apache.hadoop.http.FilterInitializer. The corresponding |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| val version = getCurrentVersionFromConnector | |
| val appId = getCurrentAppIdFromConnector | |
| val txn = startTxn() | |
| val versionInTxn = txn.txnVersion(appId) | |
| if (version <= versionInTxn) { | |
| // Skip the write that's done | |
| return | |
| } | |
| // write files and commit |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package rx.android.observables; | |
| import rx.Observable; | |
| import rx.Observable.OnSubscribe; | |
| import rx.Subscriber; | |
| import rx.android.subscriptions.AndroidSubscriptions; | |
| import rx.functions.Action0; | |
| import android.content.BroadcastReceiver; | |
| import android.content.Context; | |
| import android.content.Intent; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| watermark = 1 hour | |
| First batch (max event time = null): | |
| 2017-06-07 10:00:00.000 | |
| StateStore will store 2017-06-07 10:00:00.000 | |
| Second batch (max event time = 2017-06-07 10:00:00.000): | |
| 2017-06-07 11:00:00.000 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Pig: | |
| org.apache.pig.newplan.logical.relational.LogicalPlan | |
| org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan | |
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans.MROperPlan | |
| org.apache.pig.parser.QueryParserDriver.parse(String) | |
| org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(LogicalPlan,Properties) | |
| org.apache.pig.PigServer.launchPlan(PhysicalPlan,String) | |
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.compile(PhysicalPlan,PigContext) | |
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(MROperPlan,MapReduceOper,Configuration,PigContext) | |
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(MROperPlan,String) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Observable.just(1) | |
| .doOnSubscribe(() -> System.out.println("before 1st doOnSubscribe: " + Thread.currentThread().getName())) | |
| .subscribeOn(Schedulers.newThread()) | |
| .doOnSubscribe(() -> System.out.println("before 2nd doOnSubscribe: " + Thread.currentThread().getName())) | |
| .subscribeOn(Schedulers.io()) | |
| .doOnSubscribe(() -> System.out.println("before 3rd doOnSubscribe: " + Thread.currentThread().getName())) | |
| .subscribeOn(Schedulers.computation()) | |
| .doOnSubscribe(() -> System.out.println("before subscribe: " + Thread.currentThread().getName())) | |
| .subscribe(new Subscriber<Integer>() { | |
| @Override |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package streaming.app | |
| import java.util.UUID | |
| import scala.util.Random | |
| import scala.util.control.NonFatal | |
| import org.apache.commons.io.IOUtils | |
| import org.apache.hadoop.fs.{Path, FileSystem} | |
| import org.apache.spark.sql.SQLContext |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import rx.lang.scala.Observable._ | |
| import rx.lang.scala.JavaConversions._ | |
| import rx.lang.scala.ImplicitFunctionConversions._ | |
| import rx.util.async.Async | |
| import java.util.concurrent.Executors | |
| import rx.schedulers.Schedulers | |
| object Test extends App { | |
| val executor = Executors.newFixedThreadPool(10) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| apply plugin: 'scala' | |
| apply plugin: 'eclipse' | |
| sourceCompatibility = JavaVersion.VERSION_1_6 | |
| targetCompatibility = JavaVersion.VERSION_1_6 | |
| eclipse { | |
| classpath { | |
| downloadSources = true | |
| downloadJavadoc = false |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash -e | |
| set -e |
NewerOlder