Alexey Romanenko aromanenko-dev
aromanenko-dev
/ gist:8f948ae016e920e3ba96f3f0d37eef81
Created
January 17, 2018 10:34
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/sdks/java/io/kinesis/pom.xml b/sdks/java/io/kinesis/pom.xml | |
| index 41ee27267..246b36173 100644 | |
| --- a/sdks/java/io/kinesis/pom.xml | |
| +++ b/sdks/java/io/kinesis/pom.xml | |
| @@ -33,6 +33,28 @@ | |
| <plugins> | |
| <plugin> | |
| <groupId>org.apache.maven.plugins</groupId> | |
| + <artifactId>maven-failsafe-plugin</artifactId> | |
| + <configuration> |
aromanenko-dev
/ diff
Created
January 17, 2018 10:58
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/sdks/java/io/kinesis/pom.xml b/sdks/java/io/kinesis/pom.xml | |
| index 41ee27267..c5bab2256 100644 | |
| --- a/sdks/java/io/kinesis/pom.xml | |
| +++ b/sdks/java/io/kinesis/pom.xml | |
| @@ -33,6 +33,28 @@ | |
| <plugins> | |
| <plugin> | |
| <groupId>org.apache.maven.plugins</groupId> | |
| + <artifactId>maven-failsafe-plugin</artifactId> | |
| + <configuration> |
aromanenko-dev
/ diff
Created
January 18, 2018 14:11
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/sdks/java/io/kinesis/pom.xml b/sdks/java/io/kinesis/pom.xml | |
| index 41ee27267..16db065f2 100644 | |
| --- a/sdks/java/io/kinesis/pom.xml | |
| +++ b/sdks/java/io/kinesis/pom.xml | |
| @@ -40,6 +40,48 @@ | |
| <reuseForks>false</reuseForks> | |
| </configuration> | |
| </plugin> | |
| + | |
| + <plugin> |
aromanenko-dev
/ diff
Created
January 22, 2018 13:31
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/sdks/java/io/kinesis/pom.xml b/sdks/java/io/kinesis/pom.xml | |
| index 41ee27267..bc54d7e0b 100644 | |
| --- a/sdks/java/io/kinesis/pom.xml | |
| +++ b/sdks/java/io/kinesis/pom.xml | |
| @@ -43,6 +43,61 @@ | |
| </plugins> | |
| </build> | |
| + <profiles> | |
| + <profile> |
aromanenko-dev
/ gist:372d828abfb9eb25baefe632e21a2ac2
Created
March 29, 2018 13:15
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Pipeline pipeline = Pipeline.create(); |
aromanenko-dev
/ gist:a42a0a011f9fbd10b8443bf2ca38c68a
Created
April 9, 2018 10:02
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| MacBook-Pro-de-Alexey:nexmark aromanenko$ mvn -Pdirect-runner exec:java -Dexec.mainClass=org.apache.beam.sdk.nexmark.Main "-Dexec.args=--sinkType=PUBSUB --runner=DirectRunner --query=1 --streaming=false --manageResources=false --monitorJobs=true --enforceEncodability=false --enforceImmutability=false --pubsubRootUrl=http://localhost:8085 --pubsubSubscription=projects/nexmark/subscriptions/source --pubsubTopic=projects/nexmark/topics/sink --resourceNameMode=VERBATIM --sourceType=PUBSUB --pubSubMode=COMBINED" | |
| [INFO] Scanning for projects... | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] Detecting the operating system and CPU architecture | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] os.detected.name: osx | |
| [INFO] os.detected.arch: x86_64 | |
| [INFO] os.detected.version: 10.13 | |
| [INFO] os.detected.version.major: 10 | |
| [INFO] os.detected.version.minor: 13 |
aromanenko-dev
/ 1.java
Created
April 24, 2018 10:13
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| .apply("ParseAndConvertToKV", MapElements.via( | |
| new SimpleFunction<String, KV<String, Integer>>() { | |
| @Override | |
| public KV<String, Integer> apply(String input) { | |
| String[] split = input.split(","); | |
| if (split.length < 4) { | |
| return null; | |
| } | |
| String key = split[1]; | |
| Integer value = Integer.valueOf(split[3]); |
aromanenko-dev
/ snippet1.java
Created
April 24, 2018 10:14
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| .apply("ParseAndConvertToKV", MapElements.via( | |
| new SimpleFunction<String, KV<String, Integer>>() { | |
| @Override | |
| public KV<String, Integer> apply(String input) { | |
| String[] split = input.split(","); | |
| if (split.length < 4) { | |
| return null; | |
| } | |
| String key = split[1]; | |
| Integer value = Integer.valueOf(split[3]); |
aromanenko-dev
/ gist:b99ad6eb9d7b6de31b8e9607b37aaefb
Created
November 27, 2019 11:09
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff -u sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/AmazonKinesisMock.java sdks/java/io/kinesis2/src/test/java/org/apache/beam/sdk/io/kinesis2/AmazonKinesisMock.java | |
| --- sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/AmazonKinesisMock.java 2019-10-26 20:23:24.000000000 -0700 | |
| +++ sdks/java/io/kinesis2/src/test/java/org/apache/beam/sdk/io/kinesis2/AmazonKinesisMock.java 2019-10-27 12:35:16.000000000 -0700 | |
| @@ -15,83 +15,14 @@ | |
| * See the License for the specific language governing permissions and | |
| * limitations under the License. | |
| */ | |
| -package org.apache.beam.sdk.io.kinesis; | |
| +package org.apache.beam.sdk.io.kinesis2; | |
aromanenko-dev
/ gist:e3aaa81eacfb932e55f7493ba1c2c228
Created
January 20, 2020 15:18
beam_PreCommit_Java_Examples_Dataflow_Phrase
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 11:57:38 > Task :runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker | |
| 11:57:38 | |
| 11:57:38 org.apache.beam.examples.WindowedWordCountIT > testWindowedWordCountInStreamingStaticSharding FAILED | |
| 11:57:38 java.lang.RuntimeException at WindowedWordCountIT.java:188 | |
| 12:06:42 Build timed out (after 30 minutes). Marking the build as aborted. | |
| 12:06:42 Build was aborted | |
| 12:06:42 Recording test results | |
| 12:06:43 Could not stop org.gradle.internal.actor.internal.DefaultActorFactory$NonBlockingActor@1574bf6d. | |
| 12:06:43 org.gradle.internal.dispatch.DispatchException: Could not dispatch message [MethodInvocation method: processTestClass(DefaultTestClassRunInfo(org.apache.beam.examples.WordCountIT))]. | |
| 12:06:43 at org.gradle.internal.dispatch.ExceptionTrackingFailureHandler.dispatchFailed(ExceptionTrackingFailureHandler.java:34) |
OlderNewer