Kyle Weaver ibzib
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 55 results - 12 files | |
| website/CONTRIBUTE.md: | |
| 192 | |
| 193: ``` | |
| 194: {{< highlight java >}} | |
| 195 // This is java | |
| website/www/site/content/en/documentation/io/built-in/hadoop.md: | |
| 35 |
ibzib
/ parallel-flink-stuck-2
Created
July 2, 2019 23:08
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "MapPartition (MapPartition at [6]{ReadData, DecodeData}) (2/4)" #2113 prio=5 os_prio=0 tid=0x00007fcec0023000 nid=0x1b635 waiting on condition [0x00007fcd507e6000] | |
| java.lang.Thread.State: WAITING (parking) | |
| at (C/C++) 0x00007fcf3ff409f2 (Unknown Source) | |
| at (C/C++) 0x00007fcf3f4e3d99 (Unknown Source) | |
| at sun.misc.Unsafe.park(Native Method) | |
| - parking to wait for <0x00000000fe574fa0> (a org.apache.beam.vendor.guava.v20_0.com.google.common.util.concurrent.SettableFuture) | |
| at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) | |
| at org.apache.beam.vendor.guava.v20_0.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:469) | |
| at org.apache.beam.vendor.guava.v20_0.com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:76) | |
| at org.apache.beam.vendor.guava.v20_0.com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:142) |
ibzib
/ parallel-flink-stuck-1
Created
July 2, 2019 23:07
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "MapPartition (MapPartition at [6]{ReadData, DecodeData}) (3/4)" #1714 prio=5 os_prio=0 tid=0x00007fc964013800 nid=0x78b1 waiting on condition [0x00007fc7f58d3000] | |
| java.lang.Thread.State: WAITING (parking) | |
| at (C/C++) 0x00007fc9f12ac9f2 (Unknown Source) | |
| at (C/C++) 0x00007fc9f084fd99 (Unknown Source) | |
| at sun.misc.Unsafe.park(Native Method) | |
| - parking to wait for <0x00000000dd681b50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) ** can try tracking down the lock | |
| at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) | |
| at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) | |
| at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) | |
| at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ClientCalls$ThreadlessExecutor.waitAndDrain(ClientCalls.java:629) |
ibzib
/ spark-pwc-error.txt
Created
May 13, 2019 18:22
Beam portable word count fails on Spark with `pre_optimize=all` set
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ERROR:root:java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_4, PCollection=unique_name: "57read/Read/Reshuffle/ReshufflePerKey/Map(reify_timestamps).None" | |
| coder_id: "ref_Coder_TupleCoder_5_length_prefixed" | |
| is_bounded: BOUNDED | |
| windowing_strategy_id: "ref_Windowing_Windowing_2" | |
| }, PCollectionNode{id=ref_PCollection_PCollection_24, PCollection=unique_name: "46write/Write/WriteImpl/WindowInto(WindowIntoFn).None" | |
| coder_id: "ref_Coder_TupleCoder_4_length_prefixed" | |
| is_bounded: BOUNDED | |
| windowing_strategy_id: "ref_Windowing_Windowing_1" | |
| }, PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "13pair_with_one.None" | |
| coder_id: "ref_Coder_TupleCoder_11" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| PCollection<String> a = pipeline.apply(Impulse.create()) | |
| .apply("a", ParDo.of(new DoFn<byte[], String>() { | |
| @ProcessElement | |
| public void processElement(ProcessContext context) { | |
| System.out.println("A"); | |
| context.output("a"); | |
| } | |
| })); | |
| PCollection<String> ab = a.apply("b", ParDo.of(new DoFn<String, String>() { | |
| @ProcessElement |