Last active
December 21, 2021 08:36
-
-
Save gecko655/14641fba1c0fb7bfff4e78b909087389 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
git clone git@github.com:GoogleCloudPlatform/DataflowTemplates.git DataflowTemplates | |
cd DataflowTemplates/v2 | |
git rev-parse HEAD | |
# -> 68e6939d82e1ad84aa69f33e59c74d6bdea89a3e | |
docker run --rm -v $(pwd):/root --entrypoint=bash gcr.io/cloud-builders/mvn@sha256:d2142eae8adb79128665fdfb2953cb3135ef83b9f21c3d113273bc8907c88bdf \ | |
-c "cd /root && mvn clean test --batch-mode \ | |
-Dimage=gcr.io/hoge/piyo \ | |
-Dbase-container-image='gcr.io/dataflow-templates-base/java8-template-launcher-base' \ | |
-Dbase-container-image.version=latest \ | |
-Dapp-root=/template/pubsub-cdc-to-bigquery \ | |
-Dcommand-spec=/template/pubsub-cdc-to-bigquery/resources/pubsub-cdc-to-bigquery-command-spec.json \ | |
-am -pl pubsub-cdc-to-bigquery" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
[INFO] Scanning for projects... | |
[INFO] Downloading: https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.5.0.Final/os-maven-plugin-1.5.0.Final.pom | |
[INFO] Downloaded: https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.5.0.Final/os-maven-plugin-1.5.0.Final.pom (6.4 kB at 4.3 kB/s) | |
[INFO] Downloading: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom | |
[INFO] Downloaded: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 16 kB/s) | |
[INFO] Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom | |
[INFO] Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom (3.4 kB at 13 kB/s) | |
# ( ... Download logs omitted) | |
[INFO] | |
[INFO] ------------------------------------------------------- | |
[INFO] T E S T S | |
[INFO] ------------------------------------------------------- | |
[WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 1. See FAQ web page and the dump file /root/common/target/surefire-reports/2021-12-21T07-11-54_417-jvmRun1.dumpstream | |
[INFO] Running com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumerTest | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile1.json | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile2.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile2.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile1.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile2.json. | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile1.json. | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile3.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile3.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile3.json. | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit3868726022661842640/* | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit3868726022661842640/dlqFile1.json | |
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit3868726022661842640/dlqFile1.json. | |
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.266 s - in com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumerTest | |
[INFO] Running com.google.cloud.teleport.v2.cdc.merge.MergeInfoTest | |
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.556 s - in com.google.cloud.teleport.v2.cdc.merge.MergeInfoTest | |
[INFO] Running com.google.cloud.teleport.v2.cdc.sources.DataStreamIOTest | |
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 s - in com.google.cloud.teleport.v2.cdc.sources.DataStreamIOTest | |
[INFO] Running com.google.cloud.teleport.v2.coders.FailsafeElementCoderTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.723 s - in com.google.cloud.teleport.v2.coders.FailsafeElementCoderTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.AccumulateListFnTest | |
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.586 s - in com.google.cloud.teleport.v2.transforms.AccumulateListFnTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.AvroConvertersTest | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/AvroConvertersTest/test_avro_file.avro matched 1 files with total size 264 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/AvroConvertersTest/test_avro_file.avro into bundles of size 66 took 1 ms and produced 1 files and 1 bundles | |
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.725 s - in com.google.cloud.teleport.v2.transforms.AvroConvertersTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.BigQueryConvertersTest | |
log4j:WARN No appenders could be found for logger (org.apache.hadoop.hbase.util.ClassSize). | |
log4j:WARN Please initialize the log4j system properly. | |
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. | |
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.603 s - in com.google.cloud.teleport.v2.transforms.BigQueryConvertersTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.CsvConvertersTest | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 1 ms and produced 1 files and 5 bundles | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv | |
[direct-runner-worker] ERROR com.google.cloud.teleport.v2.transforms.CsvConverters - Headers do not match, consistency cannot be guaranteed | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 0 ms and produced 1 files and 5 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 1 ms and produced 1 files and 5 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv matched 1 files with total size 28 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv into bundles of size 7 took 0 ms and produced 1 files and 4 bundles | |
[direct-runner-worker] ERROR com.google.cloud.teleport.v2.transforms.CsvConverters - Failed to convert Strings to Generic Record. | |
[ERROR] Tests run: 16, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 4.062 s <<< FAILURE! - in com.google.cloud.teleport.v2.transforms.CsvConvertersTest | |
[ERROR] testLineToFailsafeJsonNoHeadersUdf(com.google.cloud.teleport.v2.transforms.CsvConvertersTest) Time elapsed: 0.504 s <<< FAILURE! | |
java.lang.AssertionError: TestLineToFailsafeJsonNoHeadersUdf/LineToDocumentUsingUdf/ProcessUdf.out0: null | |
at com.google.cloud.teleport.v2.transforms.CsvConvertersTest.testLineToFailsafeJsonNoHeadersUdf(CsvConvertersTest.java:310) | |
Caused by: java.util.NoSuchElementException | |
at com.google.cloud.teleport.v2.transforms.CsvConvertersTest.lambda$testLineToFailsafeJsonNoHeadersUdf$43268ee4$1(CsvConvertersTest.java:313) | |
[INFO] Running com.google.cloud.teleport.v2.transforms.DLQWriteTransformTest | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Opening writer 129303c0-f384-4fe4-92c2-c91108777208 for window [2021-12-21T07:12:00.000Z..2021-12-21T07:13:00.000Z) pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink$Writer - Successfully wrote temporary file /tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208 | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Finalizing 1 file results | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will copy temporary file FileResult{tempFilename=/tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208, shard=6, window=[2021-12-21T07:12:00.000Z..2021-12-21T07:13:00.000Z), paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/junit8864378803229941601/dlq/error-00006-of-00020.json | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will remove known temporary file /tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208 | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.55 s - in com.google.cloud.teleport.v2.transforms.DLQWriteTransformTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.ErrorConvertersTest | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Opening writer f4c44452-e2c9-4b1f-8c22-cd20b8867280 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@340b9973 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink$Writer - Successfully wrote temporary file /tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280 | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Finalizing 1 file results | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Finalizing for destination null num shards 1. | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will copy temporary file FileResult{tempFilename=/tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@340b9973, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/junit8403355132876717001errors.txt-00000-of-00001 | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will remove known temporary file /tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280 | |
[direct-runner-worker] WARN org.apache.beam.sdk.io.FileBasedSink - Failed to match temporary files under: [/tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/]. | |
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.303 s - in com.google.cloud.teleport.v2.transforms.ErrorConvertersTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.FailsafeElementTransformsTest | |
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.993 s - in com.google.cloud.teleport.v2.transforms.FailsafeElementTransformsTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.FormatDatastreamRecordToJsonTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.212 s - in com.google.cloud.teleport.v2.transforms.FormatDatastreamRecordToJsonTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest | |
[pool-144-thread-1] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request cannot be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b/some/o/bad%2Frandom%2Fpath. | |
[ERROR] Tests run: 11, Failures: 3, Errors: 4, Skipped: 0, Time elapsed: 6.548 s <<< FAILURE! - in com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest | |
[ERROR] testInvokeScriptException(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.004 s <<< FAILURE! | |
java.lang.AssertionError: | |
Expected: an instance of javax.script.ScriptException | |
got: <java.lang.NullPointerException> | |
[ERROR] testInvokeUndefined(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.017 s <<< ERROR! | |
java.lang.NullPointerException | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testInvokeUndefined(JavascriptTextTransformerTest.java:135) | |
[ERROR] testDoFnGood(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.281 s <<< ERROR! | |
org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NullPointerException | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testDoFnGood(JavascriptTextTransformerTest.java:160) | |
Caused by: java.lang.NullPointerException | |
[ERROR] testDoFnDisregards(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.109 s <<< ERROR! | |
org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NullPointerException | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testDoFnDisregards(JavascriptTextTransformerTest.java:250) | |
Caused by: java.lang.NullPointerException | |
[ERROR] testFailsafeJavaScriptUdfValidInput(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.269 s <<< FAILURE! | |
java.lang.AssertionError: InvokeUdf/ProcessUdf.out0: null | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testFailsafeJavaScriptUdfValidInput(JavascriptTextTransformerTest.java:289) | |
Caused by: java.util.NoSuchElementException | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.lambda$testFailsafeJavaScriptUdfValidInput$b25e2d0e$1(JavascriptTextTransformerTest.java:292) | |
[ERROR] testFailsafeJavaScriptUdfInvalidInput(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.232 s <<< FAILURE! | |
java.lang.AssertionError: | |
InvokeUdf/ProcessUdf.out1: | |
Expected: is not null | |
got: null | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testFailsafeJavaScriptUdfInvalidInput(JavascriptTextTransformerTest.java:352) | |
Caused by: java.lang.AssertionError: | |
Expected: is not null | |
got: null | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.lambda$testFailsafeJavaScriptUdfInvalidInput$b25e2d0e$1(JavascriptTextTransformerTest.java:361) | |
[ERROR] testInvokeGood(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.011 s <<< ERROR! | |
java.lang.NullPointerException | |
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testInvokeGood(JavascriptTextTransformerTest.java:120) | |
[INFO] Running com.google.cloud.teleport.v2.transforms.JsonConvertersTest | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_field_record.json matched 1 files with total size 12 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_field_record.json into bundles of size 3 took 2 ms and produced 1 files and 4 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/numeric_fields_record.json matched 1 files with total size 43 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/numeric_fields_record.json into bundles of size 10 took 1 ms and produced 1 files and 5 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/nested_fields_record.json matched 1 files with total size 32 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/nested_fields_record.json into bundles of size 8 took 0 ms and produced 1 files and 4 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/array_of_records.json matched 1 files with total size 53 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/array_of_records.json into bundles of size 13 took 1 ms and produced 1 files and 4 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json matched 1 files with total size 12 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json into bundles of size 3 took 1 ms and produced 1 files and 4 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json matched 1 files with total size 12 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json into bundles of size 3 took 1 ms and produced 1 files and 4 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json matched 1 files with total size 3 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json into bundles of size 0 took 0 ms and produced 1 files and 3 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json matched 1 files with total size 3 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json into bundles of size 0 took 2 ms and produced 1 files and 3 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_not_null_field.json matched 1 files with total size 10 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_not_null_field.json into bundles of size 2 took 3 ms and produced 1 files and 5 bundles | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/json_records.json matched 1 files with total size 57 | |
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/json_records.json into bundles of size 14 took 1 ms and produced 1 files and 4 bundles | |
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.667 s - in com.google.cloud.teleport.v2.transforms.JsonConvertersTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.KeyValueToGenericRecordFnTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.244 s - in com.google.cloud.teleport.v2.transforms.KeyValueToGenericRecordFnTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.ParquetConvertersTest | |
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /root/common/target/test-classes/ParquetConvertersTest/test_parquet_file.parquet | |
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - RecordReader initialized will read a total of 1 records. | |
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - at row 0. reading next block | |
[direct-runner-worker] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor [.snappy] | |
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - block read in memory in 395 ms. row count = 1 | |
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.958 s - in com.google.cloud.teleport.v2.transforms.ParquetConvertersTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.PythonTextTransformerTest | |
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0 s - in com.google.cloud.teleport.v2.transforms.PythonTextTransformerTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSAvroTest | |
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSAvroTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSParquetTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSParquetTest | |
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSTextTest | |
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSTextTest | |
[INFO] Running com.google.cloud.teleport.v2.utils.DataStreamClientTest | |
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.01 s - in com.google.cloud.teleport.v2.utils.DataStreamClientTest | |
[INFO] Running com.google.cloud.teleport.v2.utils.SchemaUtilsTest | |
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.067 s - in com.google.cloud.teleport.v2.utils.SchemaUtilsTest | |
[INFO] Running com.google.cloud.teleport.v2.utils.SerializableSchemaSupplierTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in com.google.cloud.teleport.v2.utils.SerializableSchemaSupplierTest | |
[INFO] Running com.google.cloud.teleport.v2.values.FailsafeElementTest | |
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in com.google.cloud.teleport.v2.values.FailsafeElementTest | |
[INFO] | |
[INFO] Results: | |
[INFO] | |
[ERROR] Failures: | |
[ERROR] CsvConvertersTest.testLineToFailsafeJsonNoHeadersUdf:310 TestLineToFailsafeJsonNoHeadersUdf/LineToDocumentUsingUdf/ProcessUdf.out0: null | |
[ERROR] JavascriptTextTransformerTest.testFailsafeJavaScriptUdfInvalidInput:352 InvokeUdf/ProcessUdf.out1: | |
Expected: is not null | |
got: null | |
[ERROR] JavascriptTextTransformerTest.testFailsafeJavaScriptUdfValidInput:289 InvokeUdf/ProcessUdf.out0: null | |
[ERROR] JavascriptTextTransformerTest.testInvokeScriptException | |
Expected: an instance of javax.script.ScriptException | |
got: <java.lang.NullPointerException> | |
[ERROR] Errors: | |
[ERROR] JavascriptTextTransformerTest.testDoFnDisregards:250 » PipelineExecution java.... | |
[ERROR] JavascriptTextTransformerTest.testDoFnGood:160 » PipelineExecution java.lang.N... | |
[ERROR] JavascriptTextTransformerTest.testInvokeGood:120 » NullPointer | |
[ERROR] JavascriptTextTransformerTest.testInvokeUndefined:135 » NullPointer | |
[INFO] | |
[ERROR] Tests run: 100, Failures: 4, Errors: 4, Skipped: 5 | |
[INFO] | |
[INFO] ------------------------------------------------------------------------ | |
[INFO] Reactor Summary: | |
[INFO] | |
[INFO] dynamic-templates .................................. SUCCESS [09:40 min] | |
[INFO] common ............................................. FAILURE [06:25 min] | |
[INFO] pubsub-cdc-to-bigquery ............................. SKIPPED | |
[INFO] ------------------------------------------------------------------------ | |
[INFO] BUILD FAILURE | |
[INFO] ------------------------------------------------------------------------ | |
[INFO] Total time: 16:20 min | |
[INFO] Finished at: 2021-12-21T07:13:13Z | |
[INFO] Final Memory: 82M/259M | |
[INFO] ------------------------------------------------------------------------ | |
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on project common: There are test failures. | |
[ERROR] | |
[ERROR] Please refer to /root/common/target/surefire-reports for the individual test results. | |
[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. | |
[ERROR] -> [Help 1] | |
[ERROR] | |
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. | |
[ERROR] Re-run Maven using the -X switch to enable full debug logging. | |
[ERROR] | |
[ERROR] For more information about the errors and possible solutions, please read the following articles: | |
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException | |
[ERROR] | |
[ERROR] After correcting the problems, you can resume the build with the command | |
[ERROR] mvn <goals> -rf :common |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment