Skip to content

Instantly share code, notes, and snippets.

@gecko655
Last active December 21, 2021 08:36
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save gecko655/14641fba1c0fb7bfff4e78b909087389 to your computer and use it in GitHub Desktop.
Save gecko655/14641fba1c0fb7bfff4e78b909087389 to your computer and use it in GitHub Desktop.
git clone git@github.com:GoogleCloudPlatform/DataflowTemplates.git DataflowTemplates
cd DataflowTemplates/v2
git rev-parse HEAD
# -> 68e6939d82e1ad84aa69f33e59c74d6bdea89a3e
docker run --rm -v $(pwd):/root --entrypoint=bash gcr.io/cloud-builders/mvn@sha256:d2142eae8adb79128665fdfb2953cb3135ef83b9f21c3d113273bc8907c88bdf \
-c "cd /root && mvn clean test --batch-mode \
-Dimage=gcr.io/hoge/piyo \
-Dbase-container-image='gcr.io/dataflow-templates-base/java8-template-launcher-base' \
-Dbase-container-image.version=latest \
-Dapp-root=/template/pubsub-cdc-to-bigquery \
-Dcommand-spec=/template/pubsub-cdc-to-bigquery/resources/pubsub-cdc-to-bigquery-command-spec.json \
-am -pl pubsub-cdc-to-bigquery"
[INFO] Scanning for projects...
[INFO] Downloading: https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.5.0.Final/os-maven-plugin-1.5.0.Final.pom
[INFO] Downloaded: https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.5.0.Final/os-maven-plugin-1.5.0.Final.pom (6.4 kB at 4.3 kB/s)
[INFO] Downloading: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
[INFO] Downloaded: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 16 kB/s)
[INFO] Downloading: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
[INFO] Downloaded: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom (3.4 kB at 13 kB/s)
# ( ... Download logs omitted)
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 1. See FAQ web page and the dump file /root/common/target/surefire-reports/2021-12-21T07-11-54_417-jvmRun1.dumpstream
[INFO] Running com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumerTest
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile1.json
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile2.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile2.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile1.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile2.json.
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile1.json.
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit4541564555058549501/dlqFile3.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit4541564555058549501/dlqFile3.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit4541564555058549501/dlqFile3.json.
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /tmp/junit3868726022661842640/*
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Found DLQ File: /tmp/junit3868726022661842640/dlqFile1.json
[direct-runner-worker] INFO com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumer - Deleted file /tmp/junit3868726022661842640/dlqFile1.json.
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.266 s - in com.google.cloud.teleport.v2.cdc.dlq.FileBasedDeadLetterQueueReconsumerTest
[INFO] Running com.google.cloud.teleport.v2.cdc.merge.MergeInfoTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.556 s - in com.google.cloud.teleport.v2.cdc.merge.MergeInfoTest
[INFO] Running com.google.cloud.teleport.v2.cdc.sources.DataStreamIOTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 s - in com.google.cloud.teleport.v2.cdc.sources.DataStreamIOTest
[INFO] Running com.google.cloud.teleport.v2.coders.FailsafeElementCoderTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.723 s - in com.google.cloud.teleport.v2.coders.FailsafeElementCoderTest
[INFO] Running com.google.cloud.teleport.v2.transforms.AccumulateListFnTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.586 s - in com.google.cloud.teleport.v2.transforms.AccumulateListFnTest
[INFO] Running com.google.cloud.teleport.v2.transforms.AvroConvertersTest
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/AvroConvertersTest/test_avro_file.avro matched 1 files with total size 264
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/AvroConvertersTest/test_avro_file.avro into bundles of size 66 took 1 ms and produced 1 files and 1 bundles
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.725 s - in com.google.cloud.teleport.v2.transforms.AvroConvertersTest
[INFO] Running com.google.cloud.teleport.v2.transforms.BigQueryConvertersTest
log4j:WARN No appenders could be found for logger (org.apache.hadoop.hbase.util.ClassSize).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.603 s - in com.google.cloud.teleport.v2.transforms.BigQueryConvertersTest
[INFO] Running com.google.cloud.teleport.v2.transforms.CsvConvertersTest
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 1 ms and produced 1 files and 5 bundles
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv
[direct-runner-worker] ERROR com.google.cloud.teleport.v2.transforms.CsvConverters - Headers do not match, consistency cannot be guaranteed
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 0 ms and produced 1 files and 5 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv matched 1 files with total size 13
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/no_header.csv into bundles of size 3 took 1 ms and produced 1 files and 5 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv matched 1 files with total size 28
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/CsvConvertersTest/with_headers.csv into bundles of size 7 took 0 ms and produced 1 files and 4 bundles
[direct-runner-worker] ERROR com.google.cloud.teleport.v2.transforms.CsvConverters - Failed to convert Strings to Generic Record.
[ERROR] Tests run: 16, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 4.062 s <<< FAILURE! - in com.google.cloud.teleport.v2.transforms.CsvConvertersTest
[ERROR] testLineToFailsafeJsonNoHeadersUdf(com.google.cloud.teleport.v2.transforms.CsvConvertersTest) Time elapsed: 0.504 s <<< FAILURE!
java.lang.AssertionError: TestLineToFailsafeJsonNoHeadersUdf/LineToDocumentUsingUdf/ProcessUdf.out0: null
at com.google.cloud.teleport.v2.transforms.CsvConvertersTest.testLineToFailsafeJsonNoHeadersUdf(CsvConvertersTest.java:310)
Caused by: java.util.NoSuchElementException
at com.google.cloud.teleport.v2.transforms.CsvConvertersTest.lambda$testLineToFailsafeJsonNoHeadersUdf$43268ee4$1(CsvConvertersTest.java:313)
[INFO] Running com.google.cloud.teleport.v2.transforms.DLQWriteTransformTest
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Opening writer 129303c0-f384-4fe4-92c2-c91108777208 for window [2021-12-21T07:12:00.000Z..2021-12-21T07:13:00.000Z) pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink$Writer - Successfully wrote temporary file /tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Finalizing 1 file results
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will copy temporary file FileResult{tempFilename=/tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208, shard=6, window=[2021-12-21T07:12:00.000Z..2021-12-21T07:13:00.000Z), paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/junit8864378803229941601/dlq/error-00006-of-00020.json
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will remove known temporary file /tmp/junit8864378803229941601/.temp-beam-f15cd7f9-746a-4e94-9f36-7e112eec2792/129303c0-f384-4fe4-92c2-c91108777208
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.55 s - in com.google.cloud.teleport.v2.transforms.DLQWriteTransformTest
[INFO] Running com.google.cloud.teleport.v2.transforms.ErrorConvertersTest
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Opening writer f4c44452-e2c9-4b1f-8c22-cd20b8867280 for window org.apache.beam.sdk.transforms.windowing.GlobalWindow@340b9973 pane PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0} destination null
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink$Writer - Successfully wrote temporary file /tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280
[direct-runner-worker] INFO org.apache.beam.sdk.io.WriteFiles - Finalizing 1 file results
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Finalizing for destination null num shards 1.
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will copy temporary file FileResult{tempFilename=/tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@340b9973, paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}} to final location /tmp/junit8403355132876717001errors.txt-00000-of-00001
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileBasedSink - Will remove known temporary file /tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/f4c44452-e2c9-4b1f-8c22-cd20b8867280
[direct-runner-worker] WARN org.apache.beam.sdk.io.FileBasedSink - Failed to match temporary files under: [/tmp/.temp-beam-d82313cf-c691-49bb-bfd3-a38f37fb3730/].
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.303 s - in com.google.cloud.teleport.v2.transforms.ErrorConvertersTest
[INFO] Running com.google.cloud.teleport.v2.transforms.FailsafeElementTransformsTest
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.993 s - in com.google.cloud.teleport.v2.transforms.FailsafeElementTransformsTest
[INFO] Running com.google.cloud.teleport.v2.transforms.FormatDatastreamRecordToJsonTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.212 s - in com.google.cloud.teleport.v2.transforms.FormatDatastreamRecordToJsonTest
[INFO] Running com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest
[pool-144-thread-1] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request cannot be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b/some/o/bad%2Frandom%2Fpath.
[ERROR] Tests run: 11, Failures: 3, Errors: 4, Skipped: 0, Time elapsed: 6.548 s <<< FAILURE! - in com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest
[ERROR] testInvokeScriptException(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.004 s <<< FAILURE!
java.lang.AssertionError:
Expected: an instance of javax.script.ScriptException
got: <java.lang.NullPointerException>
[ERROR] testInvokeUndefined(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.017 s <<< ERROR!
java.lang.NullPointerException
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testInvokeUndefined(JavascriptTextTransformerTest.java:135)
[ERROR] testDoFnGood(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.281 s <<< ERROR!
org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NullPointerException
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testDoFnGood(JavascriptTextTransformerTest.java:160)
Caused by: java.lang.NullPointerException
[ERROR] testDoFnDisregards(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.109 s <<< ERROR!
org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NullPointerException
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testDoFnDisregards(JavascriptTextTransformerTest.java:250)
Caused by: java.lang.NullPointerException
[ERROR] testFailsafeJavaScriptUdfValidInput(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.269 s <<< FAILURE!
java.lang.AssertionError: InvokeUdf/ProcessUdf.out0: null
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testFailsafeJavaScriptUdfValidInput(JavascriptTextTransformerTest.java:289)
Caused by: java.util.NoSuchElementException
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.lambda$testFailsafeJavaScriptUdfValidInput$b25e2d0e$1(JavascriptTextTransformerTest.java:292)
[ERROR] testFailsafeJavaScriptUdfInvalidInput(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.232 s <<< FAILURE!
java.lang.AssertionError:
InvokeUdf/ProcessUdf.out1:
Expected: is not null
got: null
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testFailsafeJavaScriptUdfInvalidInput(JavascriptTextTransformerTest.java:352)
Caused by: java.lang.AssertionError:
Expected: is not null
got: null
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.lambda$testFailsafeJavaScriptUdfInvalidInput$b25e2d0e$1(JavascriptTextTransformerTest.java:361)
[ERROR] testInvokeGood(com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest) Time elapsed: 0.011 s <<< ERROR!
java.lang.NullPointerException
at com.google.cloud.teleport.v2.transforms.JavascriptTextTransformerTest.testInvokeGood(JavascriptTextTransformerTest.java:120)
[INFO] Running com.google.cloud.teleport.v2.transforms.JsonConvertersTest
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_field_record.json matched 1 files with total size 12
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_field_record.json into bundles of size 3 took 2 ms and produced 1 files and 4 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/numeric_fields_record.json matched 1 files with total size 43
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/numeric_fields_record.json into bundles of size 10 took 1 ms and produced 1 files and 5 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/nested_fields_record.json matched 1 files with total size 32
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/nested_fields_record.json into bundles of size 8 took 0 ms and produced 1 files and 4 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/array_of_records.json matched 1 files with total size 53
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/array_of_records.json into bundles of size 13 took 1 ms and produced 1 files and 4 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json matched 1 files with total size 12
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json into bundles of size 3 took 1 ms and produced 1 files and 4 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json matched 1 files with total size 12
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_explicit.json into bundles of size 3 took 1 ms and produced 1 files and 4 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json matched 1 files with total size 3
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json into bundles of size 0 took 0 ms and produced 1 files and 3 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json matched 1 files with total size 3
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_null_field_implicit.json into bundles of size 0 took 2 ms and produced 1 files and 3 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/one_not_null_field.json matched 1 files with total size 10
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/one_not_null_field.json into bundles of size 2 took 3 ms and produced 1 files and 5 bundles
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Filepattern /root/common/target/test-classes/JsonConvertersTest/json_records.json matched 1 files with total size 57
[main] INFO org.apache.beam.sdk.io.FileBasedSource - Splitting filepattern /root/common/target/test-classes/JsonConvertersTest/json_records.json into bundles of size 14 took 1 ms and produced 1 files and 4 bundles
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.667 s - in com.google.cloud.teleport.v2.transforms.JsonConvertersTest
[INFO] Running com.google.cloud.teleport.v2.transforms.KeyValueToGenericRecordFnTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.244 s - in com.google.cloud.teleport.v2.transforms.KeyValueToGenericRecordFnTest
[INFO] Running com.google.cloud.teleport.v2.transforms.ParquetConvertersTest
[direct-runner-worker] INFO org.apache.beam.sdk.io.FileIO - Matched 1 files for pattern /root/common/target/test-classes/ParquetConvertersTest/test_parquet_file.parquet
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - RecordReader initialized will read a total of 1 records.
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - at row 0. reading next block
[direct-runner-worker] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor [.snappy]
[direct-runner-worker] INFO org.apache.parquet.hadoop.InternalParquetRecordReader - block read in memory in 395 ms. row count = 1
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.958 s - in com.google.cloud.teleport.v2.transforms.ParquetConvertersTest
[INFO] Running com.google.cloud.teleport.v2.transforms.PythonTextTransformerTest
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0 s - in com.google.cloud.teleport.v2.transforms.PythonTextTransformerTest
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSAvroTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSAvroTest
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSParquetTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSParquetTest
[INFO] Running com.google.cloud.teleport.v2.transforms.WriteToGCSTextTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 s - in com.google.cloud.teleport.v2.transforms.WriteToGCSTextTest
[INFO] Running com.google.cloud.teleport.v2.utils.DataStreamClientTest
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.01 s - in com.google.cloud.teleport.v2.utils.DataStreamClientTest
[INFO] Running com.google.cloud.teleport.v2.utils.SchemaUtilsTest
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.067 s - in com.google.cloud.teleport.v2.utils.SchemaUtilsTest
[INFO] Running com.google.cloud.teleport.v2.utils.SerializableSchemaSupplierTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in com.google.cloud.teleport.v2.utils.SerializableSchemaSupplierTest
[INFO] Running com.google.cloud.teleport.v2.values.FailsafeElementTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in com.google.cloud.teleport.v2.values.FailsafeElementTest
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] CsvConvertersTest.testLineToFailsafeJsonNoHeadersUdf:310 TestLineToFailsafeJsonNoHeadersUdf/LineToDocumentUsingUdf/ProcessUdf.out0: null
[ERROR] JavascriptTextTransformerTest.testFailsafeJavaScriptUdfInvalidInput:352 InvokeUdf/ProcessUdf.out1:
Expected: is not null
got: null
[ERROR] JavascriptTextTransformerTest.testFailsafeJavaScriptUdfValidInput:289 InvokeUdf/ProcessUdf.out0: null
[ERROR] JavascriptTextTransformerTest.testInvokeScriptException
Expected: an instance of javax.script.ScriptException
got: <java.lang.NullPointerException>
[ERROR] Errors:
[ERROR] JavascriptTextTransformerTest.testDoFnDisregards:250 » PipelineExecution java....
[ERROR] JavascriptTextTransformerTest.testDoFnGood:160 » PipelineExecution java.lang.N...
[ERROR] JavascriptTextTransformerTest.testInvokeGood:120 » NullPointer
[ERROR] JavascriptTextTransformerTest.testInvokeUndefined:135 » NullPointer
[INFO]
[ERROR] Tests run: 100, Failures: 4, Errors: 4, Skipped: 5
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] dynamic-templates .................................. SUCCESS [09:40 min]
[INFO] common ............................................. FAILURE [06:25 min]
[INFO] pubsub-cdc-to-bigquery ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16:20 min
[INFO] Finished at: 2021-12-21T07:13:13Z
[INFO] Final Memory: 82M/259M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on project common: There are test failures.
[ERROR]
[ERROR] Please refer to /root/common/target/surefire-reports for the individual test results.
[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :common
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment