Created
December 21, 2018 02:21
-
-
Save dimaspivak/654382b4290c01c28aba65971f8f8137 to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2018-12-21 01:34:12,512 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,513 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Build info: | |
| 2018-12-21 01:34:12,513 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Version : 3.7.0 | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Date : 2018-12-20T22:08Z | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Built by : ubuntu | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Repo SHA : 6da8299871663ddf58b033b092b2544da49d2b2d | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Source MD5 : ca4c16c35ae9d9ab4fc8e38c20983077 | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Runtime info: | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Java version : 1.8.0_131-b11 | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - SDC ID : 84bbc1c2-04c0-11e9-a95a-4d985cae95d4 | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Runtime dir : /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0 | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Config dir : /var/run/cloudera-scm-agent/process/109-streamsets-DATACOLLECTOR | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Data dir : /var/lib/sdc/data | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Log dir : /var/log/sdc | |
| 2018-12-21 01:34:12,514 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Extra Libs dir: /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs-extras/ | |
| 2018-12-21 01:34:12,515 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,520 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Security Manager : ENABLED, policy file: file:///var/run/cloudera-scm-agent/process/109-streamsets-DATACOLLECTOR/sdc-security.policy | |
| 2018-12-21 01:34:12,521 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,521 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Starting ... | |
| 2018-12-21 01:34:12,528 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,528 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Kerberos enabled: false | |
| 2018-12-21 01:34:12,623 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Unlimited cryptography enabled: true | |
| 2018-12-21 01:34:12,623 [user:] [pipeline:] [runner:] [thread:main] INFO Main - ----------------------------------------------------------------- | |
| 2018-12-21 01:34:12,623 [user:] [pipeline:] [runner:] [thread:main] INFO Main - Starting ... | |
| 2018-12-21 01:34:12,630 [user:] [pipeline:] [runner:] [thread:main] INFO ClassLoaderStageLibraryTask - Validating classpath of all stages | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] INFO ClassLoaderStageLibraryTask - Finished classpath validation in 2889 ms | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_6_0-lib | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.1.17, 3.7.0 | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.1.17 | |
| 2018-12-21 01:34:15,519 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-resolver-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-buffer-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-transport-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-common-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-codec-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-all-4.1.17.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.7.0 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_6_0-lib/lib/netty-3.7.0.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_5_10-lib | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency javax.inject have versions: 1, 2.5.0-b32 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 1 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/javax.inject-1.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 2.5.0-b32 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/javax.inject-2.5.0-b32.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.0.29, 3.10.5 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.0.29 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-transport-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-codec-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-common-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-buffer-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-all-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.10.5 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_10-lib/lib/netty-3.10.5.Final.jar | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_5_13-lib | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency javax.inject have versions: 1, 2.5.0-b32 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 1 | |
| 2018-12-21 01:34:15,520 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/javax.inject-1.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 2.5.0-b32 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/javax.inject-2.5.0-b32.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.0.29, 3.10.5 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.0.29 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-transport-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-codec-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-common-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-buffer-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-all-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.10.5 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_13-lib/lib/netty-3.10.5.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_5_12-lib | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency javax.inject have versions: 1, 2.5.0-b32 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 1 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/javax.inject-1.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 2.5.0-b32 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/javax.inject-2.5.0-b32.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.0.29, 3.10.5 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.0.29 | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-transport-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-codec-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-common-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,521 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-buffer-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-all-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.10.5 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/netty-3.10.5.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_5_14-lib | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency javax.inject have versions: 1, 2.5.0-b32 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 1 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/javax.inject-1.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 2.5.0-b32 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/javax.inject-2.5.0-b32.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.0.29, 3.10.5 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.0.29 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-transport-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-codec-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-common-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-buffer-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-all-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.10.5 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_14-lib/lib/netty-3.10.5.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Validation results for streamsets-datacollector-cdh_5_11-lib | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Detected colliding dependency versions: | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency javax.inject have versions: 1, 2.5.0-b32 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 1 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/javax.inject-1.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 2.5.0-b32 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/javax.inject-2.5.0-b32.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Dependency netty have versions: 4.0.29, 3.10.5 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 4.0.29 | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-transport-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-codec-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-common-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-buffer-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-all-4.0.29.Final.jar | |
| 2018-12-21 01:34:15,522 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - Version: 3.10.5 | |
| 2018-12-21 01:34:15,523 [user:] [pipeline:] [runner:] [thread:main] WARN ClasspathValidatorResult - file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_11-lib/lib/netty-3.10.5.Final.jar | |
| 2018-12-21 01:34:15,523 [user:] [pipeline:] [runner:] [thread:main] ERROR ClassLoaderStageLibraryTask - The following stages have invalid classpath: streamsets-datacollector-cdh_5_10-lib, streamsets-datacollector-cdh_6_0-lib, streamsets-datacollector-cdh_5_13-lib, streamsets-datacollector-cdh_5_12-lib, streamsets-datacollector-cdh_5_14-lib, streamsets-datacollector-cdh_5_11-lib | |
| 2018-12-21 01:34:46,817 [user:] [pipeline:] [runner:] [thread:main] INFO ClassLoaderStageLibraryTask - Loaded '68' libraries with a total of '384' stages, '0' lineage publishers, '2' services, '0' interceptors, '1' delegates and '4' credentialStores in '31272ms' | |
| 2018-12-21 01:34:49,380 [user:] [pipeline:] [runner:] [thread:main] INFO LineagePublisherTaskImpl - No publishers configured | |
| 2018-12-21 01:34:49,618 [user:] [pipeline:] [runner:] [thread:main] INFO StatsCollectorTask - Stats Collection, opted 'false, active 'false' | |
| 2018-12-21 01:34:49,645 [user:] [pipeline:] [runner:] [thread:main] INFO Server - jetty-9.4.12.v20180830; built: 2018-08-30T13:59:14.071Z; git: 27208684755d94a92186989f695db2d7b21ebc51; jvm 1.8.0_131-b11 | |
| 2018-12-21 01:34:49,755 [user:] [pipeline:] [runner:] [thread:main] INFO session - DefaultSessionIdManager workerName=node0 | |
| 2018-12-21 01:34:49,756 [user:] [pipeline:] [runner:] [thread:main] INFO session - No SessionScavenger set, using defaults | |
| 2018-12-21 01:34:49,758 [user:] [pipeline:] [runner:] [thread:main] INFO session - node0 Scavenging every 600000ms | |
| 2018-12-21 01:34:50,509 [user:] [pipeline:] [runner:] [thread:main] INFO Reflections - Reflections took 234 ms to scan 2 urls, producing 1392 keys and 2271 values | |
| 2018-12-21 01:34:51,774 [user:] [pipeline:] [runner:] [thread:main] INFO Reflections - Reflections took 180 ms to scan 2 urls, producing 1392 keys and 2271 values | |
| 2018-12-21 01:34:53,074 [user:] [pipeline:] [runner:] [thread:main] INFO ContextHandler - Started o.e.j.s.ServletContextHandler@75d7e128{/,null,AVAILABLE} | |
| 2018-12-21 01:34:53,099 [user:] [pipeline:] [runner:] [thread:main] INFO AbstractConnector - Started ServerConnector@2ee6cb8a{HTTP/1.1,[http/1.1]}{0.0.0.0:18630} | |
| 2018-12-21 01:34:53,099 [user:] [pipeline:] [runner:] [thread:main] INFO Server - Started @42845ms | |
| 2018-12-21 01:34:53,103 [user:] [pipeline:] [runner:] [thread:main] INFO WebServerTask - Running on URI : 'http://node-1.cluster:18630' | |
| 2018-12-21 01:39:25,731 [user:admin] [pipeline:Pipeline Builder/PipelineBuilder5638f3ec-6594-4f4b-b66d-d75589e32570] [runner:] [thread:EL-cache-trimmer] INFO LruExpressionEvaluatorImpl - Starting housekeeper thread for expected types cache (runs every 5mins) | |
| 2018-12-21 01:39:28,897 [user:admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:39:28,920 [user:admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c::0' | |
| 2018-12-21 01:39:28,932 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:runner-pool-2-thread-2] INFO StandaloneRunner - Starting pipeline HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c 0 | |
| 2018-12-21 01:39:29,058 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:runner-pool-2-thread-2] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:39:30,066 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] WARN LoginUgiProviderFactory - Could not find implementation of LoginUgiProviderFactory. Using default implementation meant for Apache Hadoop. | |
| 2018-12-21 01:39:30,229 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:30,239 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:30,240 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:30,264 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:30,264 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:30,689 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] WARN LoginUgiProviderFactory - Could not find implementation of LoginUgiProviderFactory. Using default implementation meant for Apache Hadoop. | |
| 2018-12-21 01:39:30,843 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:31,569 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:39:31,933 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] WARN LoginUgiProviderFactory - Could not find implementation of LoginUgiProviderFactory. Using default implementation meant for Apache Hadoop. | |
| 2018-12-21 01:39:32,046 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:32,049 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:32,050 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:32,080 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:32,080 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:39,238 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:39:39,244 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:39:39,293 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:39:39,408 [user:*admin] [pipeline:Hive drift test - Null values/HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c-Hive drift test - Null values] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:39:41,985 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:webserver-20] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:39:41,986 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:webserver-20] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382::0' | |
| 2018-12-21 01:39:42,009 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:runner-pool-2-thread-18] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382 0 | |
| 2018-12-21 01:39:42,053 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:runner-pool-2-thread-18] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:39:42,210 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:42,212 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:42,215 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:42,218 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:42,219 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:42,411 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:42,414 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:39:42,499 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:42,500 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:42,500 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:42,500 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:42,500 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:45,596 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:39:45,602 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:39:45,718 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:39:48,952 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:webserver-20] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:39:48,953 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:webserver-20] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0::0' | |
| 2018-12-21 01:39:48,957 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:runner-pool-2-thread-14] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0 0 | |
| 2018-12-21 01:39:49,039 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:runner-pool-2-thread-14] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:39:49,180 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:49,181 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:49,181 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:49,181 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:49,181 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:49,316 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:49,319 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:39:49,387 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:49,388 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:49,388 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:49,388 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:49,388 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:51,393 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:39:51,399 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:39:51,513 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:39:52,961 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:39:52,961 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927::0' | |
| 2018-12-21 01:39:52,966 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:runner-pool-2-thread-3] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927 0 | |
| 2018-12-21 01:39:53,005 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:runner-pool-2-thread-3] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:39:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartd53c47c2-bda1-4dd3-b9a5-8f3fc93203e0::'0' | |
| 2018-12-21 01:39:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestNullvalues14e40ccf-7725-49da-ab52-5d5fc09f090c::'0' | |
| 2018-12-21 01:39:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart87140888-4a86-49b7-8da7-7593594de382::'0' | |
| 2018-12-21 01:39:53,122 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:53,122 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:53,122 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:53,123 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:53,123 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:53,333 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:53,336 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:39:53,420 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:53,421 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:53,421 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:53,421 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:53,421 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:56,082 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:39:56,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:39:56,202 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:39:58,135 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:39:58,136 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3::0' | |
| 2018-12-21 01:39:58,160 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:runner-pool-2-thread-10] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3 0 | |
| 2018-12-21 01:39:58,185 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:runner-pool-2-thread-10] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:39:58,300 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:58,301 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:58,301 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:58,301 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:58,302 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:39:58,425 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:58,427 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:39:58,519 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:39:58,519 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:39:58,520 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:39:58,520 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:39:58,520 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:01,256 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:01,261 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:01,484 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:03,135 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:03,135 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b::0' | |
| 2018-12-21 01:40:03,138 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:runner-pool-2-thread-15] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b 0 | |
| 2018-12-21 01:40:03,168 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:runner-pool-2-thread-15] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:03,306 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:03,307 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:03,307 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:03,308 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:03,308 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:03,474 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:03,476 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:03,552 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:03,553 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:03,553 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:03,553 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:03,553 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:06,370 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:06,375 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:06,592 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:08,192 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:08,193 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715::0' | |
| 2018-12-21 01:40:08,196 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:runner-pool-2-thread-4] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715 0 | |
| 2018-12-21 01:40:08,220 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:runner-pool-2-thread-4] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:08,315 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:08,316 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:08,316 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:08,316 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:08,316 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:08,416 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:08,419 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:08,471 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:08,472 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:08,472 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:08,472 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:08,472 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:11,856 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:11,860 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:12,074 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:13,352 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:13,352 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48::0' | |
| 2018-12-21 01:40:13,355 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:runner-pool-2-thread-13] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48 0 | |
| 2018-12-21 01:40:13,380 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:runner-pool-2-thread-13] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:13,467 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:13,467 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:13,467 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:13,467 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:13,468 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:13,582 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:13,584 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:13,642 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:13,642 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:13,642 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:13,643 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:13,643 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:16,165 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:16,172 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:16,286 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:17,366 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:webserver-20] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:17,367 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:webserver-20] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e::0' | |
| 2018-12-21 01:40:17,371 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:runner-pool-2-thread-18] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e 0 | |
| 2018-12-21 01:40:17,407 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:runner-pool-2-thread-18] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:17,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:17,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:17,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:17,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:17,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:17,571 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:17,572 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:17,645 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:17,645 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:17,645 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:17,646 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:17,646 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:21,836 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:21,841 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:21,955 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:23,466 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:23,467 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8::0' | |
| 2018-12-21 01:40:23,471 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:runner-pool-2-thread-8] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8 0 | |
| 2018-12-21 01:40:23,513 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:runner-pool-2-thread-8] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:23,640 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:23,641 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:23,641 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:23,641 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:23,641 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:23,769 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:23,772 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:23,857 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:23,858 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:23,858 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:23,858 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:23,858 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:26,820 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:26,824 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:26,940 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:28,498 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:28,499 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358::0' | |
| 2018-12-21 01:40:28,502 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:runner-pool-2-thread-31] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358 0 | |
| 2018-12-21 01:40:28,524 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:runner-pool-2-thread-31] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:28,603 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:28,603 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:28,603 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:28,603 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:28,603 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:28,709 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:28,710 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:28,785 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:28,785 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:28,785 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:28,785 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:28,785 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:32,584 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:32,590 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:32,809 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:34,565 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:34,565 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1::0' | |
| 2018-12-21 01:40:34,568 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:runner-pool-2-thread-23] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1 0 | |
| 2018-12-21 01:40:34,602 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:runner-pool-2-thread-23] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:34,721 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:34,721 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:34,721 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:34,721 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:34,722 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:34,825 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:34,827 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:34,909 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:34,910 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:34,910 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:34,910 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:34,910 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:39,138 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:39,142 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:39,356 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:40,458 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:40,458 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7::0' | |
| 2018-12-21 01:40:40,461 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:runner-pool-2-thread-22] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7 0 | |
| 2018-12-21 01:40:40,484 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:runner-pool-2-thread-22] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:40,562 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:40,562 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:40,562 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:40,563 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:40,563 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:40,681 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:40,683 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:40,736 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:40,736 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:40,737 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:40,737 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:40,737 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:43,656 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:43,661 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:43,874 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:45,431 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:45,432 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4::0' | |
| 2018-12-21 01:40:45,434 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:runner-pool-2-thread-15] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4 0 | |
| 2018-12-21 01:40:45,454 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:runner-pool-2-thread-15] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:45,532 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:45,532 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:45,532 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:45,532 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:45,532 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:45,652 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:45,654 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:45,739 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:45,739 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:45,739 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:45,739 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:45,740 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:47,052 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:47,057 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:47,171 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:48,376 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:48,377 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf::0' | |
| 2018-12-21 01:40:48,380 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:runner-pool-2-thread-38] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf 0 | |
| 2018-12-21 01:40:48,408 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:runner-pool-2-thread-38] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:48,523 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:48,523 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:48,523 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:48,523 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:48,524 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:48,608 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:48,610 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:48,663 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:48,664 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:48,664 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:48,664 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:48,664 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:50,777 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:50,781 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:50,893 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:52,374 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:52,375 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876::0' | |
| 2018-12-21 01:40:52,377 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:runner-pool-2-thread-25] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876 0 | |
| 2018-12-21 01:40:52,404 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:runner-pool-2-thread-25] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:52,485 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:52,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:52,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:52,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:52,487 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:52,590 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:52,595 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:52,684 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:52,686 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:52,686 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:52,686 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:52,686 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:53,956 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:53,961 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:54,078 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:55,268 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:55,268 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165::0' | |
| 2018-12-21 01:40:55,273 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:runner-pool-2-thread-28] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165 0 | |
| 2018-12-21 01:40:55,294 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:runner-pool-2-thread-28] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:55,412 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:55,413 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:55,413 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:55,413 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:55,413 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:55,524 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:55,526 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:55,577 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:55,577 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:55,577 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:55,577 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:55,577 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:56,812 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:40:56,815 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:40:57,028 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:40:58,243 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:40:58,244 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69::0' | |
| 2018-12-21 01:40:58,248 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:runner-pool-2-thread-5] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69 0 | |
| 2018-12-21 01:40:58,270 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:runner-pool-2-thread-5] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:40:58,353 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:58,354 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:58,354 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:58,354 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:58,354 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:40:58,441 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:58,443 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:40:58,498 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:40:58,498 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:40:58,498 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:40:58,498 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:40:58,498 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:00,633 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:00,637 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:00,752 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:02,056 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:02,056 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63::0' | |
| 2018-12-21 01:41:02,061 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:runner-pool-2-thread-4] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63 0 | |
| 2018-12-21 01:41:02,094 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:runner-pool-2-thread-4] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:02,239 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:02,239 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:02,239 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:02,239 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:02,239 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:02,329 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:02,330 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:02,381 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:02,381 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:02,381 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:02,381 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:02,381 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:04,541 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:04,545 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:04,758 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:06,038 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:06,039 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305::0' | |
| 2018-12-21 01:41:06,045 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:runner-pool-2-thread-10] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305 0 | |
| 2018-12-21 01:41:06,066 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:runner-pool-2-thread-10] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:06,143 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:06,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:06,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:06,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:06,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:06,241 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:06,243 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:06,312 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:06,312 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:06,313 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:06,313 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:06,313 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:08,881 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:08,887 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:09,007 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:09,923 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:09,924 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee::0' | |
| 2018-12-21 01:41:09,927 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:runner-pool-2-thread-45] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee 0 | |
| 2018-12-21 01:41:09,961 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:runner-pool-2-thread-45] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:10,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:10,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:10,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:10,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:10,086 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:10,177 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:10,178 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:10,232 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:10,232 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:10,232 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:10,232 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:10,232 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:12,413 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:12,417 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:12,931 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:14,004 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:14,004 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2::0' | |
| 2018-12-21 01:41:14,007 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:runner-pool-2-thread-49] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2 0 | |
| 2018-12-21 01:41:14,028 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:runner-pool-2-thread-49] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:14,106 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:14,106 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:14,106 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:14,106 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:14,106 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:14,216 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:14,219 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:14,277 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:14,278 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:14,278 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:14,278 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:14,278 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:16,015 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:16,019 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:16,437 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:17,916 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:17,916 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315::0' | |
| 2018-12-21 01:41:17,920 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:runner-pool-2-thread-35] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315 0 | |
| 2018-12-21 01:41:17,996 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:runner-pool-2-thread-35] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:18,114 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:18,115 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:18,115 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:18,115 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:18,115 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:18,209 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:18,211 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:18,290 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:18,291 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:18,291 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:18,291 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:18,291 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:19,791 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:19,794 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:20,010 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:22,008 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:22,008 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc::0' | |
| 2018-12-21 01:41:22,011 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:runner-pool-2-thread-38] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc 0 | |
| 2018-12-21 01:41:22,032 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:runner-pool-2-thread-38] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:22,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:22,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:22,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:22,144 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:22,145 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:22,251 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:22,252 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:22,335 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:22,336 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:22,336 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:22,336 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:22,336 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:23,333 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:23,337 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:23,550 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:24,856 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:24,856 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a::0' | |
| 2018-12-21 01:41:24,859 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:runner-pool-2-thread-42] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a 0 | |
| 2018-12-21 01:41:24,914 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:runner-pool-2-thread-42] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:24,993 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:24,994 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:24,994 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:24,994 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:24,994 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:25,098 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:25,099 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:25,151 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:25,152 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:25,152 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:25,152 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:25,152 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:27,644 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:27,648 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:27,859 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:28,993 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:28,994 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2::0' | |
| 2018-12-21 01:41:28,997 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:runner-pool-2-thread-30] INFO StandaloneRunner - Starting pipeline HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2 0 | |
| 2018-12-21 01:41:29,020 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:runner-pool-2-thread-30] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:29,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:29,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:29,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:29,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:29,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:29,197 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:29,199 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:29,252 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:29,252 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:29,252 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:29,252 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:29,252 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:30,549 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:30,554 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:30,665 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:32,109 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:32,109 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5::0' | |
| 2018-12-21 01:41:32,113 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:runner-pool-2-thread-19] INFO StandaloneRunner - Starting pipeline HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5 0 | |
| 2018-12-21 01:41:32,150 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:runner-pool-2-thread-19] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:32,258 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:32,258 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:32,258 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:32,258 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:32,258 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:32,371 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:32,373 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:32,426 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:32,426 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:32,426 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:32,426 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:32,426 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:34,022 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:34,026 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:34,136 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:35,997 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:35,998 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8::0' | |
| 2018-12-21 01:41:36,005 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:runner-pool-2-thread-25] INFO StandaloneRunner - Starting pipeline HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8 0 | |
| 2018-12-21 01:41:36,038 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:runner-pool-2-thread-25] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:36,154 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:36,155 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:36,155 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:36,155 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:36,155 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:36,251 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:36,253 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:36,334 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:36,334 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:36,334 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:36,335 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:36,335 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:38,343 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:38,347 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:38,461 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:40,103 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:40,104 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5::0' | |
| 2018-12-21 01:41:40,111 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:runner-pool-2-thread-13] INFO StandaloneRunner - Starting pipeline HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5 0 | |
| 2018-12-21 01:41:40,133 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:runner-pool-2-thread-13] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:40,207 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:40,208 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:40,208 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:40,208 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:40,208 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:40,348 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:40,349 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:40,403 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:40,403 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:40,403 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:40,403 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:40,403 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:42,479 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:42,482 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:42,594 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:44,236 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:44,236 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c::0' | |
| 2018-12-21 01:41:44,238 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:runner-pool-2-thread-5] INFO StandaloneRunner - Starting pipeline HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c 0 | |
| 2018-12-21 01:41:44,263 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:runner-pool-2-thread-5] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:44,343 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:44,343 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:44,343 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:44,343 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:44,344 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:44,447 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:44,448 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:44,499 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:44,500 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:44,500 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:44,500 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:44,500 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:46,545 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:46,549 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:46,659 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:48,260 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:48,262 [user:admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859::0' | |
| 2018-12-21 01:41:48,264 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:runner-pool-2-thread-1] INFO StandaloneRunner - Starting pipeline HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859 0 | |
| 2018-12-21 01:41:48,286 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:runner-pool-2-thread-1] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:48,371 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:48,371 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:48,371 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:48,372 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:48,372 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:48,476 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:48,477 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:48,533 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:48,534 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:48,534 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:48,534 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:48,534 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:50,644 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:50,648 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:51,159 [user:*admin] [pipeline:Hive drift test - Location/HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859-Hive drift test - Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:52,364 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:52,364 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239::0' | |
| 2018-12-21 01:41:52,368 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:runner-pool-2-thread-26] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239 0 | |
| 2018-12-21 01:41:52,404 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:runner-pool-2-thread-26] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:53,146 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:53,147 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:53,147 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:53,147 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:53,147 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:53,257 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:53,258 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:53,315 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:53,315 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:53,315 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:53,316 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:53,316 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:54,370 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:41:54,372 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:54,383 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:54,396 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:41:56,543 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:41:56,543 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943::0' | |
| 2018-12-21 01:41:56,546 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:runner-pool-2-thread-43] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943 0 | |
| 2018-12-21 01:41:56,598 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:runner-pool-2-thread-43] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:41:56,824 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:56,825 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:56,825 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:56,825 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:56,825 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:56,943 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:56,944 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:41:57,031 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:41:57,032 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:41:57,032 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:41:57,032 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:41:57,032 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:41:59,532 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:41:59,535 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:41:59,548 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:41:59,662 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:01,642 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:01,643 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f::0' | |
| 2018-12-21 01:42:01,645 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:runner-pool-2-thread-27] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f 0 | |
| 2018-12-21 01:42:01,669 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:runner-pool-2-thread-27] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:01,799 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:01,800 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:01,800 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:01,800 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:01,800 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:01,904 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:01,905 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:01,961 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:01,961 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:01,961 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:01,961 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:01,961 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:04,091 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:04,093 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:04,105 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:04,217 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:05,628 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:05,629 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366::0' | |
| 2018-12-21 01:42:05,631 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:runner-pool-2-thread-44] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366 0 | |
| 2018-12-21 01:42:05,657 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:runner-pool-2-thread-44] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:05,770 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:05,770 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:05,770 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:05,771 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:05,771 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:05,853 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:05,854 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:05,917 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:05,917 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:05,917 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:05,917 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:05,917 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:07,168 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:07,171 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:07,188 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:07,303 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:08,682 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:08,682 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1::0' | |
| 2018-12-21 01:42:08,684 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:runner-pool-2-thread-48] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1 0 | |
| 2018-12-21 01:42:08,713 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:runner-pool-2-thread-48] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:08,838 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:08,839 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:08,839 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:08,839 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:08,839 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:09,006 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:09,008 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:09,098 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:09,099 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:09,099 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:09,099 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:09,099 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:10,801 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:10,804 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:10,816 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:10,928 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:12,661 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:12,661 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24::0' | |
| 2018-12-21 01:42:12,664 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:runner-pool-2-thread-45] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24 0 | |
| 2018-12-21 01:42:12,687 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:runner-pool-2-thread-45] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:12,796 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:12,797 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:12,797 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:12,797 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:12,797 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:12,892 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:12,893 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:12,947 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:12,947 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:12,947 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:12,947 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:12,947 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:14,642 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:14,644 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:14,655 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:14,767 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:16,626 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:16,627 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b::0' | |
| 2018-12-21 01:42:16,630 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:runner-pool-2-thread-30] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b 0 | |
| 2018-12-21 01:42:16,652 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:runner-pool-2-thread-30] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:16,794 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:16,795 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:16,795 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:16,795 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:16,795 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:16,877 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:16,879 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:16,929 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:16,930 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:16,930 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:16,930 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:16,930 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:18,207 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:18,209 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:18,219 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:18,330 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:19,672 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:19,673 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71::0' | |
| 2018-12-21 01:42:19,681 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:runner-pool-2-thread-31] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71 0 | |
| 2018-12-21 01:42:19,713 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:runner-pool-2-thread-31] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:19,868 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:19,869 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:19,869 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:19,869 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:19,869 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:19,972 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:19,974 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:20,061 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:20,061 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:20,062 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:20,062 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:20,062 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:21,819 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:21,820 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:21,830 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:22,343 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:23,670 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:23,670 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4::0' | |
| 2018-12-21 01:42:23,673 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:runner-pool-2-thread-26] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4 0 | |
| 2018-12-21 01:42:23,702 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:runner-pool-2-thread-26] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:23,792 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:23,793 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:23,793 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:23,793 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:23,793 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:23,870 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:23,872 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:23,921 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:23,921 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:23,921 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:23,921 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:23,921 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:24,781 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:24,784 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:24,799 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:24,911 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:26,641 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:26,641 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842::0' | |
| 2018-12-21 01:42:26,644 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:runner-pool-2-thread-43] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842 0 | |
| 2018-12-21 01:42:26,671 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:runner-pool-2-thread-43] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:26,775 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:26,775 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:26,775 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:26,775 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:26,776 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:26,863 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:26,864 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:26,945 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:26,946 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:26,946 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:26,946 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:26,946 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:27,514 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:RandomDataGenerator-0::HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_19 - Unsupported Type: BYTE | |
| at com.streamsets.pipeline.stage.lib.hive.typesupport.HiveType.getHiveTypeforFieldType(HiveType.java:64) | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.convertRecordToHMSType(HiveMetastoreUtil.java:683) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:409) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processBatch(ProductionPipelineRunner.java:491) | |
| at com.streamsets.datacollector.runner.StageRuntime$3.run(StageRuntime.java:370) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at com.streamsets.datacollector.runner.StageRuntime.processBatch(StageRuntime.java:366) | |
| at com.streamsets.datacollector.runner.StageContext.processBatch(StageContext.java:269) | |
| at com.streamsets.pipeline.stage.devtest.RandomDataGeneratorSource$GeneratorRunnable.run(RandomDataGeneratorSource.java:262) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:27,537 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:27,539 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:27,551 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:27,554 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:28,368 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:28,369 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f::0' | |
| 2018-12-21 01:42:28,370 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:runner-pool-2-thread-34] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f 0 | |
| 2018-12-21 01:42:28,398 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:runner-pool-2-thread-34] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:28,504 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:28,504 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:28,504 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:28,505 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:28,505 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:28,609 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:28,611 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:28,670 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:28,671 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:28,671 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:28,671 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:28,671 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:28,858 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:RandomDataGenerator-0::HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_19 - Unsupported Type: MAP | |
| at com.streamsets.pipeline.stage.lib.hive.typesupport.HiveType.getHiveTypeforFieldType(HiveType.java:64) | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.convertRecordToHMSType(HiveMetastoreUtil.java:683) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:409) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processBatch(ProductionPipelineRunner.java:491) | |
| at com.streamsets.datacollector.runner.StageRuntime$3.run(StageRuntime.java:370) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at com.streamsets.datacollector.runner.StageRuntime.processBatch(StageRuntime.java:366) | |
| at com.streamsets.datacollector.runner.StageContext.processBatch(StageContext.java:269) | |
| at com.streamsets.pipeline.stage.devtest.RandomDataGeneratorSource$GeneratorRunnable.run(RandomDataGeneratorSource.java:262) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:28,874 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:28,876 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:28,887 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:28,891 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:30,097 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:30,098 [user:admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a::0' | |
| 2018-12-21 01:42:30,100 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:runner-pool-2-thread-29] INFO StandaloneRunner - Starting pipeline HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a 0 | |
| 2018-12-21 01:42:30,127 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:runner-pool-2-thread-29] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:30,263 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:30,263 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:30,263 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:30,264 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:30,264 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:30,359 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:30,361 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:30,415 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:30,416 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:30,416 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:30,416 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:30,416 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:30,959 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:RandomDataGenerator-0::HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_19 - Unsupported Type: LIST_MAP | |
| at com.streamsets.pipeline.stage.lib.hive.typesupport.HiveType.getHiveTypeforFieldType(HiveType.java:64) | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.convertRecordToHMSType(HiveMetastoreUtil.java:683) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:409) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processBatch(ProductionPipelineRunner.java:491) | |
| at com.streamsets.datacollector.runner.StageRuntime$3.run(StageRuntime.java:370) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at com.streamsets.datacollector.runner.StageRuntime.processBatch(StageRuntime.java:366) | |
| at com.streamsets.datacollector.runner.StageContext.processBatch(StageContext.java:269) | |
| at com.streamsets.pipeline.stage.devtest.RandomDataGeneratorSource$GeneratorRunnable.run(RandomDataGeneratorSource.java:262) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:30,974 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:42:30,976 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:30,985 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:30,988 [user:*admin] [pipeline:Hive drift test - SDC Types/HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a-Hive drift test - SDC Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:31,851 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:31,853 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f::0' | |
| 2018-12-21 01:42:31,856 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:runner-pool-2-thread-38] INFO StandaloneRunner - Starting pipeline HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f 0 | |
| 2018-12-21 01:42:31,895 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:runner-pool-2-thread-38] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:32,012 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:32,012 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:32,012 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:32,012 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:32,012 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:32,146 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:32,148 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:32,199 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:32,199 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:32,199 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:32,200 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:32,200 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:36,192 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:36,196 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:36,306 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f-Hive drift test - Partition Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:37,751 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:37,751 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811::0' | |
| 2018-12-21 01:42:37,757 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:runner-pool-2-thread-48] INFO StandaloneRunner - Starting pipeline HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811 0 | |
| 2018-12-21 01:42:37,788 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:runner-pool-2-thread-48] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:37,887 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:37,887 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:37,887 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:37,887 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:37,887 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:37,974 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:37,975 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:38,025 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:38,026 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:38,026 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:38,026 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:38,026 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:41,517 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:41,520 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:42,033 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811-Hive drift test - Partition Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:43,670 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:43,671 [user:admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828::0' | |
| 2018-12-21 01:42:43,676 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:runner-pool-2-thread-35] INFO StandaloneRunner - Starting pipeline HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828 0 | |
| 2018-12-21 01:42:43,697 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:runner-pool-2-thread-35] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:43,780 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:43,780 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:43,780 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:43,780 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:43,781 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:43,895 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:43,896 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:43,947 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:43,947 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:43,947 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:43,947 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:43,947 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:47,203 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:47,207 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:47,319 [user:*admin] [pipeline:Hive drift test - Partition Types/HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828-Hive drift test - Partition Types] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:48,738 [user:admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:48,738 [user:admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5::0' | |
| 2018-12-21 01:42:48,742 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:runner-pool-2-thread-18] INFO StandaloneRunner - Starting pipeline HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5 0 | |
| 2018-12-21 01:42:48,764 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:runner-pool-2-thread-18] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:48,857 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:48,858 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:48,858 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:48,858 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:48,858 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:48,937 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:48,938 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:48,990 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:48,991 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:48,991 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:48,991 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:48,991 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:54,680 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:42:54,684 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:42:56,018 [user:*admin] [pipeline:Hive drift test - Multiplexing/HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5-Hive drift test - Multiplexing] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:42:58,098 [user:admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:42:58,098 [user:admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c::0' | |
| 2018-12-21 01:42:58,100 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:runner-pool-2-thread-49] INFO StandaloneRunner - Starting pipeline HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c 0 | |
| 2018-12-21 01:42:58,121 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:runner-pool-2-thread-49] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:42:58,201 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:58,202 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:58,202 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:58,202 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:58,202 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:58,331 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:58,332 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:42:58,387 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:42:58,388 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:42:58,388 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:42:58,388 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:42:58,388 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:42:58,447 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] WARN BatchMakerImpl - The maximum number of records per batch in the origin has been exceeded. | |
| 2018-12-21 01:42:59,083 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,087 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,088 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,089 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,090 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,090 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,091 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,092 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,093 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,094 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:42:59,094 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_10 - Unsupported character to use for partition value: ${record:attribute("part")} | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.getPartitionValuesFromRecord(HiveMetadataProcessor.java:700) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:376) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:05,486 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:05,490 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:07,269 [user:*admin] [pipeline:Hive drift test - Partition Characters/HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c-Hive drift test - Partition Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:09,388 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:09,389 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1::0' | |
| 2018-12-21 01:43:09,391 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:runner-pool-2-thread-4] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1 0 | |
| 2018-12-21 01:43:09,413 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:runner-pool-2-thread-4] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:09,495 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:09,495 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:09,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:09,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:09,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:09,588 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:09,589 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:09,667 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:09,668 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:09,668 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:09,668 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:09,668 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:09,755 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_03 - Failed validation on table name : Invalid character for Hive 'kivqr#kivqr' | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:373) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:09,763 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:09,766 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:09,768 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:11,122 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:11,123 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4::0' | |
| 2018-12-21 01:43:11,125 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:runner-pool-2-thread-38] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4 0 | |
| 2018-12-21 01:43:11,147 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:runner-pool-2-thread-38] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:11,222 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:11,222 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:11,222 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:11,223 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:11,223 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:11,322 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:11,323 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:11,376 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:11,377 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:11,377 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:11,377 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:11,377 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:11,626 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_30 - Invalid column name emoch#emoch | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.generateAvroSchema(HiveMetastoreUtil.java:740) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:514) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:11,631 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:11,634 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:11,637 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:12,737 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:12,739 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143::0' | |
| 2018-12-21 01:43:12,741 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:runner-pool-2-thread-7] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143 0 | |
| 2018-12-21 01:43:12,771 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:runner-pool-2-thread-7] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:12,872 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:12,872 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:12,872 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:12,872 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:12,872 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:12,954 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:12,956 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:13,013 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:13,013 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:13,013 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:13,013 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:13,013 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:13,086 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_03 - Failed validation on table name : Invalid character for Hive 'fkjzg-fkjzg' | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:373) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:13,093 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:13,095 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:13,097 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:14,458 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:14,459 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee::0' | |
| 2018-12-21 01:43:14,462 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:runner-pool-2-thread-9] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee 0 | |
| 2018-12-21 01:43:14,488 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:runner-pool-2-thread-9] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:14,570 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:14,571 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:14,571 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:14,571 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:14,571 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:14,652 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:14,654 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:14,715 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:14,716 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:14,716 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:14,716 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:14,716 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:16,148 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_30 - Invalid column name xruda-xruda | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.generateAvroSchema(HiveMetastoreUtil.java:740) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:514) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:16,156 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:16,159 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:16,162 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:17,102 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:17,103 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122::0' | |
| 2018-12-21 01:43:17,108 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:runner-pool-2-thread-35] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122 0 | |
| 2018-12-21 01:43:17,139 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:runner-pool-2-thread-35] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:17,270 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:17,270 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:17,270 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:17,271 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:17,271 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:17,374 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:17,375 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:17,436 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:17,437 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:17,437 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:17,437 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:17,437 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:17,513 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_03 - Failed validation on table name : Invalid character for Hive 'aimko$aimko' | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:373) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:17,517 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:17,520 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:17,524 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:18,816 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:18,818 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09::0' | |
| 2018-12-21 01:43:18,820 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:runner-pool-2-thread-1] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09 0 | |
| 2018-12-21 01:43:18,843 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:runner-pool-2-thread-1] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:18,919 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:18,919 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:18,919 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:18,919 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:18,919 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:18,999 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:19,000 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:19,153 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:19,154 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:19,154 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:19,154 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:19,154 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:20,240 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_30 - Invalid column name zbhjv$zbhjv | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.generateAvroSchema(HiveMetastoreUtil.java:740) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:514) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:20,248 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:20,254 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:20,257 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:21,408 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:21,409 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db::0' | |
| 2018-12-21 01:43:21,411 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:runner-pool-2-thread-33] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db 0 | |
| 2018-12-21 01:43:21,434 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:runner-pool-2-thread-33] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:21,564 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:21,564 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:21,564 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:21,564 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:21,564 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:21,643 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:21,644 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:21,696 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:21,696 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:21,696 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:21,696 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:21,696 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:21,782 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_METADATA_03 - Failed validation on table name : Invalid character for Hive 'puhax.puhax' | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:373) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:21,788 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:21,791 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:21,793 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:23,171 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:23,173 [user:admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa::0' | |
| 2018-12-21 01:43:23,178 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:runner-pool-2-thread-21] INFO StandaloneRunner - Starting pipeline HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa 0 | |
| 2018-12-21 01:43:23,207 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:runner-pool-2-thread-21] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:23,334 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:23,334 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:23,334 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:23,335 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:23,335 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:23,439 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:23,441 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:23,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:23,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:23,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:23,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:23,496 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:24,570 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_30 - Invalid column name igldk.igldk | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.generateAvroSchema(HiveMetastoreUtil.java:740) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:514) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:43:24,574 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:24,577 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:24,580 [user:*admin] [pipeline:Hive drift test - Table/Column Special Characters/HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa-Hive drift test - Table/Column Special Characters] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:25,808 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:25,809 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82::0' | |
| 2018-12-21 01:43:25,812 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:runner-pool-2-thread-32] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82 0 | |
| 2018-12-21 01:43:25,836 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:runner-pool-2-thread-32] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:25,982 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:25,983 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:25,983 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:25,983 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:25,983 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:26,063 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:26,064 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:26,116 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:26,117 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:26,117 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:26,117 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:26,117 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:28,386 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:28,389 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:28,513 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:29,938 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:29,939 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10::0' | |
| 2018-12-21 01:43:29,943 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:runner-pool-2-thread-12] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10 0 | |
| 2018-12-21 01:43:29,966 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:runner-pool-2-thread-12] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:30,045 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:30,046 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:30,046 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:30,046 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:30,046 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:30,125 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:30,126 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:30,181 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:30,181 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:30,181 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:30,181 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:30,182 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:33,731 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:33,735 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:33,846 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:35,010 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:35,010 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3::0' | |
| 2018-12-21 01:43:35,014 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:runner-pool-2-thread-18] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3 0 | |
| 2018-12-21 01:43:35,044 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:runner-pool-2-thread-18] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:35,165 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:35,165 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:35,166 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:35,166 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:35,166 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:35,273 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:35,275 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:35,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:35,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:35,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:35,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:35,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:39,726 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:39,729 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:39,840 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:41,172 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:41,173 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a::0' | |
| 2018-12-21 01:43:41,177 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:runner-pool-2-thread-9] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a 0 | |
| 2018-12-21 01:43:41,196 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:runner-pool-2-thread-9] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:41,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:41,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:41,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:41,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:41,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:41,349 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:41,351 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:41,401 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:41,401 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:41,401 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:41,401 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:41,401 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:44,500 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:44,503 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:44,615 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:46,234 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:46,234 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609::0' | |
| 2018-12-21 01:43:46,237 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:runner-pool-2-thread-1] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609 0 | |
| 2018-12-21 01:43:46,268 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:runner-pool-2-thread-1] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:46,415 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:46,415 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:46,416 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:46,416 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:46,416 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:46,502 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:46,504 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:46,554 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:46,555 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:46,555 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:46,555 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:46,555 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:48,538 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:48,542 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:49,052 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:50,386 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:50,387 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c::0' | |
| 2018-12-21 01:43:50,390 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:runner-pool-2-thread-20] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c 0 | |
| 2018-12-21 01:43:50,414 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:runner-pool-2-thread-20] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:50,506 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:50,507 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:50,507 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:50,507 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:50,507 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:50,601 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:50,603 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:50,662 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:50,663 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:50,663 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:50,663 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:50,663 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:53,747 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:53,750 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:53,861 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:55,462 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:55,463 [user:admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27::0' | |
| 2018-12-21 01:43:55,468 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:runner-pool-2-thread-7] INFO StandaloneRunner - Starting pipeline HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27 0 | |
| 2018-12-21 01:43:55,529 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:runner-pool-2-thread-7] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:55,599 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:55,600 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:55,600 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:55,600 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:55,600 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:55,675 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:55,676 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:55,725 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:55,725 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:55,725 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:55,725 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:55,725 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:57,195 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:43:57,198 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:43:57,710 [user:*admin] [pipeline:Hive drift test - Keywords/HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27-Hive drift test - Keywords] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:43:59,279 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:43:59,279 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3::0' | |
| 2018-12-21 01:43:59,283 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:runner-pool-2-thread-8] INFO StandaloneRunner - Starting pipeline HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3 0 | |
| 2018-12-21 01:43:59,308 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:runner-pool-2-thread-8] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:43:59,383 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:59,383 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:59,383 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:59,383 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:59,383 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:43:59,485 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:59,487 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:43:59,542 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:43:59,542 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:43:59,542 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:43:59,542 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:43:59,542 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:01,643 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:01,646 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:01,857 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3-Hive drift test - Serialization Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:03,202 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:03,202 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712::0' | |
| 2018-12-21 01:44:03,205 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:runner-pool-2-thread-10] INFO StandaloneRunner - Starting pipeline HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712 0 | |
| 2018-12-21 01:44:03,255 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:runner-pool-2-thread-10] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:03,324 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:03,325 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:03,325 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:03,325 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:03,325 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:03,448 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:03,450 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:03,524 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:03,524 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:03,524 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:03,525 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:03,525 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:04,449 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:04,452 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:04,662 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712-Hive drift test - Serialization Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:06,142 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:06,142 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999::0' | |
| 2018-12-21 01:44:06,146 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:runner-pool-2-thread-14] INFO StandaloneRunner - Starting pipeline HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999 0 | |
| 2018-12-21 01:44:06,176 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:runner-pool-2-thread-14] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:06,287 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:06,288 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:06,288 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:06,288 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:06,288 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:06,370 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:06,371 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:06,426 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:06,427 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:06,427 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:06,427 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:06,427 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:08,091 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:08,094 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:08,706 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999-Hive drift test - Serialization Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:09,966 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:09,968 [user:admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60::0' | |
| 2018-12-21 01:44:10,026 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:runner-pool-2-thread-19] INFO StandaloneRunner - Starting pipeline HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60 0 | |
| 2018-12-21 01:44:10,049 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:runner-pool-2-thread-19] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:10,120 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:10,121 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:10,121 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:10,121 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:10,121 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:10,222 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:10,223 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:10,284 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:10,284 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:10,284 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:10,284 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:10,284 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:12,793 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:12,796 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:13,006 [user:*admin] [pipeline:Hive drift test - Serialization Location/HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60-Hive drift test - Serialization Location] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:14,073 [user:admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:14,074 [user:admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33::0' | |
| 2018-12-21 01:44:14,078 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:runner-pool-2-thread-24] INFO StandaloneRunner - Starting pipeline HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33 0 | |
| 2018-12-21 01:44:14,104 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:runner-pool-2-thread-24] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:14,191 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:14,191 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:14,191 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:14,191 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:14,191 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:14,297 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:14,298 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:14,361 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:14,362 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:14,362 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:14,362 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:14,362 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:16,915 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_26 - Invalid decimal value 0.123 in field number: scale 3 is more then expected 2 | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.validateScaleAndPrecision(HiveMetastoreUtil.java:617) | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.convertRecordToHMSType(HiveMetastoreUtil.java:689) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:409) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:16,915 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_26 - Invalid decimal value 12345 in field number: precision 5 is more then expected 4 | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.validateScaleAndPrecision(HiveMetastoreUtil.java:620) | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.convertRecordToHMSType(HiveMetastoreUtil.java:689) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:409) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:16,938 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:16,942 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:17,050 [user:*admin] [pipeline:Hive drift test - Decimal Test/HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33-Hive drift test - Decimal Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:17,980 [user:admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:17,980 [user:admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2::0' | |
| 2018-12-21 01:44:17,984 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:runner-pool-2-thread-1] INFO StandaloneRunner - Starting pipeline HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2 0 | |
| 2018-12-21 01:44:18,004 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:runner-pool-2-thread-1] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:18,076 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:18,077 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:18,077 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:18,077 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:18,077 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:18,161 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:18,162 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:18,220 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:18,221 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:18,221 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:18,221 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:18,221 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:21,904 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:21,908 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:22,019 [user:*admin] [pipeline:Hive drift test - Partial Input/HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2-Hive drift test - Partial Input] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:23,942 [user:admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:23,942 [user:admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7::0' | |
| 2018-12-21 01:44:23,944 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:runner-pool-2-thread-45] INFO StandaloneRunner - Starting pipeline HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7 0 | |
| 2018-12-21 01:44:23,980 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:runner-pool-2-thread-45] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:24,068 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:24,069 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:24,069 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:24,069 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:24,069 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:24,194 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:24,195 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:24,249 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:24,249 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:24,249 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:24,250 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:24,250 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:24,310 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] WARN BatchMakerImpl - The maximum number of records per batch in the origin has been exceeded. | |
| 2018-12-21 01:44:26,865 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_21 - Type Mismatch for column 'col', Expected: INT, Actual: STRING | |
| at com.streamsets.pipeline.stage.lib.hive.cache.TypeInfoCacheSupport$TypeInfo.getDiff(TypeInfoCacheSupport.java:78) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:499) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:33,833 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:33,836 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:34,365 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7-Hive drift test - Drift Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:36,333 [user:admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:36,333 [user:admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927::0' | |
| 2018-12-21 01:44:36,335 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:runner-pool-2-thread-40] INFO StandaloneRunner - Starting pipeline HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927 0 | |
| 2018-12-21 01:44:36,360 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:runner-pool-2-thread-40] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:36,440 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:36,440 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:36,440 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:36,440 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:36,441 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:36,518 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:36,519 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:36,576 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:36,577 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:36,577 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:36,577 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:36,577 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:36,664 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] WARN BatchMakerImpl - The maximum number of records per batch in the origin has been exceeded. | |
| 2018-12-21 01:44:39,613 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_21 - Type Mismatch for column 'col', Expected: INT, Actual: STRING | |
| at com.streamsets.pipeline.stage.lib.hive.cache.TypeInfoCacheSupport$TypeInfo.getDiff(TypeInfoCacheSupport.java:78) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:499) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:43,707 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:43,711 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:44,243 [user:*admin] [pipeline:Hive drift test - Drift Test/HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927-Hive drift test - Drift Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:46,497 [user:admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:46,498 [user:admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5::0' | |
| 2018-12-21 01:44:46,500 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:runner-pool-2-thread-18] INFO StandaloneRunner - Starting pipeline HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5 0 | |
| 2018-12-21 01:44:46,533 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:runner-pool-2-thread-18] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:46,632 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:46,632 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:46,633 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:46,633 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:46,633 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:46,713 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:46,714 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:46,764 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:46,764 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:46,764 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:46,764 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:46,764 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:47,535 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_32 - Table rfmzkqgtsgjzrmaruafq is created using Storage Format Type org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, but Avro requested instead | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.validateTblPropertiesInfo(HiveMetastoreUtil.java:394) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:432) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:47,541 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:47,544 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:47,546 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5-Hive drift test - Unsupported Table Data Format Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:49,405 [user:admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:49,406 [user:admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033::0' | |
| 2018-12-21 01:44:49,409 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:runner-pool-2-thread-48] INFO StandaloneRunner - Starting pipeline HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033 0 | |
| 2018-12-21 01:44:49,478 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:runner-pool-2-thread-48] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:49,546 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:49,547 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:49,547 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:49,547 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:49,547 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:49,663 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:49,664 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:49,713 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:49,714 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:49,714 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:49,714 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:49,714 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:51,261 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] ERROR HiveMetadataProcessor - Error happened when processing record | |
| com.streamsets.pipeline.stage.lib.hive.exceptions.HiveStageCheckedException: HIVE_32 - Table hrmxvametwoptdwyvrde is created using Storage Format Type org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, but Parquet requested instead | |
| at com.streamsets.pipeline.stage.lib.hive.HiveMetastoreUtil.validateTblPropertiesInfo(HiveMetastoreUtil.java:401) | |
| at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:432) | |
| at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52) | |
| at com.streamsets.pipeline.api.base.configurablestage.DProcessor.process(DProcessor.java:35) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:286) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:44:51,266 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:51,269 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:51,271 [user:*admin] [pipeline:Hive drift test - Unsupported Table Data Format Test/HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033-Hive drift test - Unsupported Table Data Format Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:52,308 [user:admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:52,309 [user:admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d::0' | |
| 2018-12-21 01:44:52,311 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:runner-pool-2-thread-47] INFO StandaloneRunner - Starting pipeline HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d 0 | |
| 2018-12-21 01:44:52,334 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:runner-pool-2-thread-47] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:52,421 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:52,421 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:52,421 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:52,421 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:52,421 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:52,499 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:52,500 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:52,556 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:52,557 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:52,557 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:52,557 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:52,557 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStarte1629145-2891-41e2-a226-b572ad156a63::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart061de50e-8434-44ae-ad42-fb8c91b9f9e8::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart206b9c60-b936-43a6-a9a6-1d199298c10b::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSerializationLocation938ff9b8-fb7d-4ae8-8c24-4d82c5460712::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStarte8248890-43e0-48a2-a7b8-49673470c315::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes0487fe57-0e0e-466a-9b78-9390d9d9c366::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters52029194-9d36-4aa1-8643-75f9b802fa09::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywordsee40fccb-0bce-4597-9c90-91dadb4d2e27::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartda7d05b7-cdce-49b1-b306-1895cd6d8dee::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes56e86b0c-d1b7-4090-a122-3ee4dccac11f::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart12310019-2d11-44c1-9247-335b35c2ddb3::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters76795fa9-790c-4f39-baea-5dc94069f122::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes0618c27b-0338-4e6d-8319-b897b9032842::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestMultiplexing5717d783-6644-4899-b181-54d5ba063ec5::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacterscb63b89c-cd5e-4a69-af1e-e14c5d6b1bd4::'0' | |
| 2018-12-21 01:44:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart6f35c2ae-4a8d-4e69-8c76-9241be4841e4::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocation898b322f-81e9-4a91-90a2-62cacabd2859::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters5d1a43c2-9cc9-4fc6-ae36-79a60630a143::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestDriftTest099bc536-ca95-4d86-8c1e-44f13f55f927::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacterscf3f7cc7-4145-4697-a4da-774356a687db::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartf42f6008-5c7e-4f71-8051-a21dddca5ddf::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestPartitionTypes929facd9-fa31-40ae-98a9-aae240563828::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters370ccd3c-ecb5-4a7c-8761-4119c8f423ee::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocation2ad4470e-159a-48cf-8eb4-a21b006c06d5::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypesa961227c-b423-46cb-bac5-bc1145138943::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywordsd225ff1b-f825-4c5b-b4c8-41b2834f2a10::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartb87fb048-eaa7-468c-ae94-0591a0126876::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocation66d1f129-b2c3-44d2-8935-27ed1ea2c9a5::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters7d5dd806-4f00-418f-b9cf-e3826538c5aa::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypesaa78aa54-2ce7-4cdc-a5b4-4e75941c200f::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocation4464f552-e3bf-40a4-a94c-5bbbd036d8c2::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart669ec009-f513-480c-9a19-46a8b6bcc715::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestPartitionTypesad7123e9-539a-4de4-a0d5-618ab37a8811::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartf20077b3-6d3f-4c27-a9d5-f8513a4708d2::'0' | |
| 2018-12-21 01:44:53,108 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart8e1480d5-af89-48a0-acb9-22e2d41df358::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocationd5dca7c7-3ee2-47d1-a1b8-22ef7885a69c::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestLocationf6d2f21b-7d23-428e-aeff-2a7fd9ed69a8::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypescddb98a1-49be-436f-8360-10c02dcabf0b::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywordsfa948dbe-f675-4979-b72e-ce3ad22ba7d3::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestPartitionTypesce84eae0-5af9-4759-85d6-8b4344047a8f::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart7baed7af-4fef-42a9-9224-720a0ba7e4c7::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart88029cea-d496-4b5c-b067-38131dfe60fc::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart89515973-b8f5-42f1-9055-ce2fa8534165::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestPartialInpute3d2f8a2-2be0-423f-99c5-f719b29fbfd2::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSerializationLocationaf8d74e7-5171-453f-89de-59fd1883a999::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSerializationLocationcb0b6d40-f960-4f0c-8283-57d9556ac2a3::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestPartitionCharactersca67e4a9-9533-401b-838a-a499dbaa247c::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypesa29675fc-b863-4cd7-b36f-fd5adfdf8c24::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestUnsupportedTableDataFormatTestd86f9387-7b29-4892-80e8-467f5f631ab5::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywords223907e4-9511-4e85-87b1-f72856082609::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes3db6e589-c974-4759-b270-43e438755e71::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStarted74fde0-05de-4304-adff-6de6ac8e1927::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestDecimalTest57d55158-61e6-467b-ba0e-ac63c6105d33::'0' | |
| 2018-12-21 01:44:53,109 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestDriftTestb892b66e-dd61-4140-b402-25f38af6fec7::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSerializationLocation7529c84b-c580-4781-8567-2746acd60d60::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes510022f4-8870-448d-bc6c-d4adfe2858a4::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes61c38b1e-c900-45bb-8e60-3bdf23e8430a::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypesd7cd3ab2-a1e2-4cd4-91da-be542ccffea1::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywords2f9d42ad-fe8b-42d7-bf00-c893529fbf82::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart6bdb25e2-7b77-4a64-b227-25003e61479e::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartc8ebb47c-e6e9-44d7-8f81-db1ecbe7f305::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestSDCTypes37f831bc-5398-4562-816a-2ef6c9e2c239::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestUnsupportedTableDataFormatTest9d0ae64e-d062-440b-8c96-a48d31f3d033::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywords08fb6aa0-5d51-4f75-875b-e04a588b510a::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartb72801b9-bfef-4e02-a4d8-4c3162b63ee1::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStarta6caf724-b359-44a8-a033-4ffeb1c92e7a::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestTableColumnSpecialCharacters4308bd0e-b5d0-4293-80af-22a6131a14f1::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartaf3cc0d5-14a7-4244-bf7a-96ddf26ffd69::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestKeywords82818527-ba08-40a8-bd38-dd53226f2b2c::'0' | |
| 2018-12-21 01:44:53,110 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-1] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStart2717063d-8d8b-43c0-a90a-eb2c74218f48::'0' | |
| 2018-12-21 01:44:57,223 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:44:57,227 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:44:57,762 [user:*admin] [pipeline:Hive drift test - Multiple open partitions/HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d-Hive drift test - Multiple open partitions] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:44:59,390 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:44:59,391 [user:admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed::0' | |
| 2018-12-21 01:44:59,396 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:runner-pool-2-thread-40] INFO StandaloneRunner - Starting pipeline HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed 0 | |
| 2018-12-21 01:44:59,417 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:runner-pool-2-thread-40] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:44:59,490 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:59,490 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:59,490 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:59,490 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:59,490 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:44:59,601 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:59,602 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:44:59,655 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:44:59,655 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:44:59,655 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:44:59,655 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:44:59,655 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:45:01,625 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:45:01,630 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:45:01,740 [user:*admin] [pipeline:Hive drift test - Cold Start/HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed-Hive drift test - Cold Start] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:45:03,423 [user:admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:03,423 [user:admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606::0' | |
| 2018-12-21 01:45:03,426 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:runner-pool-2-thread-19] INFO StandaloneRunner - Starting pipeline HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606 0 | |
| 2018-12-21 01:45:03,448 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:runner-pool-2-thread-19] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:03,523 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:45:03,524 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:45:03,524 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:45:03,524 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:45:03,524 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:45:03,602 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:45:03,603 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:45:03,655 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:45:03,656 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:45:03,656 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:45:03,656 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:45:03,656 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:45:07,251 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:45:07,254 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:0] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:45:08,177 [user:*admin] [pipeline:Hive drift test - Events Test/HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606] [runner:] [thread:ProductionPipelineRunnable-HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606-Hive drift test - Events Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:45:09,301 [user:admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:09,303 [user:admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e::0' | |
| 2018-12-21 01:45:09,305 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:runner-pool-2-thread-10] INFO StandaloneRunner - Starting pipeline HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e 0 | |
| 2018-12-21 01:45:09,358 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:runner-pool-2-thread-10] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:09,438 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:45:09,438 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:45:09,438 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:45:09,438 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:45:09,438 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:45:11,080 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] ERROR HiveQueryExecutor - Failed to execute query: select 22 from invalid_table | |
| org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:241) | |
| at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:227) | |
| at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:255) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:129) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:400) | |
| at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:187) | |
| at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:271) | |
| at org.apache.hive.service.cli.operation.Operation.run(Operation.java:337) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:439) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:416) | |
| at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:498) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at javax.security.auth.Subject.doAs(Subject.java:422) | |
| at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59) | |
| at com.sun.proxy.$Proxy20.executeStatementAsync(Unknown Source) | |
| at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:282) | |
| at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:501) | |
| at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) | |
| at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) | |
| at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) | |
| at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) | |
| at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) | |
| at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) | |
| ... 3 more | |
| Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1903) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1557) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genResolvedParseTree(SemanticAnalyzer.java:10172) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10223) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10108) | |
| at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:223) | |
| at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:558) | |
| at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1356) | |
| at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1343) | |
| at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:185) | |
| ... 26 more | |
| Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1607) | |
| ... 35 more | |
| 2018-12-21 01:45:11,083 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] ERROR HiveQueryExecutor - Error when processing record: com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'select 22 from invalid_table'. Reason: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'select 22 from invalid_table'. Reason: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:152) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:45:11,087 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:45:11,090 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e] [runner:] [thread:ProductionPipelineRunnable-HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e-Hive Query Executor Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:45:11,976 [user:admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:11,977 [user:admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd::0' | |
| 2018-12-21 01:45:11,978 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:runner-pool-2-thread-27] INFO StandaloneRunner - Starting pipeline HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd 0 | |
| 2018-12-21 01:45:12,012 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:runner-pool-2-thread-27] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:12,099 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:45:12,100 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:45:12,100 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:45:12,100 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:45:12,100 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:45:15,743 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] ERROR HiveQueryExecutor - Failed to execute query: select 22 from invalid_table | |
| org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:241) | |
| at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:227) | |
| at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:255) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:129) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:400) | |
| at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:187) | |
| at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:271) | |
| at org.apache.hive.service.cli.operation.Operation.run(Operation.java:337) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:439) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:416) | |
| at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:498) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at javax.security.auth.Subject.doAs(Subject.java:422) | |
| at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) | |
| at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59) | |
| at com.sun.proxy.$Proxy20.executeStatementAsync(Unknown Source) | |
| at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:282) | |
| at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:501) | |
| at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313) | |
| at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298) | |
| at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) | |
| at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) | |
| at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56) | |
| at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) | |
| ... 3 more | |
| Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1903) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1557) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genResolvedParseTree(SemanticAnalyzer.java:10172) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10223) | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10108) | |
| at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:223) | |
| at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:558) | |
| at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1356) | |
| at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1343) | |
| at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:185) | |
| ... 26 more | |
| Caused by: org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:15 Table not found 'invalid_table' | |
| at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1607) | |
| ... 35 more | |
| 2018-12-21 01:45:16,206 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:0] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] ERROR HiveQueryExecutor - Error when processing record: com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'select 22 from invalid_table'. Reason: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'select 22 from invalid_table'. Reason: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 1:15 Table not found 'invalid_table' | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:152) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:45:16,211 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:45:16,214 [user:*admin] [pipeline:Hive Query Executor Test/HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd] [runner:] [thread:ProductionPipelineRunnable-HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd-Hive Query Executor Test] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:45:27,622 [user:admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:27,623 [user:admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203::0' | |
| 2018-12-21 01:45:27,628 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:runner-pool-2-thread-41] INFO StandaloneRunner - Starting pipeline Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203 0 | |
| 2018-12-21 01:45:27,664 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:runner-pool-2-thread-41] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:27,794 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] INFO KuduTarget - Validating connection to Kudu cluster node-1.cluster and whether table impala::default.cTHEyxmGvI exists and is enabled | |
| 2018-12-21 01:45:29,440 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 4], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:29,440 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:29,440 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 2], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:29,440 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 3], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:30,433 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 4], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:30,433 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 2], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:30,433 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 3], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:30,433 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:31,431 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 4], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:31,432 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:31,432 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 2], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:31,432 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 3], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:31,722 [user:admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:45:31,727 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:runnerStop-pool-10-thread-1] INFO StandaloneRunner - Stopping pipeline Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203 0 | |
| 2018-12-21 01:45:32,435 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:32,435 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 4], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:32,435 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 2], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:32,435 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:0] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 3], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:32,436 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:45:32,450 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:45:32,451 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:ProductionPipelineRunnable-Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203', '0' to 'STOPPED' | |
| 2018-12-21 01:45:32,463 [user:*admin] [pipeline:Pipeline/Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203] [runner:] [thread:runnerStop-pool-10-thread-1] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:45:39,890 [user:admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:webserver-33] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:39,890 [user:admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:webserver-33] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline37a122d5-d335-4303-b880-ffba84a055f4::0' | |
| 2018-12-21 01:45:39,894 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:runner-pool-2-thread-46] INFO StandaloneRunner - Starting pipeline Pipeline37a122d5-d335-4303-b880-ffba84a055f4 0 | |
| 2018-12-21 01:45:39,918 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:runner-pool-2-thread-46] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:39,948 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] INFO KuduTarget - Validating connection to Kudu cluster node-1.cluster and whether table impala::default.NJyMTzOcNd exists and is enabled | |
| 2018-12-21 01:45:40,174 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:40,422 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:40,672 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:40,922 [user:admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:45:40,923 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:40,925 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:runnerStop-pool-10-thread-2] INFO StandaloneRunner - Stopping pipeline Pipeline37a122d5-d335-4303-b880-ffba84a055f4 0 | |
| 2018-12-21 01:45:41,174 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:0] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] WARN KuduTarget - Errors while interacting with Kudu: Row error for primary key=[-128, 0, 0, 1], tablet=null, server=4317c10af9d04dd4b6cefcb435b3a7a0, status=Already present: key already present (error 0) | |
| 2018-12-21 01:45:41,175 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:45:41,186 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:45:41,190 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:ProductionPipelineRunnable-Pipeline37a122d5-d335-4303-b880-ffba84a055f4-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline37a122d5-d335-4303-b880-ffba84a055f4', '0' to 'STOPPED' | |
| 2018-12-21 01:45:41,205 [user:*admin] [pipeline:Pipeline/Pipeline37a122d5-d335-4303-b880-ffba84a055f4] [runner:] [thread:runnerStop-pool-10-thread-2] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:45:51,566 [user:admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:51,566 [user:admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03::0' | |
| 2018-12-21 01:45:51,569 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:runner-pool-2-thread-44] INFO StandaloneRunner - Starting pipeline Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03 0 | |
| 2018-12-21 01:45:51,612 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:runner-pool-2-thread-44] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:52,603 [user:admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:45:52,607 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:runnerStop-pool-10-thread-3] INFO StandaloneRunner - Stopping pipeline Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03 0 | |
| 2018-12-21 01:45:52,607 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:ProductionPipelineRunnable-Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:45:52,615 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:ProductionPipelineRunnable-Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:45:52,617 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:ProductionPipelineRunnable-Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03', '0' to 'STOPPED' | |
| 2018-12-21 01:45:52,639 [user:*admin] [pipeline:Pipeline/Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03] [runner:] [thread:runnerStop-pool-10-thread-3] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:45:54,353 [user:admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:45:54,353 [user:admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline545cae58-b389-44d3-abee-9191272ac572::0' | |
| 2018-12-21 01:45:54,358 [user:*admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:runner-pool-2-thread-27] INFO StandaloneRunner - Starting pipeline Pipeline545cae58-b389-44d3-abee-9191272ac572 0 | |
| 2018-12-21 01:45:54,377 [user:*admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:runner-pool-2-thread-27] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:45:54,433 [user:*admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:ProductionPipelineRunnable-Pipeline545cae58-b389-44d3-abee-9191272ac572-Pipeline] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:45:54,437 [user:*admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:ProductionPipelineRunnable-Pipeline545cae58-b389-44d3-abee-9191272ac572-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:45:54,451 [user:*admin] [pipeline:Pipeline/Pipeline545cae58-b389-44d3-abee-9191272ac572] [runner:] [thread:ProductionPipelineRunnable-Pipeline545cae58-b389-44d3-abee-9191272ac572-Pipeline] ERROR ProductionPipelineRunnable - An exception occurred while running the pipeline, com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'Pipeline545cae58-b389-44d3-abee-9191272ac572' validation error : KUDU_01 - Table 'impala::default.czkrvalgbb' does not exist | |
| com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'Pipeline545cae58-b389-44d3-abee-9191272ac572' validation error : KUDU_01 - Table 'impala::default.czkrvalgbb' does not exist | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:128) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:724) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:151) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:46:05,576 [user:admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:46:05,576 [user:admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed::0' | |
| 2018-12-21 01:46:05,580 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:runner-pool-2-thread-5] INFO StandaloneRunner - Starting pipeline Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed 0 | |
| 2018-12-21 01:46:05,649 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:runner-pool-2-thread-5] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:06,606 [user:admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:06,610 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:runnerStop-pool-10-thread-4] INFO StandaloneRunner - Stopping pipeline Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed 0 | |
| 2018-12-21 01:46:06,610 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:ProductionPipelineRunnable-Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:06,618 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:ProductionPipelineRunnable-Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:06,619 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:ProductionPipelineRunnable-Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed', '0' to 'STOPPED' | |
| 2018-12-21 01:46:06,654 [user:*admin] [pipeline:Pipeline/Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed] [runner:] [thread:runnerStop-pool-10-thread-4] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:46:13,529 [user:admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:webserver-17] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:46:13,529 [user:admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:webserver-17] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e::0' | |
| 2018-12-21 01:46:13,532 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:runner-pool-2-thread-9] INFO StandaloneRunner - Starting pipeline Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e 0 | |
| 2018-12-21 01:46:13,553 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:runner-pool-2-thread-9] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:14,559 [user:admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:14,563 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:runnerStop-pool-10-thread-5] INFO StandaloneRunner - Stopping pipeline Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e 0 | |
| 2018-12-21 01:46:14,563 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:ProductionPipelineRunnable-Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:14,579 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:ProductionPipelineRunnable-Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:14,581 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:ProductionPipelineRunnable-Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e', '0' to 'STOPPED' | |
| 2018-12-21 01:46:14,600 [user:*admin] [pipeline:Pipeline/Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e] [runner:] [thread:runnerStop-pool-10-thread-5] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:46:21,547 [user:admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:46:21,548 [user:admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4::0' | |
| 2018-12-21 01:46:21,552 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:runner-pool-2-thread-6] INFO StandaloneRunner - Starting pipeline Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4 0 | |
| 2018-12-21 01:46:21,607 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:runner-pool-2-thread-6] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:22,607 [user:admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:22,611 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:runnerStop-pool-10-thread-6] INFO StandaloneRunner - Stopping pipeline Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4 0 | |
| 2018-12-21 01:46:22,612 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:ProductionPipelineRunnable-Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:22,621 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:ProductionPipelineRunnable-Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:22,622 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:ProductionPipelineRunnable-Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4', '0' to 'STOPPED' | |
| 2018-12-21 01:46:22,635 [user:*admin] [pipeline:Pipeline/Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4] [runner:] [thread:runnerStop-pool-10-thread-6] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:46:24,388 [user:admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:46:24,390 [user:admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7::0' | |
| 2018-12-21 01:46:24,392 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runner-pool-2-thread-36] INFO StandaloneRunner - Starting pipeline Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7 0 | |
| 2018-12-21 01:46:24,414 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runner-pool-2-thread-36] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:24,504 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:46:24,505 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:46:24,505 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:46:24,505 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:46:24,505 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:46:25,413 [user:admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:25,416 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runnerStop-pool-10-thread-6] INFO StandaloneRunner - Stopping pipeline Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7 0 | |
| 2018-12-21 01:46:25,416 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:25,420 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:25,421 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7', '0' to 'STOPPED' | |
| 2018-12-21 01:46:25,433 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runnerStop-pool-10-thread-6] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:46:26,480 [user:admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7::0' | |
| 2018-12-21 01:46:26,483 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runner-pool-2-thread-29] INFO StandaloneRunner - Starting pipeline Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7 0 | |
| 2018-12-21 01:46:26,508 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runner-pool-2-thread-29] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:26,615 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:46:26,615 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO HiveConfigBean - Authentication: Simple | |
| 2018-12-21 01:46:26,615 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO HiveConfigBean - Connection to Hive become stale, reconnecting. | |
| 2018-12-21 01:46:26,615 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Utils - Supplied authorities: node-1.cluster:10000 | |
| 2018-12-21 01:46:26,615 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Utils - Resolved authority: node-1.cluster:10000 | |
| 2018-12-21 01:46:27,155 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] ERROR HiveQueryExecutor - Failed to execute query: CREATE TABLE cgWuOKpRUO (id int, name string) | |
| java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. AlreadyExistsException(message:Table cgWuOKpRUO already exists) | |
| at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:292) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:129) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:46:27,155 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:0] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] ERROR HiveQueryExecutor - Error when processing record: com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'CREATE TABLE cgWuOKpRUO (id int, name string)'. Reason: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. AlreadyExistsException(message:Table cgWuOKpRUO already exists) | |
| com.streamsets.pipeline.api.base.OnRecordErrorException: QUERY_EXECUTOR_001 - Failed to execute queries. Details : Failed to execute query 'CREATE TABLE cgWuOKpRUO (id int, name string)'. Reason: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. AlreadyExistsException(message:Table cgWuOKpRUO already exists) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.executeQueries(HiveQueryExecutor.java:152) | |
| at com.streamsets.pipeline.stage.destination.hive.queryexecutor.HiveQueryExecutor.write(HiveQueryExecutor.java:91) | |
| at com.streamsets.pipeline.api.base.configurablestage.DExecutor.write(DExecutor.java:34) | |
| at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:290) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:235) | |
| at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:298) | |
| at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:244) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:824) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:869) | |
| at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:138) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:868) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:846) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:583) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:397) | |
| at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:532) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:109) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:46:27,520 [user:admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:27,523 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runnerStop-pool-10-thread-7] INFO StandaloneRunner - Stopping pipeline Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7 0 | |
| 2018-12-21 01:46:27,524 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:27,529 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:27,530 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:ProductionPipelineRunnable-Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7-Hive query executor pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7', '0' to 'STOPPED' | |
| 2018-12-21 01:46:27,542 [user:*admin] [pipeline:Hive query executor pipeline/Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7] [runner:] [thread:runnerStop-pool-10-thread-7] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:46:29,216 [user:admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:46:29,217 [user:admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734::0' | |
| 2018-12-21 01:46:29,219 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:runner-pool-2-thread-17] INFO StandaloneRunner - Starting pipeline MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734 0 | |
| 2018-12-21 01:46:29,243 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:runner-pool-2-thread-17] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:46:29,350 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:46:29,352 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:46:29,389 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/_sdc-dummy-ebb3521f-31d8-4639-9c11-52fd7ea33c30 | |
| 2018-12-21 01:46:29,404 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/zZMOdwccfW/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:46:29,453 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:46:29,553 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO deprecation - mapreduce.task.classpath.user.precedence is deprecated. Instead, use mapreduce.job.user.classpath.first | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-common-1.8.1.jar for class org.apache.parquet.SemanticVersion | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-hadoop-1.8.1.jar for class org.apache.parquet.hadoop.ParquetWriter | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-avro-1.8.1.jar for class org.apache.parquet.avro.AvroParquetWriter | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/hive-exec-1.1.0-cdh5.12.2.jar for class org.apache.avro.mapred.FsInput | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-format-2.3.0-incubating.jar for class org.apache.parquet.format.CompressionCodec | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-column-1.8.1.jar for class org.apache.parquet.column.ParquetProperties | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-encoding-1.8.1.jar for class org.apache.parquet.bytes.BytesInput | |
| 2018-12-21 01:46:29,559 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-wholefile-converter-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.AvroToParquetConverterUtil | |
| 2018-12-21 01:46:29,622 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO RMProxy - Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:46:29,863 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] WARN JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
| 2018-12-21 01:46:31,810 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO JobSubmitter - number of splits:1 | |
| 2018-12-21 01:46:31,846 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO JobSubmitter - Submitting tokens for job: job_1545356107870_0001 | |
| 2018-12-21 01:46:32,423 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO YarnClientImpl - Submitted application application_1545356107870_0001 | |
| 2018-12-21 01:46:32,462 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO Job - The url to track the job: http://node-1.cluster:8088/proxy/application_1545356107870_0001/ | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-common-1.8.1.jar for class org.apache.parquet.SemanticVersion | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-hadoop-1.8.1.jar for class org.apache.parquet.hadoop.ParquetWriter | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-avro-1.8.1.jar for class org.apache.parquet.avro.AvroParquetWriter | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/hive-exec-1.1.0-cdh5.12.2.jar for class org.apache.avro.mapred.FsInput | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-format-2.3.0-incubating.jar for class org.apache.parquet.format.CompressionCodec | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-column-1.8.1.jar for class org.apache.parquet.column.ParquetProperties | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/parquet-encoding-1.8.1.jar for class org.apache.parquet.bytes.BytesInput | |
| 2018-12-21 01:46:32,464 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-wholefile-converter-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.AvroToParquetConverterUtil | |
| 2018-12-21 01:46:32,485 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO RMProxy - Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:46:32,490 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] WARN JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
| 2018-12-21 01:46:33,141 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO JobSubmitter - number of splits:1 | |
| 2018-12-21 01:46:33,161 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO JobSubmitter - Submitting tokens for job: job_1545356107870_0002 | |
| 2018-12-21 01:46:33,449 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO YarnClientImpl - Submitted application application_1545356107870_0002 | |
| 2018-12-21 01:46:33,452 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO Job - The url to track the job: http://node-1.cluster:8088/proxy/application_1545356107870_0002/ | |
| 2018-12-21 01:46:34,266 [user:admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:webserver-19] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:46:34,275 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:runnerStop-pool-10-thread-9] INFO StandaloneRunner - Stopping pipeline MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734 0 | |
| 2018-12-21 01:46:34,288 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:46:34,289 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:0] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:46:34,391 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:46:34,392 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:ProductionPipelineRunnable-MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734-MapReduce executor pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734', '0' to 'STOPPED' | |
| 2018-12-21 01:46:34,416 [user:*admin] [pipeline:MapReduce executor pipeline/MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734] [runner:] [thread:runnerStop-pool-10-thread-9] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:08,493 [user:admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:08,493 [user:admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to start pipeline 'ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382::0' | |
| 2018-12-21 01:47:08,496 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:runner-pool-2-thread-40] INFO StandaloneRunner - Starting pipeline ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382 0 | |
| 2018-12-21 01:47:08,516 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:runner-pool-2-thread-40] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:08,597 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:0] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] WARN LoginUgiProviderFactory - Could not find implementation of LoginUgiProviderFactory. Using default implementation meant for Apache Hadoop. | |
| 2018-12-21 01:47:08,719 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:0] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:47:08,746 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:0] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/_sdc-dummy-16acd6dc-8fb5-42fb-b7f4-3709f4362cf9 | |
| 2018-12-21 01:47:08,755 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:0] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/MYWMbeGdAT/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:47:08,782 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:47:08,783 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:0] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:47:08,784 [user:*admin] [pipeline:To File pipeline/ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382] [runner:] [thread:ProductionPipelineRunnable-ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382-To File pipeline] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:47:09,962 [user:admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:09,962 [user:admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to start pipeline 'Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a::0' | |
| 2018-12-21 01:47:09,966 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:runner-pool-2-thread-5] INFO StandaloneRunner - Starting pipeline Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a 0 | |
| 2018-12-21 01:47:10,032 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:runner-pool-2-thread-5] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:10,136 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - WARNING: User-defined SPARK_HOME (/opt/cloudera/parcels/SPARK2-2.1.0.cloudera1-1.cdh5.7.0.p0.120904/lib/spark2) overrides detected (/opt/cloudera/parcels/SPARK2/lib/spark2). | |
| 2018-12-21 01:47:10,136 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - WARNING: Running spark-class from user-defined location. | |
| 2018-12-21 01:47:11,005 [user:admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:47:11,008 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:runnerStop-pool-10-thread-10] INFO StandaloneRunner - Stopping pipeline Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a 0 | |
| 2018-12-21 01:47:11,009 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:ProductionPipelineRunnable-Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a-Spark executor pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:47:11,009 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:ProductionPipelineRunnable-Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a-Spark executor pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:47:11,011 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:ProductionPipelineRunnable-Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a-Spark executor pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a', '0' to 'STOPPED' | |
| 2018-12-21 01:47:11,027 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:] [thread:runnerStop-pool-10-thread-10] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:13,272 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO client.RMProxy: Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:47:13,467 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Requesting a new application from cluster with 1 NodeManagers | |
| 2018-12-21 01:47:13,521 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Verifying our application has not requested more than the maximum memory capability of the cluster (5985 MB per container) | |
| 2018-12-21 01:47:13,522 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Will allocate AM container, with 394 MB memory including 384 MB overhead | |
| 2018-12-21 01:47:13,522 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Setting up container launch context for our AM | |
| 2018-12-21 01:47:13,525 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Setting up the launch environment for our AM container | |
| 2018-12-21 01:47:13,556 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:13 INFO yarn.Client: Preparing resources for our AM container | |
| 2018-12-21 01:47:14,954 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:14 INFO yarn.Client: Uploading resource file:/tmp/out/MYWMbeGdAT/sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4_cb2c1c36-bd57-4bf7-b692-1b441dd3deef.py -> hdfs://node-1.cluster:8020/user/sdc/.sparkStaging/application_1545356107870_0003/sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4_cb2c1c36-bd57-4bf7-b692-1b441dd3deef.py | |
| 2018-12-21 01:47:15,266 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO yarn.Client: Uploading resource file:/tmp/spark-c4b12013-8cf1-4609-bbe8-a0d7c52b6d27/__spark_conf__779351880586007068.zip -> hdfs://node-1.cluster:8020/user/sdc/.sparkStaging/application_1545356107870_0003/__spark_conf__.zip | |
| 2018-12-21 01:47:15,316 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO spark.SecurityManager: Changing view acls to: sdc | |
| 2018-12-21 01:47:15,317 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO spark.SecurityManager: Changing modify acls to: sdc | |
| 2018-12-21 01:47:15,318 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO spark.SecurityManager: Changing view acls groups to: | |
| 2018-12-21 01:47:15,318 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO spark.SecurityManager: Changing modify acls groups to: | |
| 2018-12-21 01:47:15,320 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(sdc); groups with view permissions: Set(); users with modify permissions: Set(sdc); groups with modify permissions: Set() | |
| 2018-12-21 01:47:15,339 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO yarn.Client: Submitting application application_1545356107870_0003 to ResourceManager | |
| 2018-12-21 01:47:15,374 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:15 INFO impl.YarnClientImpl: Submitted application application_1545356107870_0003 | |
| 2018-12-21 01:47:16,376 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:16 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:16 INFO yarn.Client: | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - client token: N/A | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - diagnostics: N/A | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - ApplicationMaster host: N/A | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - ApplicationMaster RPC port: -1 | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - queue: root.users.sdc | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - start time: 1545356835352 | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - final status: UNDEFINED | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - tracking URL: http://node-1.cluster:8088/proxy/application_1545356107870_0003/ | |
| 2018-12-21 01:47:16,380 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - user: sdc | |
| 2018-12-21 01:47:17,382 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:17 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:18,384 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:18 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:19,387 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:19 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:20,391 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:20 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:21,393 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:21 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:22,396 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:22 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:23,398 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:23 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:24,401 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:24 INFO yarn.Client: Application report for application_1545356107870_0003 (state: ACCEPTED) | |
| 2018-12-21 01:47:25,928 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:25 INFO yarn.Client: Application report for application_1545356107870_0003 (state: FAILED) | |
| 2018-12-21 01:47:25,928 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:25 INFO yarn.Client: | |
| 2018-12-21 01:47:25,928 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - client token: N/A | |
| 2018-12-21 01:47:25,928 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - diagnostics: Application application_1545356107870_0003 failed 2 times due to AM Container for appattempt_1545356107870_0003_000002 exited with exitCode: 1 | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - For more detailed output, check application tracking page:http://node-1.cluster:8088/proxy/application_1545356107870_0003/Then, click on links to logs of each attempt. | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Diagnostics: Exception from container-launch. | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Container id: container_1545356107870_0003_02_000001 | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Exit code: 1 | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Stack trace: ExitCodeException exitCode=1: | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.util.Shell.runCommand(Shell.java:601) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.util.Shell.run(Shell.java:504) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) | |
| 2018-12-21 01:47:25,929 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Container exited with a non-zero exit code 1 | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Failing this attempt. Failing the application. | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - ApplicationMaster host: N/A | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - ApplicationMaster RPC port: -1 | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - queue: root.users.sdc | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - start time: 1545356835352 | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - final status: FAILED | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - tracking URL: http://node-1.cluster:8088/cluster/app/application_1545356107870_0003 | |
| 2018-12-21 01:47:25,930 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - user: sdc | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - Exception in thread "main" org.apache.spark.SparkException: Application application_1545356107870_0003 finished with failed status | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.yarn.Client.run(Client.scala:1172) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1218) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.yarn.Client.main(Client.scala) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at java.lang.reflect.Method.invoke(Method.java:498) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187) | |
| 2018-12-21 01:47:25,939 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212) | |
| 2018-12-21 01:47:25,940 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126) | |
| 2018-12-21 01:47:25,940 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) | |
| 2018-12-21 01:47:25,942 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:25 INFO util.ShutdownHookManager: Shutdown hook called | |
| 2018-12-21 01:47:25,943 [user:*admin] [pipeline:Spark executor pipeline/Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a] [runner:0] [thread:launcher-proc-1] INFO stf_HXiGmKwgXn - 18/12/21 01:47:25 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-c4b12013-8cf1-4609-bbe8-a0d7c52b6d27 | |
| 2018-12-21 01:47:36,355 [user:admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:webserver-15] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:36,356 [user:admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:webserver-15] INFO StandaloneRunner - Preparing to start pipeline 'HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449::0' | |
| 2018-12-21 01:47:36,358 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:runner-pool-2-thread-28] INFO StandaloneRunner - Starting pipeline HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449 0 | |
| 2018-12-21 01:47:36,382 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:runner-pool-2-thread-28] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:36,432 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:47:36,433 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:47:36,443 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/_sdc-dummy-ca6aa3a6-9652-4d40-8472-b15f017d4b8e | |
| 2018-12-21 01:47:36,454 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/2f8089c0-1565-4078-b915-243dcef3c719/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:47:37,375 [user:admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:webserver-15] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:47:37,379 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:runnerStop-pool-10-thread-11] INFO StandaloneRunner - Stopping pipeline HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449 0 | |
| 2018-12-21 01:47:37,480 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:47:37,480 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:47:37,480 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:47:37,488 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:47:37,489 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:ProductionPipelineRunnable-HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449-Hadoop FS impersonation pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449', '0' to 'STOPPED' | |
| 2018-12-21 01:47:37,499 [user:*admin] [pipeline:Hadoop FS impersonation pipeline/HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449] [runner:] [thread:runnerStop-pool-10-thread-11] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:47,336 [user:admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:47,336 [user:admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b::0' | |
| 2018-12-21 01:47:47,344 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:runner-pool-2-thread-23] INFO StandaloneRunner - Starting pipeline HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b 0 | |
| 2018-12-21 01:47:47,381 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:runner-pool-2-thread-23] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:47,451 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:47:47,452 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:47:47,458 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/out/_sdc-dummy-6d093dc9-2279-405d-b7d5-ccfafa364f90 | |
| 2018-12-21 01:47:47,463 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/QREwJbWfPy/_tmp_stages* | |
| 2018-12-21 01:47:48,417 [user:admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:47:48,421 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:runnerStop-pool-10-thread-12] INFO StandaloneRunner - Stopping pipeline HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b 0 | |
| 2018-12-21 01:47:48,421 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:47:48,421 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:47:48,422 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:47:48,424 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b-Hadoop FS Destination] INFO ProductionPipelineRunnable - Changing state of pipeline 'HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b', '0' to 'STOPPED' | |
| 2018-12-21 01:47:48,441 [user:*admin] [pipeline:Hadoop FS Destination/HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b] [runner:] [thread:runnerStop-pool-10-thread-12] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:49,914 [user:admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:49,915 [user:admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141::0' | |
| 2018-12-21 01:47:49,919 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:runner-pool-2-thread-24] INFO StandaloneRunner - Starting pipeline HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141 0 | |
| 2018-12-21 01:47:49,940 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:runner-pool-2-thread-24] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:49,996 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:47:49,998 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:47:50,058 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/out/_sdc-dummy-f3772a73-3a53-4937-b246-c69f135b4056 | |
| 2018-12-21 01:47:50,064 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/FhMumKNSjK/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:47:50,968 [user:admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:47:50,971 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:runnerStop-pool-10-thread-12] INFO StandaloneRunner - Stopping pipeline HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141 0 | |
| 2018-12-21 01:47:50,971 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:47:50,971 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:47:50,971 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:47:50,973 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141-Hadoop FS Destination User] INFO ProductionPipelineRunnable - Changing state of pipeline 'HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141', '0' to 'STOPPED' | |
| 2018-12-21 01:47:50,987 [user:*admin] [pipeline:Hadoop FS Destination User/HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141] [runner:] [thread:runnerStop-pool-10-thread-12] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:52,666 [user:admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:webserver-21] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:52,666 [user:admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:webserver-21] INFO StandaloneRunner - Preparing to start pipeline 'HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98::0' | |
| 2018-12-21 01:47:52,672 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:runner-pool-2-thread-19] INFO StandaloneRunner - Starting pipeline HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98 0 | |
| 2018-12-21 01:47:52,702 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:runner-pool-2-thread-19] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:52,769 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:47:52,770 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:47:52,778 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/out/_sdc-dummy-cbacc1dc-1530-46d9-ac34-4cbf27e84ca1 | |
| 2018-12-21 01:47:52,784 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/RMjboTFynV/*/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:47:53,713 [user:admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:47:53,716 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:runnerStop-pool-10-thread-13] INFO StandaloneRunner - Stopping pipeline HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98 0 | |
| 2018-12-21 01:47:53,716 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:47:53,716 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:0] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:47:53,727 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:47:53,728 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:ProductionPipelineRunnable-HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98-Hadoop FS Destination Time Basis] INFO ProductionPipelineRunnable - Changing state of pipeline 'HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98', '0' to 'STOPPED' | |
| 2018-12-21 01:47:53,743 [user:*admin] [pipeline:Hadoop FS Destination Time Basis/HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98] [runner:] [thread:runnerStop-pool-10-thread-13] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:47:55,672 [user:admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:47:55,674 [user:admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to start pipeline 'Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6::0' | |
| 2018-12-21 01:47:55,676 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:runner-pool-2-thread-13] INFO StandaloneRunner - Starting pipeline Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6 0 | |
| 2018-12-21 01:47:55,734 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:runner-pool-2-thread-13] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:47:55,778 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO log - Logging initialized @825524ms to org.eclipse.jetty.util.log.Slf4jLog | |
| 2018-12-21 01:47:55,873 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO Server - jetty-9.4.12.v20180830; built: 2018-08-30T13:59:14.071Z; git: 27208684755d94a92186989f695db2d7b21ebc51; jvm 1.8.0_131-b11 | |
| 2018-12-21 01:47:55,902 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO ContextHandler - Started o.e.j.s.ServletContextHandler@6d8c076b{/,null,AVAILABLE} | |
| 2018-12-21 01:47:55,913 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO AbstractConnector - Started ServerConnector@35d9a75b{HTTP/1.1,[http/1.1]}{0.0.0.0:20000} | |
| 2018-12-21 01:47:55,913 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO Server - Started @825660ms | |
| 2018-12-21 01:47:55,914 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO IpcServer - Running, port '20000', TLS 'false' | |
| 2018-12-21 01:47:56,748 [user:admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: CLUSTER_BATCH | |
| 2018-12-21 01:47:56,763 [user:admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:webserver-22] INFO ClusterRunner - Preparing to start pipeline 'HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755::0' | |
| 2018-12-21 01:47:56,858 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO DClusterSourceOffsetCommitter - Created source of type: com.streamsets.pipeline.stage.origin.hdfs.cluster.ClusterHdfsSource@a3c2ab6 | |
| 2018-12-21 01:47:56,900 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:47:56,903 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ClusterHdfsSource - Authentication Config: Using Simple | |
| 2018-12-21 01:47:56,927 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] ERROR ClusterHdfsSource - Issues: {} | |
| 2018-12-21 01:47:57,041 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO Pipeline - Destroying pipeline with reason=UNUSED | |
| 2018-12-21 01:47:57,041 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ControlChannel - Producer complete | |
| 2018-12-21 01:47:57,043 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO Pipeline - Pipeline finished destroying with final reason=UNUSED | |
| 2018-12-21 01:47:57,089 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - stagingDir = '/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging' | |
| 2018-12-21 01:47:57,089 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - bootstrapDir = '/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs' | |
| 2018-12-21 01:47:57,089 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - etcDir = '/var/run/cloudera-scm-agent/process/109-streamsets-DATACOLLECTOR' | |
| 2018-12-21 01:47:57,089 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - resourcesDir = '/var/lib/sdc/resources' | |
| 2018-12-21 01:47:57,089 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - staticWebDir = '/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/sdc-static-web' | |
| 2018-12-21 01:48:37,336 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - Slave Java Opts : -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dlog4j.debug | |
| 2018-12-21 01:48:37,336 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - Submitting MapReduce Job | |
| 2018-12-21 01:48:37,339 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - Starting: SystemProcess: /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/_cluster-manager start jar /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/cluster/streamsets-datacollector-cluster-bootstrap-api-3.7.0.jar com.streamsets.pipeline.BootstrapClusterBatch -archives /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/libs.tar.gz,/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/etc.tar.gz,/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/resources.tar.gz -D mapreduce.job.log4j-properties-file=/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/log4j.properties -libjars /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.7.0.jar,/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/avro-mapred-1.7.7-hadoop2.jar,/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/avro-1.7.7.jar /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/etc/sdc.properties -Xmx2048m -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dlog4j.debug -javaagent:./streamsets-datacollector-bootstrap-3.7.0.jar | |
| 2018-12-21 01:48:37,339 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO SystemProcessImpl - Standard output for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.48.37-0000000001.out | |
| 2018-12-21 01:48:37,339 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO SystemProcessImpl - Standard error for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.48.37-0000000001.err | |
| 2018-12-21 01:48:37,342 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO SystemProcessImpl - Starting: [/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/_cluster-manager, start, jar, /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/cluster/streamsets-datacollector-cluster-bootstrap-api-3.7.0.jar, com.streamsets.pipeline.BootstrapClusterBatch, -archives, /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/libs.tar.gz,/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/etc.tar.gz,/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/resources.tar.gz, -D, mapreduce.job.log4j-properties-file=/tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/log4j.properties, -libjars, /opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.7.0.jar,/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/avro-mapred-1.7.7-hadoop2.jar,/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/avro-1.7.7.jar, /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/staging/etc/sdc.properties, -Xmx2048m -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dlog4j.debug -javaagent:./streamsets-datacollector-bootstrap-3.7.0.jar] | |
| 2018-12-21 01:48:41,470 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-38] INFO ShellClusterProvider - Found application id application_1545356107870_0004 | |
| 2018-12-21 01:48:41,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-11] INFO SystemProcessImpl - Standard output for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.48.41-0000000002.out | |
| 2018-12-21 01:48:41,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-11] INFO SystemProcessImpl - Standard error for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.48.41-0000000002.err | |
| 2018-12-21 01:48:41,563 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-11] INFO SystemProcessImpl - Starting: [/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/_cluster-manager, status, application_1545356107870_0004] | |
| 2018-12-21 01:49:11,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-21] INFO SystemProcessImpl - Standard output for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.49.11-0000000003.out | |
| 2018-12-21 01:49:11,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-21] INFO SystemProcessImpl - Standard error for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.49.11-0000000003.err | |
| 2018-12-21 01:49:11,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-21] INFO SystemProcessImpl - Starting: [/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/_cluster-manager, status, application_1545356107870_0004] | |
| 2018-12-21 01:49:14,247 [user:admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:49:14,256 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:runnerStop-pool-10-thread-15] INFO StandaloneRunner - Stopping pipeline Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6 0 | |
| 2018-12-21 01:49:14,268 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:runnerStop-pool-10-thread-16] INFO ProductionPipelineRunnable - Changing state of pipeline 'Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6', '0' to 'STOPPED' | |
| 2018-12-21 01:49:14,272 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:49:14,272 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO IpcServer - Shutting down, port '20000', TLS 'false' | |
| 2018-12-21 01:49:14,287 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO AbstractConnector - Stopped ServerConnector@35d9a75b{HTTP/1.1,[http/1.1]}{0.0.0.0:20000} | |
| 2018-12-21 01:49:14,290 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO ContextHandler - Stopped o.e.j.s.ServletContextHandler@6d8c076b{/,null,UNAVAILABLE} | |
| 2018-12-21 01:49:14,292 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:49:14,293 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6', '0' to 'STOPPED' | |
| 2018-12-21 01:49:14,294 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:runnerStop-pool-10-thread-15] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:49:14,295 [user:*admin] [pipeline:Snapshot pipeline/Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6] [runner:] [thread:ProductionPipelineRunnable-Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6-Snapshot pipeline] ERROR ProductionPipelineRunnable - An exception occurred while trying to transition pipeline state, com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0102 - Cannot change state from com.streamsets.datacollector.execution.runner.common.PipelineRunnerException: CONTAINER_0102 - Cannot change state from STOPPED to STOPPED to {} | |
| com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0102 - Cannot change state from com.streamsets.datacollector.execution.runner.common.PipelineRunnerException: CONTAINER_0102 - Cannot change state from STOPPED to STOPPED to {} | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.stateChanged(StandaloneRunner.java:603) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.postStop(ProductionPipelineRunnable.java:163) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:92) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.startAndCaptureSnapshot(StandaloneRunner.java:940) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$startAndCaptureSnapshot$4(AsyncRunner.java:170) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| Caused by: com.streamsets.datacollector.execution.runner.common.PipelineRunnerException: CONTAINER_0102 - Cannot change state from STOPPED to STOPPED | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.checkState(StandaloneRunner.java:669) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.validateAndSetStateTransition(StandaloneRunner.java:613) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.stateChanged(StandaloneRunner.java:601) | |
| ... 17 more | |
| 2018-12-21 01:49:24,529 [user:admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:webserver-15] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:49:24,529 [user:admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:webserver-15] INFO StandaloneRunner - Preparing to start pipeline 'ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf::0' | |
| 2018-12-21 01:49:24,534 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:runner-pool-2-thread-49] INFO StandaloneRunner - Starting pipeline ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf 0 | |
| 2018-12-21 01:49:24,575 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:runner-pool-2-thread-49] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:49:24,659 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:49:24,660 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO HdfsBaseConfigBean - Authentication Config: {} | |
| 2018-12-21 01:49:24,675 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO HdfsTargetConfigBean - Creating dummy directory to validate permissions /tmp/out/_sdc-dummy-9d4e7abf-6afe-4c4f-8b73-b84950f85339 | |
| 2018-12-21 01:49:24,680 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO RecordWriterManager - Created the following glob path for file recovery: /tmp/out/mACdGkFJoH/_tmp_sdc-84bbc1c2-04c0-11e9-a95a-4d985cae95d4* | |
| 2018-12-21 01:49:24,709 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:49:27,354 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO deprecation - mapreduce.task.classpath.user.precedence is deprecated. Instead, use mapreduce.job.user.classpath.first | |
| 2018-12-21 01:49:27,357 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcRecordConverter | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcSchemaConverter | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-commonlib-3.7.0.jar for class com.streamsets.pipeline.lib.util.AvroTypeUtil | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-log4j12-1.7.7.jar for class org.slf4j.impl.Log4jLoggerAdapter | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-api-1.7.7.jar for class org.slf4j.Logger | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/aircompressor-0.8.jar for class io.airlift.compress.Decompressor | |
| 2018-12-21 01:49:27,358 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/streamsets-datacollector-api-3.7.0.jar for class com.streamsets.pipeline.api.ErrorCode | |
| 2018-12-21 01:49:27,424 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO RMProxy - Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:49:27,553 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] WARN JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
| 2018-12-21 01:49:27,832 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO JobSubmitter - number of splits:1 | |
| 2018-12-21 01:49:27,868 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO JobSubmitter - Submitting tokens for job: job_1545356107870_0005 | |
| 2018-12-21 01:49:28,064 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO YarnClientImpl - Submitted application application_1545356107870_0005 | |
| 2018-12-21 01:49:28,088 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO Job - The url to track the job: http://node-1.cluster:8088/proxy/application_1545356107870_0005/ | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcRecordConverter | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcSchemaConverter | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-commonlib-3.7.0.jar for class com.streamsets.pipeline.lib.util.AvroTypeUtil | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-log4j12-1.7.7.jar for class org.slf4j.impl.Log4jLoggerAdapter | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-api-1.7.7.jar for class org.slf4j.Logger | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/aircompressor-0.8.jar for class io.airlift.compress.Decompressor | |
| 2018-12-21 01:49:30,719 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/streamsets-datacollector-api-3.7.0.jar for class com.streamsets.pipeline.api.ErrorCode | |
| 2018-12-21 01:49:30,735 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO RMProxy - Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:49:30,749 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] WARN JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
| 2018-12-21 01:49:33,521 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO JobSubmitter - number of splits:1 | |
| 2018-12-21 01:49:33,562 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO JobSubmitter - Submitting tokens for job: job_1545356107870_0006 | |
| 2018-12-21 01:49:33,619 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO YarnClientImpl - Submitted application application_1545356107870_0006 | |
| 2018-12-21 01:49:33,621 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:RandomDataGenerator-0::ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] INFO Job - The url to track the job: http://node-1.cluster:8088/proxy/application_1545356107870_0006/ | |
| 2018-12-21 01:49:34,802 [user:admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:webserver-15] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:49:34,811 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:runnerStop-pool-10-thread-17] INFO StandaloneRunner - Stopping pipeline ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf 0 | |
| 2018-12-21 01:49:34,821 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO RandomDataGeneratorSource - Shutting down executor service | |
| 2018-12-21 01:49:34,822 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:49:34,822 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO HdfsTargetConfigBean - Destroy | |
| 2018-12-21 01:49:34,841 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcRecordConverter | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-mapreduce-protolib-3.7.0.jar for class com.streamsets.pipeline.lib.util.avroorc.AvroToOrcSchemaConverter | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/streamsets-datacollector-commonlib-3.7.0.jar for class com.streamsets.pipeline.lib.util.AvroTypeUtil | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-log4j12-1.7.7.jar for class org.slf4j.impl.Log4jLoggerAdapter | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/slf4j-api-1.7.7.jar for class org.slf4j.Logger | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/streamsets-libs/streamsets-datacollector-cdh_5_12-lib/lib/aircompressor-0.8.jar for class io.airlift.compress.Decompressor | |
| 2018-12-21 01:49:34,842 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO MapreduceUtils - Adding jar file:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/api-lib/streamsets-datacollector-api-3.7.0.jar for class com.streamsets.pipeline.api.ErrorCode | |
| 2018-12-21 01:49:34,874 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO RMProxy - Connecting to ResourceManager at node-1.cluster/172.18.0.2:8032 | |
| 2018-12-21 01:49:34,881 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] WARN JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
| 2018-12-21 01:49:38,895 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO JobSubmitter - number of splits:1 | |
| 2018-12-21 01:49:39,324 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO JobSubmitter - Submitting tokens for job: job_1545356107870_0007 | |
| 2018-12-21 01:49:39,587 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO YarnClientImpl - Submitted application application_1545356107870_0007 | |
| 2018-12-21 01:49:39,595 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:0] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO Job - The url to track the job: http://node-1.cluster:8088/proxy/application_1545356107870_0007/ | |
| 2018-12-21 01:49:39,599 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:49:39,609 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:ProductionPipelineRunnable-ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf-ORC MapReduce executor pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf', '0' to 'STOPPED' | |
| 2018-12-21 01:49:39,628 [user:*admin] [pipeline:ORC MapReduce executor pipeline/ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf] [runner:] [thread:runnerStop-pool-10-thread-17] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:49:41,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-26] INFO SystemProcessImpl - Standard output for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.49.41-0000000004.out | |
| 2018-12-21 01:49:41,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-26] INFO SystemProcessImpl - Standard error for process written to file: /tmp/1545356876759-0/cluster-pipeline-HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755-0/BaseClusterProvider-2018-12-21_01.49.41-0000000004.err | |
| 2018-12-21 01:49:41,562 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-26] INFO SystemProcessImpl - Starting: [/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/_cluster-manager, status, application_1545356107870_0004] | |
| 2018-12-21 01:49:43,076 [user:*admin] [pipeline:Hadoop FS pipeline/HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755] [runner:] [thread:runner-pool-2-thread-26] INFO ClusterRunner - Cleaning up application | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HadoopFSDestinationfc558dcd-6665-46a7-88ab-6d986a694b5b::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Snapshotpipeline8a82e715-9720-457e-ab7b-f0eddc165cb6::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipeline75ec2a55-951f-4e27-b355-396bf6bd362e::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipeline37a122d5-d335-4303-b880-ffba84a055f4::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HadoopFSDestinationTimeBasisf030ca00-69ee-4871-af0a-7dffe3399a98::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipelineabd38ed5-eaef-43ce-a8a1-eb5003f3e7ed::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipelinef8f364cd-d23e-4db7-93aa-77eec62d7e03::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HadoopFSpipeline96471052-0f17-43a1-ad7e-dd8caa275755::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HadoopFSDestinationUser7b38d876-a021-4363-a962-2faa1cbe5141::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Hivequeryexecutorpipelinef8aac187-9e4e-40d5-8d53-b46dff2efcd7::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HiveQueryExecutorTestdecda026-bfbd-41ac-92cb-b4d415a609dd::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipeline79cebdef-162d-419c-b0ed-8b3ca2f6aaa4::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestColdStartcf249b06-da4b-4ca7-9b41-7f24f900e0ed::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestEventsTest199a166f-b480-4657-8d8e-c867643f2606::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'MapReduceexecutorpipelinec7720ebb-9498-4627-9abb-31aaf55e9734::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipeline545cae58-b389-44d3-abee-9191272ac572::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Pipeline78b18b93-93b9-45b9-afd8-c17d78a72203::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'ORCMapReduceexecutorpipelinef7c9f3df-2c14-440d-8346-ef55d589d4bf::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HadoopFSimpersonationpipelineddefc9b0-c644-4c2d-b8a8-9a6cf9f46449::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HivedrifttestMultipleopenpartitions4b9c17f9-6d2e-4bb5-8803-fb44820c4b0d::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'Sparkexecutorpipeline20fd5e15-048c-492d-99d0-be6392c4a45a::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'HiveQueryExecutorTest93471d6d-3aee-4a98-ba38-1337d56a263e::'0' | |
| 2018-12-21 01:49:53,107 [user:*?] [pipeline:-] [runner:] [thread:managerExecutor-pool-3-thread-2] INFO StandaloneAndClusterPipelineManager - Removing runner for pipeline 'ToFilepipeline8001cb22-ef76-4274-8da5-1741ce78a382::'0' | |
| 2018-12-21 01:50:12,754 [user:admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:12,754 [user:admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline820ac500-15ab-4d93-ae34-984cbc15a886::0' | |
| 2018-12-21 01:50:12,757 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:runner-pool-2-thread-17] INFO StandaloneRunner - Starting pipeline Pipeline820ac500-15ab-4d93-ae34-984cbc15a886 0 | |
| 2018-12-21 01:50:12,777 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:runner-pool-2-thread-17] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:12,806 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO HBaseFactory - Found FactoriesBean loader com.streamsets.pipeline.hbase.impl.HBaseProvider0_98 | |
| 2018-12-21 01:50:12,832 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:12,832 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:12,959 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x3d4f287f connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:zookeeper.version=3.4.5-cdh5.12.2--1, built on 11/23/2017 18:38 GMT | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:host.name=node-1.cluster | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.version=1.8.0_131 | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.vendor=Oracle Corporation | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.home=/usr/java/jdk1.8.0_131/jre | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.class.path=/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.7.0.jar:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/root-lib/snappy-java-1.0.5.jar:/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.7.0.jar | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.io.tmpdir=/tmp | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:java.compiler=<NA> | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:os.name=Linux | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:os.arch=amd64 | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:os.version=4.4.0-64-generic | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:user.name=sdc | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:user.home=/var/lib/sdc | |
| 2018-12-21 01:50:12,964 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Client environment:user.dir=/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.7.0 | |
| 2018-12-21 01:50:12,965 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x3d4f287f0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:12,981 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:12,982 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50512, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:12,988 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0053, negotiated timeout = 60000 | |
| 2018-12-21 01:50:13,168 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:13,168 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0053 | |
| 2018-12-21 01:50:13,169 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0053 closed | |
| 2018-12-21 01:50:13,169 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:13,182 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x3fb7c34c connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:13,182 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x3fb7c34c0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:13,183 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:13,183 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50516, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:13,185 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0054, negotiated timeout = 60000 | |
| 2018-12-21 01:50:13,355 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO deprecation - hadoop.native.lib is deprecated. Instead, use io.native.lib.available | |
| 2018-12-21 01:50:13,407 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:13,407 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0054 | |
| 2018-12-21 01:50:13,408 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0054 closed | |
| 2018-12-21 01:50:13,408 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:13,412 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x51533619 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:13,412 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x515336190x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:13,413 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:13,414 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50522, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:13,415 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0055, negotiated timeout = 60000 | |
| 2018-12-21 01:50:13,777 [user:admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:50:13,781 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:runnerStop-pool-10-thread-18] INFO StandaloneRunner - Stopping pipeline Pipeline820ac500-15ab-4d93-ae34-984cbc15a886 0 | |
| 2018-12-21 01:50:13,784 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:50:13,785 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0055 | |
| 2018-12-21 01:50:13,786 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0055 closed | |
| 2018-12-21 01:50:13,786 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:0] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:13,796 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:50:13,797 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:ProductionPipelineRunnable-Pipeline820ac500-15ab-4d93-ae34-984cbc15a886-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline820ac500-15ab-4d93-ae34-984cbc15a886', '0' to 'STOPPED' | |
| 2018-12-21 01:50:13,808 [user:*admin] [pipeline:Pipeline/Pipeline820ac500-15ab-4d93-ae34-984cbc15a886] [runner:] [thread:runnerStop-pool-10-thread-18] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:50:20,268 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:20,268 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:20,291 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO RecoverableZooKeeper - Process identifier=hconnection-0x48a7bc9e connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:20,292 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x48a7bc9e0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:20,296 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:20,297 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50634, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:20,301 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0056, negotiated timeout = 60000 | |
| 2018-12-21 01:50:20,321 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:20,322 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0056 | |
| 2018-12-21 01:50:20,323 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Session: 0x167ce66013e0056 closed | |
| 2018-12-21 01:50:20,323 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:20,334 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO RecoverableZooKeeper - Process identifier=hconnection-0x34b16e8d connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:20,334 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x34b16e8d0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:20,336 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:20,337 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50638, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:20,338 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0057, negotiated timeout = 60000 | |
| 2018-12-21 01:50:20,386 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:20,386 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0057 | |
| 2018-12-21 01:50:20,387 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Session: 0x167ce66013e0057 closed | |
| 2018-12-21 01:50:20,387 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:20,399 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO RecoverableZooKeeper - Process identifier=hconnection-0x1f41eb7f connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:20,399 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x1f41eb7f0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:20,400 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:20,401 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50644, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:20,403 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0058, negotiated timeout = 60000 | |
| 2018-12-21 01:50:20,407 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:] [thread:preview-pool-1-thread-1] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:50:20,408 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0058 | |
| 2018-12-21 01:50:20,410 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1] INFO ZooKeeper - Session: 0x167ce66013e0058 closed | |
| 2018-12-21 01:50:20,412 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:] [thread:preview-pool-1-thread-1] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:50:20,413 [user:*admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:0] [thread:preview-pool-1-thread-1-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:21,194 [user:admin] [pipeline:Pipeline/Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922] [runner:] [thread:webserver-16] WARN StandaloneAndClusterPipelineManager - Evicting idle previewer 'Pipeline62d15a73-8f35-41be-87d1-9a0ac250e922::0'::'f8dc8bbd-ca74-4c51-a06b-33b66fb86178' in status 'FINISHED' | |
| 2018-12-21 01:50:27,732 [user:admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:27,732 [user:admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline36ac3edc-e914-41a9-b551-b786de37b509::0' | |
| 2018-12-21 01:50:27,735 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:runner-pool-2-thread-5] INFO StandaloneRunner - Starting pipeline Pipeline36ac3edc-e914-41a9-b551-b786de37b509 0 | |
| 2018-12-21 01:50:27,755 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:runner-pool-2-thread-5] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:27,793 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:0] [thread:ProductionPipelineRunnable-Pipeline36ac3edc-e914-41a9-b551-b786de37b509-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:27,793 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:0] [thread:ProductionPipelineRunnable-Pipeline36ac3edc-e914-41a9-b551-b786de37b509-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:27,798 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:ProductionPipelineRunnable-Pipeline36ac3edc-e914-41a9-b551-b786de37b509-Pipeline] INFO Pipeline - Destroying pipeline with reason=FINISHED | |
| 2018-12-21 01:50:27,798 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:ProductionPipelineRunnable-Pipeline36ac3edc-e914-41a9-b551-b786de37b509-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=FINISHED | |
| 2018-12-21 01:50:27,813 [user:*admin] [pipeline:Pipeline/Pipeline36ac3edc-e914-41a9-b551-b786de37b509] [runner:] [thread:ProductionPipelineRunnable-Pipeline36ac3edc-e914-41a9-b551-b786de37b509-Pipeline] ERROR ProductionPipelineRunnable - An exception occurred while running the pipeline, com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'Pipeline36ac3edc-e914-41a9-b551-b786de37b509' validation error : HBASE_13 - Zookeeper client port is invalid: {} | |
| com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'Pipeline36ac3edc-e914-41a9-b551-b786de37b509' validation error : HBASE_13 - Zookeeper client port is invalid: {} | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:128) | |
| at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:75) | |
| at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:724) | |
| at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:151) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226) | |
| at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) | |
| at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:266) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) | |
| at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) | |
| at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:748) | |
| 2018-12-21 01:50:34,028 [user:admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:webserver-22] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:34,028 [user:admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b::0' | |
| 2018-12-21 01:50:34,033 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:runner-pool-2-thread-43] INFO StandaloneRunner - Starting pipeline Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b 0 | |
| 2018-12-21 01:50:34,057 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:runner-pool-2-thread-43] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:34,095 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:34,095 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:34,108 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x37c229b connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:34,108 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x37c229b0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:34,110 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:34,110 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50756, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:34,112 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e005b, negotiated timeout = 60000 | |
| 2018-12-21 01:50:34,119 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:34,119 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e005b | |
| 2018-12-21 01:50:34,120 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e005b closed | |
| 2018-12-21 01:50:34,120 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:34,131 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x1073e0f9 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:34,131 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x1073e0f90x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:34,132 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:34,135 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50760, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:34,137 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e005c, negotiated timeout = 60000 | |
| 2018-12-21 01:50:34,166 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:34,166 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e005c | |
| 2018-12-21 01:50:34,167 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e005c closed | |
| 2018-12-21 01:50:34,167 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:34,178 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x1573e4ab connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:34,178 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x1573e4ab0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:34,180 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:34,180 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50766, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:34,182 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e005d, negotiated timeout = 60000 | |
| 2018-12-21 01:50:35,043 [user:admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:webserver-22] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:50:35,046 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:runnerStop-pool-10-thread-19] INFO StandaloneRunner - Stopping pipeline Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b 0 | |
| 2018-12-21 01:50:35,049 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:50:35,050 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e005d | |
| 2018-12-21 01:50:35,051 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e005d closed | |
| 2018-12-21 01:50:35,051 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:0] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:35,061 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:50:35,062 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:ProductionPipelineRunnable-Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b', '0' to 'STOPPED' | |
| 2018-12-21 01:50:35,076 [user:*admin] [pipeline:Pipeline/Pipeline1c4f77d8-b924-497e-91b9-e778d52cd49b] [runner:] [thread:runnerStop-pool-10-thread-19] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:50:41,318 [user:admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:webserver-16] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:41,318 [user:admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline6b56a965-ac70-4152-b4ac-c91de2563063::0' | |
| 2018-12-21 01:50:41,322 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:runner-pool-2-thread-2] INFO StandaloneRunner - Starting pipeline Pipeline6b56a965-ac70-4152-b4ac-c91de2563063 0 | |
| 2018-12-21 01:50:41,347 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:runner-pool-2-thread-2] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:41,385 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:41,386 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:41,399 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x1d3efcd2 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:41,399 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x1d3efcd20x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:41,400 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:41,401 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50826, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:41,402 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0060, negotiated timeout = 60000 | |
| 2018-12-21 01:50:41,407 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:41,407 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0060 | |
| 2018-12-21 01:50:41,408 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0060 closed | |
| 2018-12-21 01:50:41,409 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:41,419 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x9f8cbf3 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:41,419 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x9f8cbf30x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:41,420 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:41,421 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50830, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:41,422 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0061, negotiated timeout = 60000 | |
| 2018-12-21 01:50:41,445 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:41,445 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0061 | |
| 2018-12-21 01:50:41,446 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0061 closed | |
| 2018-12-21 01:50:41,446 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:41,457 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x6ddbfd1a connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:41,457 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x6ddbfd1a0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:41,460 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:41,461 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50836, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:41,462 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0062, negotiated timeout = 60000 | |
| 2018-12-21 01:50:42,331 [user:admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:50:42,335 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:runnerStop-pool-10-thread-20] INFO StandaloneRunner - Stopping pipeline Pipeline6b56a965-ac70-4152-b4ac-c91de2563063 0 | |
| 2018-12-21 01:50:42,335 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:50:42,336 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0062 | |
| 2018-12-21 01:50:42,337 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0062 closed | |
| 2018-12-21 01:50:42,337 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:0] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:42,348 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:50:42,348 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:ProductionPipelineRunnable-Pipeline6b56a965-ac70-4152-b4ac-c91de2563063-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline6b56a965-ac70-4152-b4ac-c91de2563063', '0' to 'STOPPED' | |
| 2018-12-21 01:50:42,362 [user:*admin] [pipeline:Pipeline/Pipeline6b56a965-ac70-4152-b4ac-c91de2563063] [runner:] [thread:runnerStop-pool-10-thread-20] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:50:48,847 [user:admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:webserver-979] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:48,847 [user:admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:webserver-979] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e::0' | |
| 2018-12-21 01:50:48,852 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:runner-pool-2-thread-49] INFO StandaloneRunner - Starting pipeline Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e 0 | |
| 2018-12-21 01:50:48,883 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:runner-pool-2-thread-49] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:48,936 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:48,936 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:48,956 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x275bb0be connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:48,956 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x275bb0be0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:48,968 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:48,968 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50900, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:48,970 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0063, negotiated timeout = 60000 | |
| 2018-12-21 01:50:48,975 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:48,975 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0063 | |
| 2018-12-21 01:50:48,976 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0063 closed | |
| 2018-12-21 01:50:48,976 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:48,987 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x63f7175d connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:48,987 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x63f7175d0x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:48,988 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:48,989 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50904, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:48,990 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0064, negotiated timeout = 60000 | |
| 2018-12-21 01:50:49,014 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing master protocol: MasterService | |
| 2018-12-21 01:50:49,014 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0064 | |
| 2018-12-21 01:50:49,016 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0064 closed | |
| 2018-12-21 01:50:49,016 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:49,026 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x13924295 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:49,026 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x139242950x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:49,028 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:49,028 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Socket connection established, initiating session, client: /172.18.0.2:50910, server: node-1.cluster/172.18.0.2:2181 | |
| 2018-12-21 01:50:49,029 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Session establishment complete on server node-1.cluster/172.18.0.2:2181, sessionid = 0x167ce66013e0065, negotiated timeout = 60000 | |
| 2018-12-21 01:50:49,861 [user:admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:webserver-16] INFO StandaloneRunner - Preparing to stop pipeline | |
| 2018-12-21 01:50:49,864 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:runnerStop-pool-10-thread-21] INFO StandaloneRunner - Stopping pipeline Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e 0 | |
| 2018-12-21 01:50:49,866 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO Pipeline - Destroying pipeline with reason=USER_ACTION | |
| 2018-12-21 01:50:49,866 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x167ce66013e0065 | |
| 2018-12-21 01:50:49,867 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline-EventThread] INFO ClientCnxn - EventThread shut down | |
| 2018-12-21 01:50:49,867 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:0] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ZooKeeper - Session: 0x167ce66013e0065 closed | |
| 2018-12-21 01:50:49,878 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO Pipeline - Pipeline finished destroying with final reason=USER_ACTION | |
| 2018-12-21 01:50:49,878 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:ProductionPipelineRunnable-Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e-Pipeline] INFO ProductionPipelineRunnable - Changing state of pipeline 'Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e', '0' to 'STOPPED' | |
| 2018-12-21 01:50:49,893 [user:*admin] [pipeline:Pipeline/Pipeline945282d0-cf17-4dcd-9c9e-e3fab694797e] [runner:] [thread:runnerStop-pool-10-thread-21] INFO ProductionPipelineRunnable - Pipeline is in terminal state | |
| 2018-12-21 01:50:57,083 [user:admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:] [thread:webserver-979] INFO StandaloneAndClusterRunnerProviderImpl - Pipeline execution mode is: STANDALONE | |
| 2018-12-21 01:50:57,083 [user:admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:] [thread:webserver-979] INFO StandaloneRunner - Preparing to start pipeline 'Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46::0' | |
| 2018-12-21 01:50:57,087 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:] [thread:runner-pool-2-thread-15] INFO StandaloneRunner - Starting pipeline Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46 0 | |
| 2018-12-21 01:50:57,108 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:] [thread:runner-pool-2-thread-15] INFO ProductionPipelineRunner - Adding error listeners0 | |
| 2018-12-21 01:50:57,144 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline] INFO UserGroupInformation - Config hadoop.treat.subject.external is set to true, the owner of the subject passed to UserGroupInformation(Subject) is supposed to renew the credential. | |
| 2018-12-21 01:50:57,145 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline] INFO AbstractHBaseConnectionHelper - Authentication Config: Using Simple | |
| 2018-12-21 01:50:57,158 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline] INFO RecoverableZooKeeper - Process identifier=hconnection-0x7dd92244 connecting to ZooKeeper ensemble=node-1.cluster:2181 | |
| 2018-12-21 01:50:57,158 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline] INFO ZooKeeper - Initiating client connection, connectString=node-1.cluster:2181 sessionTimeout=90000 watcher=hconnection-0x7dd922440x0, quorum=node-1.cluster:2181, baseZNode=/hbase | |
| 2018-12-21 01:50:57,160 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline-SendThread(node-1.cluster:2181)] INFO ClientCnxn - Opening socket connection to server node-1.cluster/172.18.0.2:2181. Will not attempt to authenticate using SASL (unknown error) | |
| 2018-12-21 01:50:57,161 [user:*admin] [pipeline:Pipeline/Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46] [runner:0] [thread:ProductionPipelineRunnable-Pipeline911e5f72-0a7c-4ae7-9104-bde6aed63b46-Pipeline-SendThread(node-1. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment