Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
2017-05-19T12:39:42,465 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-05-19T12:39:42,468 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-05-19T12:39:42,498 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-05-19T12:39:42,905 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[]}]
2017-05-19T12:39:43,940 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-05-19T12:39:44,024 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@7d755813]
2017-05-19T12:39:44,037 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-05-19T12:39:44,071 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middleManager', host='Ubuntu-1604-xenial-64-minimal', port=8100}]
2017-05-19T12:39:44,937 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-05-19T12:39:44,937 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-05-19T12:39:44,949 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[]}]
2017-05-19T12:39:44,952 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@56d93692]
2017-05-19T12:39:44,953 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@5c10285a]
2017-05-19T12:39:44,953 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@61e3cf4d]
2017-05-19T12:39:44,964 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@c6634d]
2017-05-19T12:39:44,964 INFO [main] io.druid.cli.CliPeon - Starting up with processors[8], memory[325,058,560].
2017-05-19T12:39:44,965 INFO [main] io.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2017-05-19T12:39:44,965 INFO [main] io.druid.cli.CliPeon - * druid.emitter: logging
2017-05-19T12:39:44,965 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2017-05-19T12:39:44,965 INFO [main] io.druid.cli.CliPeon - * druid.extensions.loadList: []
2017-05-19T12:39:44,965 INFO [main] io.druid.cli.CliPeon - * druid.host: Ubuntu-1604-xenial-64-minimal
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.directory: var/druid/indexing-logs
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.type: file
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.javaOpts: -server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: var/druid/task
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: var/druid/hadoop-tmp
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:derby://localhost:1527/var/druid/metadata.db;create=true
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.host: localhost
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.port: 1527
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.type: derby
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: datashort
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_hadoop_datashort_2017-05-19T12:39:40.477Z
2017-05-19T12:39:44,966 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.port: 8100
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 256000000
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.processing.numThreads: 2
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.server.http.numThreads: 9
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.service: druid/middleManager
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.storage.storageDirectory: var/druid/segments
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.storage.type: local
2017-05-19T12:39:44,967 INFO [main] io.druid.cli.CliPeon - * druid.worker.capacity: 3
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.host: localhost
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * file.encoding: UTF-8
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * file.separator: /
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.class.path: conf-quickstart/druid/_common:conf-quickstart/druid/middleManager:lib/druid-console-0.0.2.jar:lib/antlr4-runtime-4.5.1.jar:lib/aether-util-0.9.0.M2.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/plexus-interpolation-1.19.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/jackson-annotations-2.4.6.jar:lib/maven-settings-3.1.1.jar:lib/jetty-servlets-9.3.16.v20170120.jar:lib/jackson-core-2.4.6.jar:lib/javax.el-3.0.0.jar:lib/lz4-1.3.0.jar:lib/jsr311-api-1.1.1.jar:lib/opencsv-2.3.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/jetty-client-9.3.16.v20170120.jar:lib/jsr305-2.0.1.jar:lib/icu4j-4.8.1.jar:lib/commons-compiler-2.7.6.jar:lib/okhttp-1.0.2.jar:lib/guice-multibindings-4.1.0.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/guice-servlet-4.1.0.jar:lib/extendedset-0.10.0.jar:lib/jetty-continuation-9.3.16.v20170120.jar:lib/validation-api-1.1.0.Final.jar:lib/calcite-linq4j-1.11.0.jar:lib/jackson-databind-2.4.6.jar:lib/commons-dbcp2-2.0.1.jar:lib/druid-server-0.10.0.jar:lib/plexus-utils-3.0.15.jar:lib/jetty-io-9.3.16.v20170120.jar:lib/netty-3.10.4.Final.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/base64-2.3.8.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/httpclient-4.5.1.jar:lib/RoaringBitmap-0.5.18.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/jetty-servlet-9.3.16.v20170120.jar:lib/druid-indexing-service-0.10.0.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/aws-java-sdk-1.10.21.jar:lib/disruptor-3.3.0.jar:lib/commons-math3-3.6.1.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/wagon-provider-api-2.4.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/fastutil-7.0.13.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/joda-time-2.8.2.jar:lib/log4j-1.2-api-2.5.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/commons-logging-1.1.1.jar:lib/aether-spi-0.9.0.M2.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/geoip2-0.4.0.jar:lib/druid-processing-0.10.0.jar:lib/netty-all-4.1.6.Final.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/config-magic-0.9.jar:lib/jetty-proxy-9.3.16.v20170120.jar:lib/airline-0.7.jar:lib/commons-cli-1.2.jar:lib/log4j-core-2.5.jar:lib/curator-x-discovery-2.11.0.jar:lib/derby-10.11.1.1.jar:lib/maven-model-builder-3.1.1.jar:lib/maven-model-3.1.1.jar:lib/httpcore-4.4.3.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/janino-2.7.6.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/bytebuffer-collections-0.10.0.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/http-client-1.0.6.jar:lib/avatica-core-1.9.0.jar:lib/aether-api-0.9.0.M2.jar:lib/protobuf-java-3.1.0.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/mapdb-1.0.8.jar:lib/maven-aether-provider-3.1.1.jar:lib/javax.inject-1.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/jersey-core-1.19.jar:lib/commons-dbcp-1.4.jar:lib/aopalliance-1.0.jar:lib/jets3t-0.9.4.jar:lib/jetty-http-9.3.16.v20170120.jar:lib/jersey-server-1.19.jar:lib/maven-settings-builder-3.1.1.jar:lib/jetty-util-9.3.16.v20170120.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/jline-0.9.94.jar:lib/commons-lang3-3.2.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/jboss-logging-3.1.3.GA.jar:lib/derbynet-10.11.1.1.jar:lib/slf4j-api-1.6.4.jar:lib/guava-16.0.1.jar:lib/spymemcached-2.11.7.jar:lib/aether-impl-0.9.0.M2.jar:lib/log4j-slf4j-impl-2.5.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/activation-1.1.1.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/curator-client-2.11.0.jar:lib/calcite-core-1.11.0.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/emitter-0.4.1.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/zookeeper-3.4.9.jar:lib/jdbi-2.63.1.jar:lib/compress-lzf-1.0.3.jar:lib/jersey-servlet-1.19.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/druid-indexing-hadoop-0.10.0.jar:lib/druid-api-0.10.0.jar:lib/aggdesigner-algorithm-6.0.jar:lib/guice-4.1.0.jar:lib/druid-common-0.10.0.jar:lib/rhino-1.7R5.jar:lib/druid-hll-0.10.0.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/druid-sql-0.10.0.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/druid-aws-common-0.10.0.jar:lib/log4j-jul-2.5.jar:lib/java-util-0.10.0.jar:lib/commons-codec-1.7.jar:lib/avatica-server-1.9.0.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/java-util-0.27.4.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/druid-services-0.10.0.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/commons-lang-2.6.jar:lib/log4j-api-2.5.jar:lib/javax.el-api-3.0.0.jar:lib/javax.servlet-api-3.1.0.jar:lib/irc-api-1.0-0014.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-security-9.3.16.v20170120.jar:lib/jersey-guice-1.19.jar:lib/maven-repository-metadata-3.1.1.jar:lib/jetty-server-9.3.16.v20170120.jar:lib/classmate-1.0.0.jar:lib/commons-pool2-2.2.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/curator-framework-2.11.0.jar:lib/bcprov-jdk15on-1.52.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/commons-io-2.4.jar:lib/server-metrics-0.2.8.jar:lib/curator-recipes-2.11.0.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/jackson-core-asl-1.9.13.jar:lib/avatica-metrics-1.9.0.jar:lib/jackson-datatype-joda-2.4.6.jar
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.class.version: 52.0
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.endorsed.dirs: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.ext.dirs: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext
2017-05-19T12:39:44,968 INFO [main] io.druid.cli.CliPeon - * java.home: /usr/lib/jvm/java-8-openjdk-amd64/jre
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.io.tmpdir: var/tmp
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.runtime.name: OpenJDK Runtime Environment
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.runtime.version: 1.8.0_131-8u131-b11-0ubuntu1.16.04.2-b11
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.specification.version: 1.8
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.version: 1.8.0_131
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.vm.info: mixed mode
2017-05-19T12:39:44,969 INFO [main] io.druid.cli.CliPeon - * java.vm.name: OpenJDK 64-Bit Server VM
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * java.vm.version: 25.131-b11
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * line.separator:
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: io.druid.common.config.Log4jShutdown
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * os.arch: amd64
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * os.name: Linux
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * os.version: 4.8.0-45-generic
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * path.separator: :
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * sun.arch.data.model: 64
2017-05-19T12:39:44,970 INFO [main] io.druid.cli.CliPeon - * sun.boot.class.path: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.boot.library.path: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.cpu.endian: little
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.cpu.isalist:
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.java.command: io.druid.cli.Main internal peon var/druid/task/index_hadoop_datashort_2017-05-19T12:39:40.477Z/task.json var/druid/task/index_hadoop_datashort_2017-05-19T12:39:40.477Z/5475c336-484e-433b-8a2a-49c6a8bdafa9/status.json
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * sun.os.patch.level: unknown
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * user.country: US
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * user.dir: /root/druid-0.10.0
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * user.home: /root
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * user.language: en
2017-05-19T12:39:44,971 INFO [main] io.druid.cli.CliPeon - * user.name: root
2017-05-19T12:39:44,972 INFO [main] io.druid.cli.CliPeon - * user.timezone: UTC
2017-05-19T12:39:44,980 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@5b498842]
2017-05-19T12:39:44,985 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@2f04105]
2017-05-19T12:39:45,058 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@1fba386c]
2017-05-19T12:39:45,064 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@7fb33394]
2017-05-19T12:39:45,071 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@6009bea]
2017-05-19T12:39:45,078 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2017-05-19T12:39:45,106 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@10ef5fa0]
2017-05-19T12:39:45,324 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@a0db585]
2017-05-19T12:39:45,327 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@7eae3764]
2017-05-19T12:39:45,328 INFO [main] io.druid.segment.loading.LocalDataSegmentPusher - Configured local filesystem as deep storage
2017-05-19T12:39:45,335 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@5555ffcf]
2017-05-19T12:39:45,340 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@5ba26eb0]
2017-05-19T12:39:45,345 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2017-05-19T12:39:45,352 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@47ffe971]
2017-05-19T12:39:45,355 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@2133661d]
2017-05-19T12:39:45,359 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@7a04fea7]
2017-05-19T12:39:45,362 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-05-19T12:39:45,365 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-05-19T12:39:45,365 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-05-19T12:39:45,367 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-05-19T12:39:45,367 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-05-19T12:39:45,367 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-05-19T12:39:45,367 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-05-19T12:39:45,368 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-05-19T12:39:45,471 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@6e0c6a7a]
2017-05-19T12:39:45,475 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@712cfb63]
2017-05-19T12:39:45,481 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@118ffcfd]
2017-05-19T12:39:45,503 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[256,000,000]
2017-05-19T12:39:45,573 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[256,000,000]
2017-05-19T12:39:45,641 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[256,000,000]
2017-05-19T12:39:45,706 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[256,000,000]
2017-05-19T12:39:45,772 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [io.druid.query.select.SelectQueryConfig@1859e2a4]
2017-05-19T12:39:45,776 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@50fb33a]
2017-05-19T12:39:45,785 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@5ea4300e]
2017-05-19T12:39:45,796 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@31ddb930]
2017-05-19T12:39:45,805 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=9, maxIdleTime=PT5M}]
2017-05-19T12:39:45,808 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@1a22e0ef]
2017-05-19T12:39:45,811 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2017-05-19T12:39:45,823 INFO [main] org.eclipse.jetty.util.log - Logging initialized @4107ms
2017-05-19T12:39:46,018 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2017-05-19T12:39:46,024 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2017-05-19T12:39:46,027 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@3ac3f6f].
2017-05-19T12:39:46,028 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2017-05-19T12:39:46,029 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@48904d5a].
2017-05-19T12:39:46,029 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@12bbfc54].
2017-05-19T12:39:46,030 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@1491344a].
2017-05-19T12:39:46,035 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@2538bc06].
2017-05-19T12:39:46,035 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2017-05-19T12:39:46,035 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=Ubuntu-1604-xenial-64-minimal
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_131
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-openjdk-amd64/jre
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=conf-quickstart/druid/_common:conf-quickstart/druid/middleManager:lib/druid-console-0.0.2.jar:lib/antlr4-runtime-4.5.1.jar:lib/aether-util-0.9.0.M2.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/plexus-interpolation-1.19.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/jackson-annotations-2.4.6.jar:lib/maven-settings-3.1.1.jar:lib/jetty-servlets-9.3.16.v20170120.jar:lib/jackson-core-2.4.6.jar:lib/javax.el-3.0.0.jar:lib/lz4-1.3.0.jar:lib/jsr311-api-1.1.1.jar:lib/opencsv-2.3.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/jetty-client-9.3.16.v20170120.jar:lib/jsr305-2.0.1.jar:lib/icu4j-4.8.1.jar:lib/commons-compiler-2.7.6.jar:lib/okhttp-1.0.2.jar:lib/guice-multibindings-4.1.0.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/guice-servlet-4.1.0.jar:lib/extendedset-0.10.0.jar:lib/jetty-continuation-9.3.16.v20170120.jar:lib/validation-api-1.1.0.Final.jar:lib/calcite-linq4j-1.11.0.jar:lib/jackson-databind-2.4.6.jar:lib/commons-dbcp2-2.0.1.jar:lib/druid-server-0.10.0.jar:lib/plexus-utils-3.0.15.jar:lib/jetty-io-9.3.16.v20170120.jar:lib/netty-3.10.4.Final.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/base64-2.3.8.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/httpclient-4.5.1.jar:lib/RoaringBitmap-0.5.18.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/jetty-servlet-9.3.16.v20170120.jar:lib/druid-indexing-service-0.10.0.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/aws-java-sdk-1.10.21.jar:lib/disruptor-3.3.0.jar:lib/commons-math3-3.6.1.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/wagon-provider-api-2.4.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/fastutil-7.0.13.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/joda-time-2.8.2.jar:lib/log4j-1.2-api-2.5.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/commons-logging-1.1.1.jar:lib/aether-spi-0.9.0.M2.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/geoip2-0.4.0.jar:lib/druid-processing-0.10.0.jar:lib/netty-all-4.1.6.Final.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/config-magic-0.9.jar:lib/jetty-proxy-9.3.16.v20170120.jar:lib/airline-0.7.jar:lib/commons-cli-1.2.jar:lib/log4j-core-2.5.jar:lib/curator-x-discovery-2.11.0.jar:lib/derby-10.11.1.1.jar:lib/maven-model-builder-3.1.1.jar:lib/maven-model-3.1.1.jar:lib/httpcore-4.4.3.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/janino-2.7.6.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/bytebuffer-collections-0.10.0.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/http-client-1.0.6.jar:lib/avatica-core-1.9.0.jar:lib/aether-api-0.9.0.M2.jar:lib/protobuf-java-3.1.0.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/mapdb-1.0.8.jar:lib/maven-aether-provider-3.1.1.jar:lib/javax.inject-1.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/jersey-core-1.19.jar:lib/commons-dbcp-1.4.jar:lib/aopalliance-1.0.jar:lib/jets3t-0.9.4.jar:lib/jetty-http-9.3.16.v20170120.jar:lib/jersey-server-1.19.jar:lib/maven-settings-builder-3.1.1.jar:lib/jetty-util-9.3.16.v20170120.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/jline-0.9.94.jar:lib/commons-lang3-3.2.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/jboss-logging-3.1.3.GA.jar:lib/derbynet-10.11.1.1.jar:lib/slf4j-api-1.6.4.jar:lib/guava-16.0.1.jar:lib/spymemcached-2.11.7.jar:lib/aether-impl-0.9.0.M2.jar:lib/log4j-slf4j-impl-2.5.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/activation-1.1.1.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/curator-client-2.11.0.jar:lib/calcite-core-1.11.0.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/emitter-0.4.1.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/zookeeper-3.4.9.jar:lib/jdbi-2.63.1.jar:lib/compress-lzf-1.0.3.jar:lib/jersey-servlet-1.19.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/druid-indexing-hadoop-0.10.0.jar:lib/druid-api-0.10.0.jar:lib/aggdesigner-algorithm-6.0.jar:lib/guice-4.1.0.jar:lib/druid-common-0.10.0.jar:lib/rhino-1.7R5.jar:lib/druid-hll-0.10.0.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/druid-sql-0.10.0.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/druid-aws-common-0.10.0.jar:lib/log4j-jul-2.5.jar:lib/java-util-0.10.0.jar:lib/commons-codec-1.7.jar:lib/avatica-server-1.9.0.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/java-util-0.27.4.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/druid-services-0.10.0.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/commons-lang-2.6.jar:lib/log4j-api-2.5.jar:lib/javax.el-api-3.0.0.jar:lib/javax.servlet-api-3.1.0.jar:lib/irc-api-1.0-0014.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-security-9.3.16.v20170120.jar:lib/jersey-guice-1.19.jar:lib/maven-repository-metadata-3.1.1.jar:lib/jetty-server-9.3.16.v20170120.jar:lib/classmate-1.0.0.jar:lib/commons-pool2-2.2.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/curator-framework-2.11.0.jar:lib/bcprov-jdk15on-1.52.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/commons-io-2.4.jar:lib/server-metrics-0.2.8.jar:lib/curator-recipes-2.11.0.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/jackson-core-asl-1.9.13.jar:lib/avatica-metrics-1.9.0.jar:lib/jackson-datatype-joda-2.4.6.jar
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.8.0-45-generic
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2017-05-19T12:39:46,046 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/root/druid-0.10.0
2017-05-19T12:39:46,047 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@596a7f44
2017-05-19T12:39:46,060 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@7343922c].
2017-05-19T12:39:46,063 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2017-05-19T12:39:46,071 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
2017-05-19T12:39:46,097 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost.localdomain/127.0.0.1:2181, sessionid = 0x15c1cfa7f2c0011, negotiated timeout = 30000
2017-05-19T12:39:46,101 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2017-05-19T12:39:46,183 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@7af3874e].
2017-05-19T12:39:46,184 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@5a8816cc].
2017-05-19T12:39:46,190 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@4a8e6e89].
2017-05-19T12:39:46,841 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_datashort_2017-05-19T12:39:40.477Z",
"spec" : {
"dataSchema" : {
"dataSource" : "datashort",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "csv",
"timestampSpec" : {
"column" : "time",
"format" : "yyyy-M-d H:m:s"
},
"columns" : [ "id", "recvtime", "imei", "bus_id", "timestamp", "time", "longitude", "latitude", "speed", "mMU1Acc", "mMU2Acc", "mSTUAcc", "mNOxOutAcc", "nDBCVersion", "nNVRAMSt", "nRecState", "nSWType", "nSWVersion", "stMU1", "stMU2", "stSTU", "qnEngOutShoAvg", "qNH3ShoAvg", "rNOxConvShoAvg", "rNOxInShoAvg", "tSCRShoAvg", "rNOxOutShoAvg", "qNH3InUseAvg", "rNOxConvInUseAvg", "rNOxInInUseAvg", "rNOxOutInUseAvg", "pDPFFild", "pDPFMax", "stDPFErr", "stHtSafeMod", "stNH3Err", "stNOxOutErr", "stSysErrStatus", "stSysPause", "tSCRInUseAvg", "obdBckPressHigh", "obdCVDInLeak", "obdCVDLeak", "obdDPFErr", "obdInLeak", "obdInLeak2", "obdMUCTCErr", "obdMUFlsEmpt", "obdNOxOut", "obdNOxOutHigh", "obdPresHigh1", "obdPresHigh2", "obdSTUClogg", "obdVlvInStckCls", "obdVlvInStckOpn", "obdVlvOutStckCls", "obdVlvOutStckOpn", "obdCVDTempOOR", "obdEEC1Dflt", "obdHtVoltHigh", "obdHtVoltLow", "obdIC1Dflt", "obdLFEDflt", "obdMainRelayDis", "obdMU1HtCirc", "obdMU1TempOOR", "obdMU2HtCirc", "obdMU2TempOOR", "obdNOxInDflt", "obdNOxInEnaTo", "obdNOxOutDflt", "obdNOxOutEnaTo", "obdPresSensOOR", "obdSCRInTempOOR", "obdSCROutTempOOR", "obdSTUHtCirc", "obdMUTempPlaus", "obdSysVoltOOR", "obdCVDInClogg", "obdCVDInSens", "obdCVDOutClogg", "obdCVDOutLeak", "obdCVDOutSens", "obdNH3Conv", "obdVlvInStckOpn2", "obdVlvOutStckOpn2", "obdDPFWarn", "obdDPFAlrm", "80", "85", "86", "88", "127", "128", "135", "136", "138", "199" ],
"dimensionsSpec" : {
"dimensions" : [ "imei", "bus_id" ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "speed",
"fieldName" : "speed",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "id_unique",
"fieldName" : "id",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "MINUTE",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/top.csv"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2017-05-19T12:39:40.476Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 75000000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 500,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.map.memory.mb" : "3500",
"mapreduce.map.java.opts" : "-server -Xmx5536m -Duser.timezone=UTC -Dfile.encoding=UTF-8",
"mapreduce.reduce.memory.mb" : "5048",
"mapreduce.reduce.java.opts" : "-server -Xmx2560m -Duser.timezone=UTC -Dfile.encoding=UTF-8"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "5d76490fb6ed4b3d95e1e8c3da28eed0"
},
"hadoopDependencyCoordinates" : null,
"classpathPrefix" : null,
"context" : null,
"groupId" : "index_hadoop_datashort_2017-05-19T12:39:40.477Z",
"dataSource" : "datashort",
"resource" : {
"availabilityGroup" : "index_hadoop_datashort_2017-05-19T12:39:40.477Z",
"requiredCapacity" : 1
}
}
2017-05-19T12:39:46,845 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[var/druid/task/index_hadoop_datashort_2017-05-19T12:39:40.477Z/lock].
2017-05-19T12:39:46,846 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[var/druid/task/index_hadoop_datashort_2017-05-19T12:39:40.477Z/lock] in 1ms.
2017-05-19T12:39:47,364 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_datashort_2017-05-19T12:39:40.477Z]: LockTryAcquireAction{interval=2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z}
2017-05-19T12:39:47,373 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_datashort_2017-05-19T12:39:40.477Z] to overlord[http://Ubuntu-1604-xenial-64-minimal:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z}
2017-05-19T12:39:47,381 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,410 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,411 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,411 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,414 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,415 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,417 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,417 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,418 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,422 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,425 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,427 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,428 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,429 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,431 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,431 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,431 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,432 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,432 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:47,433 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://Ubuntu-1604-xenial-64-minimal:8090
2017-05-19T12:39:48,157 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_datashort_2017-05-19T12:39:40.477Z
2017-05-19T12:39:48,159 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_datashort_2017-05-19T12:39:40.477Z] location changed to [TaskLocation{host='Ubuntu-1604-xenial-64-minimal', port=8100}].
2017-05-19T12:39:48,159 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_datashort_2017-05-19T12:39:40.477Z] status changed to [RUNNING].
2017-05-19T12:39:48,164 INFO [main] org.eclipse.jetty.server.Server - jetty-9.3.16.v20170120
2017-05-19T12:39:48,645 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-configuration-1.6.jar]
2017-05-19T12:39:48,645 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2017-05-19T12:39:48,645 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-math3-3.1.1.jar]
2017-05-19T12:39:48,645 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/xz-1.0.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-common-2.3.0.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jackson-core-asl-1.8.8.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-codec-1.4.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-core-1.8.0.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/stax-api-1.0-2.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-logging-1.1.3.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-compress-1.4.1.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2017-05-19T12:39:48,646 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-common-2.3.0.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/slf4j-api-1.7.5.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/protobuf-java-2.5.0.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/snappy-java-1.0.4.1.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/activation-1.1.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-httpclient-3.1.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-hdfs-2.3.0.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-cli-1.2.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jaxb-api-2.2.2.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-api-2.3.0.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-collections-3.2.1.jar]
2017-05-19T12:39:48,647 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-net-3.1.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/httpclient-4.2.5.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-annotations-2.3.0.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/avro-1.7.4.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jsr305-1.3.9.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/xmlenc-0.52.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/guava-11.0.2.jar]
2017-05-19T12:39:48,648 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jetty-util-6.1.26.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-digester-1.8.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/paranamer-2.3.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/servlet-api-2.5.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-1.7.0.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-lang-2.6.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/zookeeper-3.4.5.jar]
2017-05-19T12:39:48,649 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/log4j-1.2.17.jar]
2017-05-19T12:39:48,650 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/httpcore-4.2.5.jar]
2017-05-19T12:39:48,650 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jersey-core-1.9.jar]
2017-05-19T12:39:48,650 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/hadoop-auth-2.3.0.jar]
2017-05-19T12:39:48,650 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/commons-io-2.4.jar]
2017-05-19T12:39:48,650 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/jackson-mapper-asl-1.8.8.jar]
2017-05-19T12:39:48,651 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopTask - Hadoop Container Druid Classpath is set to [file:/root/druid-0.10.0/conf-quickstart/druid/_common/:file:/root/druid-0.10.0/conf-quickstart/druid/middleManager/:file:/root/druid-0.10.0/lib/druid-console-0.0.2.jar:file:/root/druid-0.10.0/lib/antlr4-runtime-4.5.1.jar:file:/root/druid-0.10.0/lib/aether-util-0.9.0.M2.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudfront-1.10.21.jar:file:/root/druid-0.10.0/lib/plexus-interpolation-1.19.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-iam-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-codepipeline-1.10.21.jar:file:/root/druid-0.10.0/lib/jackson-annotations-2.4.6.jar:file:/root/druid-0.10.0/lib/maven-settings-3.1.1.jar:file:/root/druid-0.10.0/lib/jetty-servlets-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/jackson-core-2.4.6.jar:file:/root/druid-0.10.0/lib/javax.el-3.0.0.jar:file:/root/druid-0.10.0/lib/lz4-1.3.0.jar:file:/root/druid-0.10.0/lib/jsr311-api-1.1.1.jar:file:/root/druid-0.10.0/lib/opencsv-2.3.jar:file:/root/druid-0.10.0/lib/jackson-dataformat-smile-2.4.6.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-route53-1.10.21.jar:file:/root/druid-0.10.0/lib/jetty-client-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/jsr305-2.0.1.jar:file:/root/druid-0.10.0/lib/icu4j-4.8.1.jar:file:/root/druid-0.10.0/lib/commons-compiler-2.7.6.jar:file:/root/druid-0.10.0/lib/okhttp-1.0.2.jar:file:/root/druid-0.10.0/lib/guice-multibindings-4.1.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cognitosync-1.10.21.jar:file:/root/druid-0.10.0/lib/guice-servlet-4.1.0.jar:file:/root/druid-0.10.0/lib/extendedset-0.10.0.jar:file:/root/druid-0.10.0/lib/jetty-continuation-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/validation-api-1.1.0.Final.jar:file:/root/druid-0.10.0/lib/calcite-linq4j-1.11.0.jar:file:/root/druid-0.10.0/lib/jackson-databind-2.4.6.jar:file:/root/druid-0.10.0/lib/commons-dbcp2-2.0.1.jar:file:/root/druid-0.10.0/lib/druid-server-0.10.0.jar:file:/root/druid-0.10.0/lib/plexus-utils-3.0.15.jar:file:/root/druid-0.10.0/lib/jetty-io-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/netty-3.10.4.Final.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-efs-1.10.21.jar:file:/root/druid-0.10.0/lib/base64-2.3.8.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-ec2-1.10.21.jar:file:/root/druid-0.10.0/lib/httpclient-4.5.1.jar:file:/root/druid-0.10.0/lib/RoaringBitmap-0.5.18.jar:file:/root/druid-0.10.0/lib/jackson-datatype-guava-2.4.6.jar:file:/root/druid-0.10.0/lib/jetty-servlet-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/druid-indexing-service-0.10.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-directconnect-1.10.21.jar:file:/root/druid-0.10.0/lib/maxminddb-0.2.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-kinesis-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-ssm-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-machinelearning-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-1.10.21.jar:file:/root/druid-0.10.0/lib/disruptor-3.3.0.jar:file:/root/druid-0.10.0/lib/commons-math3-3.6.1.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-ecs-1.10.21.jar:file:/root/druid-0.10.0/lib/wagon-provider-api-2.4.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:file:/root/druid-0.10.0/lib/fastutil-7.0.13.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudhsm-1.10.21.jar:file:/root/druid-0.10.0/lib/hibernate-validator-5.1.3.Final.jar:file:/root/druid-0.10.0/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/root/druid-0.10.0/lib/joda-time-2.8.2.jar:file:/root/druid-0.10.0/lib/log4j-1.2-api-2.5.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-codedeploy-1.10.21.jar:file:/root/druid-0.10.0/lib/commons-logging-1.1.1.jar:file:/root/druid-0.10.0/lib/aether-spi-0.9.0.M2.jar:file:/root/druid-0.10.0/lib/json-path-2.1.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-sns-1.10.21.jar:file:/root/druid-0.10.0/lib/geoip2-0.4.0.jar:file:/root/druid-0.10.0/lib/druid-processing-0.10.0.jar:file:/root/druid-0.10.0/lib/netty-all-4.1.6.Final.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-kms-1.10.21.jar:file:/root/druid-0.10.0/lib/config-magic-0.9.jar:file:/root/druid-0.10.0/lib/jetty-proxy-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/airline-0.7.jar:file:/root/druid-0.10.0/lib/commons-cli-1.2.jar:file:/root/druid-0.10.0/lib/log4j-core-2.5.jar:file:/root/druid-0.10.0/lib/curator-x-discovery-2.11.0.jar:file:/root/druid-0.10.0/lib/derby-10.11.1.1.jar:file:/root/druid-0.10.0/lib/maven-model-builder-3.1.1.jar:file:/root/druid-0.10.0/lib/maven-model-3.1.1.jar:file:/root/druid-0.10.0/lib/httpcore-4.4.3.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-rds-1.10.21.jar:file:/root/druid-0.10.0/lib/janino-2.7.6.jar:file:/root/druid-0.10.0/lib/jackson-jaxrs-base-2.4.6.jar:file:/root/druid-0.10.0/lib/bytebuffer-collections-0.10.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-elasticache-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-directory-1.10.21.jar:file:/root/druid-0.10.0/lib/aether-connector-okhttp-0.0.9.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-logs-1.10.21.jar:file:/root/druid-0.10.0/lib/http-client-1.0.6.jar:file:/root/druid-0.10.0/lib/avatica-core-1.9.0.jar:file:/root/druid-0.10.0/lib/aether-api-0.9.0.M2.jar:file:/root/druid-0.10.0/lib/protobuf-java-3.1.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-workspaces-1.10.21.jar:file:/root/druid-0.10.0/lib/mapdb-1.0.8.jar:file:/root/druid-0.10.0/lib/maven-aether-provider-3.1.1.jar:file:/root/druid-0.10.0/lib/javax.inject-1.jar:file:/root/druid-0.10.0/lib/aether-connector-file-0.9.0.M2.jar:file:/root/druid-0.10.0/lib/jackson-module-jaxb-annotations-2.4.6.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-codecommit-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-lambda-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:file:/root/druid-0.10.0/lib/jersey-core-1.19.jar:file:/root/druid-0.10.0/lib/commons-dbcp-1.4.jar:file:/root/druid-0.10.0/lib/aopalliance-1.0.jar:file:/root/druid-0.10.0/lib/jets3t-0.9.4.jar:file:/root/druid-0.10.0/lib/jetty-http-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/jersey-server-1.19.jar:file:/root/druid-0.10.0/lib/maven-settings-builder-3.1.1.jar:file:/root/druid-0.10.0/lib/jetty-util-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/derbyclient-10.11.1.1.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudtrail-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-storagegateway-1.10.21.jar:file:/root/druid-0.10.0/lib/jcl-over-slf4j-1.7.12.jar:file:/root/druid-0.10.0/lib/jline-0.9.94.jar:file:/root/druid-0.10.0/lib/commons-lang3-3.2.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudwatch-1.10.21.jar:file:/root/druid-0.10.0/lib/jboss-logging-3.1.3.GA.jar:file:/root/druid-0.10.0/lib/derbynet-10.11.1.1.jar:file:/root/druid-0.10.0/lib/slf4j-api-1.6.4.jar:file:/root/druid-0.10.0/lib/guava-16.0.1.jar:file:/root/druid-0.10.0/lib/spymemcached-2.11.7.jar:file:/root/druid-0.10.0/lib/aether-impl-0.9.0.M2.jar:file:/root/druid-0.10.0/lib/log4j-slf4j-impl-2.5.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-sqs-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-s3-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudformation-1.10.21.jar:file:/root/druid-0.10.0/lib/activation-1.1.1.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-dynamodb-1.10.21.jar:file:/root/druid-0.10.0/lib/curator-client-2.11.0.jar:file:/root/druid-0.10.0/lib/calcite-core-1.11.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-autoscaling-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-redshift-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-sts-1.10.21.jar:file:/root/druid-0.10.0/lib/emitter-0.4.1.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-glacier-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-opsworks-1.10.21.jar:file:/root/druid-0.10.0/lib/zookeeper-3.4.9.jar:file:/root/druid-0.10.0/lib/jdbi-2.63.1.jar:file:/root/druid-0.10.0/lib/compress-lzf-1.0.3.jar:file:/root/druid-0.10.0/lib/jersey-servlet-1.19.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-emr-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-datapipeline-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-importexport-1.10.21.jar:file:/root/druid-0.10.0/lib/druid-indexing-hadoop-0.10.0.jar:file:/root/druid-0.10.0/lib/druid-api-0.10.0.jar:file:/root/druid-0.10.0/lib/aggdesigner-algorithm-6.0.jar:file:/root/druid-0.10.0/lib/guice-4.1.0.jar:file:/root/druid-0.10.0/lib/druid-common-0.10.0.jar:file:/root/druid-0.10.0/lib/rhino-1.7R5.jar:file:/root/druid-0.10.0/lib/druid-hll-0.10.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:file:/root/druid-0.10.0/lib/druid-sql-0.10.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-ses-1.10.21.jar:file:/root/druid-0.10.0/lib/druid-aws-common-0.10.0.jar:file:/root/druid-0.10.0/lib/log4j-jul-2.5.jar:file:/root/druid-0.10.0/lib/java-util-0.10.0.jar:file:/root/druid-0.10.0/lib/commons-codec-1.7.jar:file:/root/druid-0.10.0/lib/avatica-server-1.9.0.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-simpledb-1.10.21.jar:file:/root/druid-0.10.0/lib/jackson-mapper-asl-1.9.13.jar:file:/root/druid-0.10.0/lib/java-util-0.27.4.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-devicefarm-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudsearch-1.10.21.jar:file:/root/druid-0.10.0/lib/druid-services-0.10.0.jar:file:/root/druid-0.10.0/lib/java-xmlbuilder-1.1.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-config-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-swf-libraries-1.10.21.jar:file:/root/druid-0.10.0/lib/commons-lang-2.6.jar:file:/root/druid-0.10.0/lib/log4j-api-2.5.jar:file:/root/druid-0.10.0/lib/javax.el-api-3.0.0.jar:file:/root/druid-0.10.0/lib/javax.servlet-api-3.1.0.jar:file:/root/druid-0.10.0/lib/irc-api-1.0-0014.jar:file:/root/druid-0.10.0/lib/tesla-aether-0.0.5.jar:file:/root/druid-0.10.0/lib/jetty-security-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/jersey-guice-1.19.jar:file:/root/druid-0.10.0/lib/maven-repository-metadata-3.1.1.jar:file:/root/druid-0.10.0/lib/jetty-server-9.3.16.v20170120.jar:file:/root/druid-0.10.0/lib/classmate-1.0.0.jar:file:/root/druid-0.10.0/lib/commons-pool2-2.2.jar:file:/root/druid-0.10.0/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/root/druid-0.10.0/lib/curator-framework-2.11.0.jar:file:/root/druid-0.10.0/lib/bcprov-jdk15on-1.52.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-core-1.10.21.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:file:/root/druid-0.10.0/lib/commons-io-2.4.jar:file:/root/druid-0.10.0/lib/server-metrics-0.2.8.jar:file:/root/druid-0.10.0/lib/curator-recipes-2.11.0.jar:file:/root/druid-0.10.0/lib/commons-pool-1.6.jar:file:/root/druid-0.10.0/lib/aws-java-sdk-support-1.10.21.jar:file:/root/druid-0.10.0/lib/jackson-core-asl-1.9.13.jar:file:/root/druid-0.10.0/lib/avatica-metrics-1.9.0.jar:file:/root/druid-0.10.0/lib/jackson-datatype-joda-2.4.6.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/druid-0.10.0/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/druid-0.10.0/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2017-05-19T12:39:48,732 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2017-05-19T12:39:48,733 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2017-05-19T12:39:48,734 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2017-05-19T12:39:48,734 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class
2017-05-19T12:39:48,736 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
2017-05-19T12:39:48,803 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2017-05-19T12:39:48,805 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-05-19T12:39:48,812 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-05-19 12:39:48,930 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19 12:39:48,933 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19 12:39:48,952 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19 12:39:48,954 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19 12:39:48,960 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19 12:39:48,962 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-05-19T12:39:49,114 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2017-05-19T12:39:49,125 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2017-05-19T12:39:49,130 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2017-05-19T12:39:49,133 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2017-05-19T12:39:49,136 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2017-05-19T12:39:49,139 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2017-05-19T12:39:49,167 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-05-19T12:39:49,169 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-05-19T12:39:49,173 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@64aeaf29{/,null,AVAILABLE}
2017-05-19T12:39:49,186 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@e3b0369{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-05-19T12:39:49,186 INFO [main] org.eclipse.jetty.server.Server - Started @7472ms
2017-05-19T12:39:49,187 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@45843650].
2017-05-19T12:39:49,187 INFO [main] io.druid.query.lookup.LookupReferencesManager - Started lookup factory references manager
2017-05-19T12:39:49,187 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@33feda48].
2017-05-19T12:39:49,204 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-05-19T12:39:49,206 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:39:49,207 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@704067c6].
2017-05-19T12:39:49,207 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='Ubuntu-1604-xenial-64-minimal:8100', host='Ubuntu-1604-xenial-64-minimal:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:39:49,706 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[]}]
2017-05-19T12:39:50,153 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-05-19T12:39:50,209 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@5ce4b9b8]
2017-05-19T12:39:50,216 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-05-19T12:39:50,220 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@5dc182f9]
2017-05-19T12:39:50,221 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@16a0df56]
2017-05-19T12:39:50,221 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@3b128802]
2017-05-19T12:39:50,225 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-05-19T12:39:50,227 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-05-19T12:39:50,227 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-05-19T12:39:50,228 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-05-19T12:39:50,228 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-05-19T12:39:50,228 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-05-19T12:39:50,228 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-05-19T12:39:50,229 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-05-19T12:39:50,322 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2017-05-19T12:39:51,124 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-05-19T12:39:51,124 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-05-19T12:39:51,133 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[]}]
2017-05-19T12:39:51,134 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2017-05-19T12:39:51,865 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-05-19T12:39:51,892 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/top.csv]
2017-05-19T12:39:52,481 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/top.csv]
2017-05-19T12:39:52,559 INFO [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.session-id
2017-05-19T12:39:52,561 INFO [task-runner-0-priority-0] org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2017-05-19T12:39:52,596 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2017-05-19T12:39:52,694 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-05-19T12:39:52,707 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2017-05-19T12:39:54,846 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-05-19T12:39:54,930 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_local1063643065_0001
2017-05-19T12:39:54,955 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/staging/root1063643065/.staging/job_local1063643065_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2017-05-19T12:39:54,955 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/staging/root1063643065/.staging/job_local1063643065_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2017-05-19T12:39:55,040 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local1063643065_0001/job_local1063643065_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2017-05-19T12:39:55,041 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local1063643065_0001/job_local1063643065_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2017-05-19T12:39:55,049 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://localhost:8080/
2017-05-19T12:39:55,049 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job datashort-determine_partitions_hashed-Optional.of([2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z]) submitted, status available at: http://localhost:8080/
2017-05-19T12:39:55,052 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_local1063643065_0001
2017-05-19T12:39:55,060 INFO [Thread-21] org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter set in config null
2017-05-19T12:39:55,067 INFO [Thread-21] org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2017-05-19T12:39:58,491 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_local1063643065_0001 running in uber mode : false
2017-05-19T12:39:58,493 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-05-19T12:39:58,508 INFO [Thread-21] org.apache.hadoop.mapred.LocalJobRunner - Waiting for map tasks
2017-05-19T12:39:58,509 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.LocalJobRunner - Starting task: attempt_local1063643065_0001_m_000000_0
2017-05-19T12:39:58,547 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.Task - Using ResourceCalculatorProcessTree : [ ]
2017-05-19T12:39:58,550 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Processing split: file:/tmp/top.csv:0+412280
2017-05-19T12:39:58,561 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2017-05-19T12:39:58,576 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - (EQUATOR) 0 kvi 26214396(104857584)
2017-05-19T12:39:58,576 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - mapreduce.task.io.sort.mb: 100
2017-05-19T12:39:58,577 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - soft limit at 83886080
2017-05-19T12:39:58,577 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - bufstart = 0; bufvoid = 104857600
2017-05-19T12:39:58,577 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - kvstart = 26214396; length = 6553600
2017-05-19T12:39:59,269 INFO [LocalJobRunner Map Task Executor #0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "datashort",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "csv",
"timestampSpec" : {
"column" : "time",
"format" : "yyyy-M-d H:m:s"
},
"columns" : [ "id", "recvtime", "imei", "bus_id", "timestamp", "time", "longitude", "latitude", "speed", "mMU1Acc", "mMU2Acc", "mSTUAcc", "mNOxOutAcc", "nDBCVersion", "nNVRAMSt", "nRecState", "nSWType", "nSWVersion", "stMU1", "stMU2", "stSTU", "qnEngOutShoAvg", "qNH3ShoAvg", "rNOxConvShoAvg", "rNOxInShoAvg", "tSCRShoAvg", "rNOxOutShoAvg", "qNH3InUseAvg", "rNOxConvInUseAvg", "rNOxInInUseAvg", "rNOxOutInUseAvg", "pDPFFild", "pDPFMax", "stDPFErr", "stHtSafeMod", "stNH3Err", "stNOxOutErr", "stSysErrStatus", "stSysPause", "tSCRInUseAvg", "obdBckPressHigh", "obdCVDInLeak", "obdCVDLeak", "obdDPFErr", "obdInLeak", "obdInLeak2", "obdMUCTCErr", "obdMUFlsEmpt", "obdNOxOut", "obdNOxOutHigh", "obdPresHigh1", "obdPresHigh2", "obdSTUClogg", "obdVlvInStckCls", "obdVlvInStckOpn", "obdVlvOutStckCls", "obdVlvOutStckOpn", "obdCVDTempOOR", "obdEEC1Dflt", "obdHtVoltHigh", "obdHtVoltLow", "obdIC1Dflt", "obdLFEDflt", "obdMainRelayDis", "obdMU1HtCirc", "obdMU1TempOOR", "obdMU2HtCirc", "obdMU2TempOOR", "obdNOxInDflt", "obdNOxInEnaTo", "obdNOxOutDflt", "obdNOxOutEnaTo", "obdPresSensOOR", "obdSCRInTempOOR", "obdSCROutTempOOR", "obdSTUHtCirc", "obdMUTempPlaus", "obdSysVoltOOR", "obdCVDInClogg", "obdCVDInSens", "obdCVDOutClogg", "obdCVDOutLeak", "obdCVDOutSens", "obdNH3Conv", "obdVlvInStckOpn2", "obdVlvOutStckOpn2", "obdDPFWarn", "obdDPFAlrm", "80", "85", "86", "88", "127", "128", "135", "136", "138", "199" ],
"dimensionsSpec" : {
"dimensions" : [ "imei", "bus_id" ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "speed",
"fieldName" : "speed",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "id_unique",
"fieldName" : "id",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "MINUTE",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/top.csv"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "file:/root/druid-0.10.0/var/druid/segments/"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "var/druid/hadoop-tmp",
"version" : "2017-05-19T12:39:40.476Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 75000000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 500,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.map.memory.mb" : "3500",
"mapreduce.map.java.opts" : "-server -Xmx5536m -Duser.timezone=UTC -Dfile.encoding=UTF-8",
"mapreduce.reduce.memory.mb" : "5048",
"mapreduce.reduce.java.opts" : "-server -Xmx2560m -Duser.timezone=UTC -Dfile.encoding=UTF-8"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "5d76490fb6ed4b3d95e1e8c3da28eed0"
}
}
2017-05-19T12:40:02,080 INFO [LocalJobRunner Map Task Executor #0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "datashort",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "csv",
"timestampSpec" : {
"column" : "time",
"format" : "yyyy-M-d H:m:s"
},
"columns" : [ "id", "recvtime", "imei", "bus_id", "timestamp", "time", "longitude", "latitude", "speed", "mMU1Acc", "mMU2Acc", "mSTUAcc", "mNOxOutAcc", "nDBCVersion", "nNVRAMSt", "nRecState", "nSWType", "nSWVersion", "stMU1", "stMU2", "stSTU", "qnEngOutShoAvg", "qNH3ShoAvg", "rNOxConvShoAvg", "rNOxInShoAvg", "tSCRShoAvg", "rNOxOutShoAvg", "qNH3InUseAvg", "rNOxConvInUseAvg", "rNOxInInUseAvg", "rNOxOutInUseAvg", "pDPFFild", "pDPFMax", "stDPFErr", "stHtSafeMod", "stNH3Err", "stNOxOutErr", "stSysErrStatus", "stSysPause", "tSCRInUseAvg", "obdBckPressHigh", "obdCVDInLeak", "obdCVDLeak", "obdDPFErr", "obdInLeak", "obdInLeak2", "obdMUCTCErr", "obdMUFlsEmpt", "obdNOxOut", "obdNOxOutHigh", "obdPresHigh1", "obdPresHigh2", "obdSTUClogg", "obdVlvInStckCls", "obdVlvInStckOpn", "obdVlvOutStckCls", "obdVlvOutStckOpn", "obdCVDTempOOR", "obdEEC1Dflt", "obdHtVoltHigh", "obdHtVoltLow", "obdIC1Dflt", "obdLFEDflt", "obdMainRelayDis", "obdMU1HtCirc", "obdMU1TempOOR", "obdMU2HtCirc", "obdMU2TempOOR", "obdNOxInDflt", "obdNOxInEnaTo", "obdNOxOutDflt", "obdNOxOutEnaTo", "obdPresSensOOR", "obdSCRInTempOOR", "obdSCROutTempOOR", "obdSTUHtCirc", "obdMUTempPlaus", "obdSysVoltOOR", "obdCVDInClogg", "obdCVDInSens", "obdCVDOutClogg", "obdCVDOutLeak", "obdCVDOutSens", "obdNH3Conv", "obdVlvInStckOpn2", "obdVlvOutStckOpn2", "obdDPFWarn", "obdDPFAlrm", "80", "85", "86", "88", "127", "128", "135", "136", "138", "199" ],
"dimensionsSpec" : {
"dimensions" : [ "imei", "bus_id" ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "speed",
"fieldName" : "speed",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "id_unique",
"fieldName" : "id",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "MINUTE",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/top.csv"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "file:/root/druid-0.10.0/var/druid/segments/"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "var/druid/hadoop-tmp",
"version" : "2017-05-19T12:39:40.476Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 75000000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 500,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.map.memory.mb" : "3500",
"mapreduce.map.java.opts" : "-server -Xmx5536m -Duser.timezone=UTC -Dfile.encoding=UTF-8",
"mapreduce.reduce.memory.mb" : "5048",
"mapreduce.reduce.java.opts" : "-server -Xmx2560m -Duser.timezone=UTC -Dfile.encoding=UTF-8"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "5d76490fb6ed4b3d95e1e8c3da28eed0"
}
}
2017-05-19T12:40:02,683 INFO [LocalJobRunner Map Task Executor #0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "datashort",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "csv",
"timestampSpec" : {
"column" : "time",
"format" : "yyyy-M-d H:m:s"
},
"columns" : [ "id", "recvtime", "imei", "bus_id", "timestamp", "time", "longitude", "latitude", "speed", "mMU1Acc", "mMU2Acc", "mSTUAcc", "mNOxOutAcc", "nDBCVersion", "nNVRAMSt", "nRecState", "nSWType", "nSWVersion", "stMU1", "stMU2", "stSTU", "qnEngOutShoAvg", "qNH3ShoAvg", "rNOxConvShoAvg", "rNOxInShoAvg", "tSCRShoAvg", "rNOxOutShoAvg", "qNH3InUseAvg", "rNOxConvInUseAvg", "rNOxInInUseAvg", "rNOxOutInUseAvg", "pDPFFild", "pDPFMax", "stDPFErr", "stHtSafeMod", "stNH3Err", "stNOxOutErr", "stSysErrStatus", "stSysPause", "tSCRInUseAvg", "obdBckPressHigh", "obdCVDInLeak", "obdCVDLeak", "obdDPFErr", "obdInLeak", "obdInLeak2", "obdMUCTCErr", "obdMUFlsEmpt", "obdNOxOut", "obdNOxOutHigh", "obdPresHigh1", "obdPresHigh2", "obdSTUClogg", "obdVlvInStckCls", "obdVlvInStckOpn", "obdVlvOutStckCls", "obdVlvOutStckOpn", "obdCVDTempOOR", "obdEEC1Dflt", "obdHtVoltHigh", "obdHtVoltLow", "obdIC1Dflt", "obdLFEDflt", "obdMainRelayDis", "obdMU1HtCirc", "obdMU1TempOOR", "obdMU2HtCirc", "obdMU2TempOOR", "obdNOxInDflt", "obdNOxInEnaTo", "obdNOxOutDflt", "obdNOxOutEnaTo", "obdPresSensOOR", "obdSCRInTempOOR", "obdSCROutTempOOR", "obdSTUHtCirc", "obdMUTempPlaus", "obdSysVoltOOR", "obdCVDInClogg", "obdCVDInSens", "obdCVDOutClogg", "obdCVDOutLeak", "obdCVDOutSens", "obdNH3Conv", "obdVlvInStckOpn2", "obdVlvOutStckOpn2", "obdDPFWarn", "obdDPFAlrm", "80", "85", "86", "88", "127", "128", "135", "136", "138", "199" ],
"dimensionsSpec" : {
"dimensions" : [ "imei", "bus_id" ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "speed",
"fieldName" : "speed",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "id_unique",
"fieldName" : "id",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "MINUTE",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-08-19T00:00:00.000Z/2017-06-01T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/top.csv"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "file:/root/druid-0.10.0/var/druid/segments/"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "var/druid/hadoop-tmp",
"version" : "2017-05-19T12:39:40.476Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 75000000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 500,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.map.memory.mb" : "3500",
"mapreduce.map.java.opts" : "-server -Xmx5536m -Duser.timezone=UTC -Dfile.encoding=UTF-8",
"mapreduce.reduce.memory.mb" : "5048",
"mapreduce.reduce.java.opts" : "-server -Xmx2560m -Duser.timezone=UTC -Dfile.encoding=UTF-8"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "5d76490fb6ed4b3d95e1e8c3da28eed0"
}
}
2017-05-19T12:40:03,912 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2017-05-19T12:40:06,403 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.LocalJobRunner -
2017-05-19T12:40:06,403 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Starting flush of map output
2017-05-19T12:40:06,403 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Spilling map output
2017-05-19T12:40:06,403 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - bufstart = 0; bufend = 17841720; bufvoid = 104857600
2017-05-19T12:40:06,403 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - kvstart = 26214396(104857584); kvend = 22458880(89835520); length = 3755517/6553600
2017-05-19T12:40:07,603 INFO [communication thread] org.apache.hadoop.mapred.LocalJobRunner - map > sort
2017-05-19T12:40:11,719 INFO [communication thread] org.apache.hadoop.mapred.LocalJobRunner - map > sort
2017-05-19T12:40:11,720 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 67% reduce 0%
2017-05-19T12:40:29,224 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Finished spill 0
2017-05-19T12:40:29,279 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.Task - Task:attempt_local1063643065_0001_m_000000_0 is done. And is in the process of committing
2017-05-19T12:40:29,280 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.LocalJobRunner - map
2017-05-19T12:40:29,281 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.Task - Task 'attempt_local1063643065_0001_m_000000_0' done.
2017-05-19T12:40:29,281 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.LocalJobRunner - Finishing task: attempt_local1063643065_0001_m_000000_0
2017-05-19T12:40:29,281 INFO [Thread-21] org.apache.hadoop.mapred.LocalJobRunner - map task executor complete.
2017-05-19T12:40:30,923 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 100% reduce 0%
2017-05-19T12:41:46,100 WARN [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 32824ms for sessionid 0x15c1cfa7f2c0011
2017-05-19T12:41:46,102 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 32824ms for sessionid 0x15c1cfa7f2c0011, closing socket connection and attempting reconnect
2017-05-19T12:41:46,112 WARN [Thread-21] org.apache.hadoop.mapred.LocalJobRunner - job_local1063643065_0001
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.HashMap.newNode(HashMap.java:1742) ~[?:1.8.0_131]
at java.util.HashMap.putVal(HashMap.java:630) ~[?:1.8.0_131]
at java.util.HashMap.putMapEntries(HashMap.java:514) ~[?:1.8.0_131]
at java.util.HashMap.<init>(HashMap.java:489) ~[?:1.8.0_131]
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:668) ~[hadoop-common-2.3.0.jar:?]
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:439) ~[hadoop-mapreduce-client-core-2.3.0.jar:?]
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.<init>(LocalJobRunner.java:294) ~[hadoop-mapreduce-client-common-2.3.0.jar:?]
at org.apache.hadoop.mapred.LocalJobRunner$Job.getReduceTaskRunnables(LocalJobRunner.java:350) ~[hadoop-mapreduce-client-common-2.3.0.jar:?]
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:526) [hadoop-mapreduce-client-common-2.3.0.jar:?]
2017-05-19T12:41:46,116 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.104Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"segment/scan/pending","value":0}]
2017-05-19T12:41:46,120 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.118Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/max","value":1908932608,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"heap"}]
2017-05-19T12:41:46,121 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.121Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/committed","value":1908932608,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"heap"}]
2017-05-19T12:41:46,121 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.121Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/used","value":778468584,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"heap"}]
2017-05-19T12:41:46,121 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.121Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/init","value":396361728,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"heap"}]
2017-05-19T12:41:46,121 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.121Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/max","value":-1,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"nonheap"}]
2017-05-19T12:41:46,122 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.121Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/committed","value":89350144,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"nonheap"}]
2017-05-19T12:41:46,122 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.122Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/used","value":87483312,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"nonheap"}]
2017-05-19T12:41:46,122 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.122Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/mem/init","value":2555904,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"memKind":"nonheap"}]
2017-05-19T12:41:46,123 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.122Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":251658240,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-05-19T12:41:46,123 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.123Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":17563648,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-05-19T12:41:46,123 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.123Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":17376000,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-05-19T12:41:46,123 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.123Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":2555904,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-05-19T12:41:46,123 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.123Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":-1,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-05-19T12:41:46,124 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.123Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":63922176,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-05-19T12:41:46,124 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.124Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":62332168,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-05-19T12:41:46,124 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.124Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":0,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-05-19T12:41:46,125 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.124Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":1073741824,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-05-19T12:41:46,125 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.125Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":8126464,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-05-19T12:41:46,125 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.125Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":7820096,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-05-19T12:41:46,125 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.125Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":0,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-05-19T12:41:46,125 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.125Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":238551040,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-05-19T12:41:46,126 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.125Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":238551040,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-05-19T12:41:46,126 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.126Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":4887568,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-05-19T12:41:46,126 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.126Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":99614720,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-05-19T12:41:46,126 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.126Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":238551040,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-05-19T12:41:46,126 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.126Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":238551040,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-05-19T12:41:46,127 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.126Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":0,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-05-19T12:41:46,127 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.127Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":16252928,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-05-19T12:41:46,127 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.127Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/max","value":1431830528,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-05-19T12:41:46,127 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.127Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/committed","value":1431830528,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-05-19T12:41:46,127 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.127Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/used","value":775553064,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-05-19T12:41:46,128 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.127Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/pool/init","value":264241152,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-05-19T12:41:46,128 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.128Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/capacity","value":1026622787,"bufferpoolName":"direct","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,128 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.128Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/used","value":1026622787,"bufferpoolName":"direct","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,129 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.128Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/count","value":47,"bufferpoolName":"direct","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,129 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.129Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,129 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.129Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,129 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.129Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,130 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-05-19T12:41:46.130Z","service":"druid/middleManager","host":"Ubuntu-1604-xenial-64-minimal:8100","version":"0.10.0","metric":"jetty/numOpenConnections","value":0,"dataSource":["datashort"],"id":["index_hadoop_datashort_2017-05-19T12:39:40.477Z"]}]
2017-05-19T12:41:46,203 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: SUSPENDED
2017-05-19T12:41:47,104 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_local1063643065_0001 failed with state FAILED due to: NA
2017-05-19T12:41:47,912 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2017-05-19T12:41:47,913 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
2017-05-19T12:41:47,915 WARN [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Unable to reconnect to ZooKeeper service, session 0x15c1cfa7f2c0011 has expired
2017-05-19T12:41:47,915 WARN [main-EventThread] org.apache.curator.ConnectionState - Session expired event received
2017-05-19T12:41:47,915 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Unable to reconnect to ZooKeeper service, session 0x15c1cfa7f2c0011 has expired, closing socket connection
2017-05-19T12:41:47,915 INFO [main-EventThread] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@596a7f44
2017-05-19T12:41:47,916 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: LOST
2017-05-19T12:41:47,917 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2017-05-19T12:41:47,917 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15c1cfa7f2c0011
2017-05-19T12:41:47,918 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
2017-05-19T12:41:47,918 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Node[/druid/announcements/Ubuntu-1604-xenial-64-minimal:8100] is added to reinstate.
2017-05-19T12:41:47,918 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Node[/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100] is added to reinstate.
2017-05-19T12:41:47,931 INFO [main-SendThread(localhost.localdomain:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost.localdomain/127.0.0.1:2181, sessionid = 0x15c1cfa7f2c0012, negotiated timeout = 30000
2017-05-19T12:41:47,931 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: RECONNECTED
2017-05-19T12:41:47,932 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Reinstating [/druid/announcements/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:41:47,933 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Reinstating [/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:41:47,933 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Node[/druid/announcements/Ubuntu-1604-xenial-64-minimal:8100] dropped, reinstating.
2017-05-19T12:41:47,939 INFO [Announcer-0] io.druid.curator.announcement.Announcer - Node[/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100] dropped, reinstating.
2017-05-19T12:42:00,729 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Counters: 20
File System Counters
FILE: Number of bytes read=412601
FILE: Number of bytes written=48096645
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=1000
Map output records=938880
Map output bytes=17841720
Map output materialized bytes=25352760
Input split bytes=264
Combine input records=0
Spilled Records=938880
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=17461
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Total committed heap usage (bytes)=1908932608
File Input Format Counters
Bytes Read=0
2017-05-19T12:42:00,729 ERROR [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job failed: job_local1063643065_0001
2017-05-19T12:42:00,730 INFO [task-runner-0-priority-0] io.druid.indexer.JobHelper - Deleting path[var/druid/hadoop-tmp/datashort/2017-05-19T123940.476Z_5d76490fb6ed4b3d95e1e8c3da28eed0]
2017-05-19T12:42:00,745 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_datashort_2017-05-19T12:39:40.477Z, type=index_hadoop, dataSource=datashort}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:211) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.10.0.jar:0.10.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208) ~[druid-indexing-service-0.10.0.jar:0.10.0]
... 7 more
Caused by: io.druid.java.util.common.ISE: Job[class io.druid.indexer.DetermineHashedPartitionsJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:306) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_131]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208) ~[druid-indexing-service-0.10.0.jar:0.10.0]
... 7 more
2017-05-19T12:42:00,752 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_datashort_2017-05-19T12:39:40.477Z] status changed to [FAILED].
2017-05-19T12:42:00,755 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_datashort_2017-05-19T12:39:40.477Z",
"status" : "FAILED",
"duration" : 132701
}
2017-05-19T12:42:00,762 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@704067c6].
2017-05-19T12:42:00,762 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@22e2266d]
2017-05-19T12:42:00,762 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:42:00,788 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@33feda48].
2017-05-19T12:42:00,788 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:42:00,794 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/Ubuntu-1604-xenial-64-minimal:8100]
2017-05-19T12:42:00,794 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@45843650].
2017-05-19T12:42:00,794 INFO [main] io.druid.query.lookup.LookupReferencesManager - Stopping lookup factory references manager
2017-05-19T12:42:00,799 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@e3b0369{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-05-19T12:42:00,800 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@64aeaf29{/,null,UNAVAILABLE}
2017-05-19T12:42:00,802 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@4a8e6e89].
2017-05-19T12:42:00,803 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@4e22368c].
2017-05-19T12:42:00,804 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@5a8816cc].
2017-05-19T12:42:00,808 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@7af3874e].
2017-05-19T12:42:00,810 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@7343922c].
2017-05-19T12:42:00,810 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2017-05-19T12:42:00,811 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2017-05-19T12:42:00,819 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x15c1cfa7f2c0012 closed
2017-05-19T12:42:00,819 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15c1cfa7f2c0012
2017-05-19T12:42:00,819 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@2538bc06].
2017-05-19T12:42:00,831 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@1491344a].
2017-05-19T12:42:00,831 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@12bbfc54].
2017-05-19T12:42:00,831 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2017-05-19T12:42:00,831 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@48904d5a].
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment