Skip to content

Instantly share code, notes, and snippets.

@zcox

zcox/gist:37245d41825633c9b8b4

Created April 10, 2015 22:28
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save zcox/37245d41825633c9b8b4 to your computer and use it in GitHub Desktop.
Save zcox/37245d41825633c9b8b4 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-10T22:24:38,462 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T22:24:38,519 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-10T22:24:39,206 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T22:24:39,418 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.cli.CliCommandCreator]
2015-04-10T22:24:40,748 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/postgresql-metadata-storage/0.7.1.1/postgresql-metadata-storage-0.7.1.1.jar]
2015-04-10T22:24:40,748 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/postgresql/postgresql/9.3-1102-jdbc41/postgresql-9.3-1102-jdbc41.jar]
2015-04-10T22:24:40,748 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]
2015-04-10T22:24:40,750 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.cli.CliCommandCreator]
2015-04-10T22:24:41,137 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/druid-hdfs-storage/0.7.1.1/druid-hdfs-storage-0.7.1.1.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/net/java/dev/jets3t/jets3t/0.9.3/jets3t-0.9.3.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.9.12/jackson-core-asl-1.9.12.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.12/jackson-mapper-asl-1.9.12.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar]
2015-04-10T22:24:41,138 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/bouncycastle/bcprov-jdk15on/1.51/bcprov-jdk15on-1.51.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2/httpclient-4.2.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2/httpcore-4.2.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar]
2015-04-10T22:24:41,139 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T22:24:41,140 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T22:24:41,141 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar]
2015-04-10T22:24:41,142 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2015-04-10T22:24:41,143 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.17.1/jersey-core-1.17.1.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/emitter/0.3.0/emitter-0.3.0.jar]
2015-04-10T22:24:41,144 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/http-client/1.0.1/http-client-1.0.1.jar]
2015-04-10T22:24:41,145 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/netty/netty/3.9.5.Final/netty-3.9.5.Final.jar]
2015-04-10T22:24:41,145 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar]
2015-04-10T22:24:41,145 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar]
2015-04-10T22:24:41,145 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar]
2015-04-10T22:24:41,145 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar]
2015-04-10T22:24:41,368 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:41,370 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:41,370 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:41,372 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:42,281 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@38c57101]
2015-04-10T22:24:42,294 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2015-04-10T22:24:42,315 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='192.168.59.103', port=8100}]
2015-04-10T22:24:42,345 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
2015-04-10T22:24:42,356 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@28d0af7a]
2015-04-10T22:24:42,363 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@5bed0458]
2015-04-10T22:24:42,474 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@79d0decf]
2015-04-10T22:24:42,481 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@1012594c]
2015-04-10T22:24:42,489 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2015-04-10T22:24:42,527 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@7936250f]
2015-04-10T22:24:42,768 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@197444e7]
2015-04-10T22:24:42,775 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@73a20aab]
2015-04-10T22:24:42,815 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@44702455]
2015-04-10T22:24:42,822 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@64903dcb]
2015-04-10T22:24:42,847 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2015-04-10T22:24:42,856 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@6f7f0411]
2015-04-10T22:24:42,867 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.FilteredServerViewProvider] from props[druid.announcer.] as [io.druid.client.FilteredBatchServerViewProvider@5c70db4d]
2015-04-10T22:24:42,890 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2015-04-10T22:24:42,895 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2015-04-10T22:24:42,896 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2015-04-10T22:24:42,897 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2015-04-10T22:24:42,992 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@2cfb40ec]
2015-04-10T22:24:42,997 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@47f03caa]
2015-04-10T22:24:43,003 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@2b45fdeb]
2015-04-10T22:24:43,010 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@5d3ad90d]
2015-04-10T22:24:43,025 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5556ms
2015-04-10T22:24:43,118 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@11fb9657].
2015-04-10T22:24:43,118 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@1c4b32fa].
2015-04-10T22:24:43,120 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@58e6b9bc].
2015-04-10T22:24:43,121 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2015-04-10T22:24:43,121 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2015-04-10T22:24:43,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2015-04-10T22:24:43,131 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=274ffb48c7ec
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_76
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-oracle/jre
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/opt/druid/config/_common:/opt/druid/lib/RoaringBitmap-0.4.5.jar:/opt/druid/lib/httpcore-4.2.jar:/opt/druid/lib/commons-pool-1.6.jar:/opt/druid/lib/maven-settings-builder-3.1.1.jar:/opt/druid/lib/curator-client-2.7.0.jar:/opt/druid/lib/mx4j-3.0.2.jar:/opt/druid/lib/log4j-jul-2.2.jar:/opt/druid/lib/jackson-datatype-joda-2.4.4.jar:/opt/druid/lib/curator-x-discovery-2.7.0.jar:/opt/druid/lib/derbyclient-10.11.1.1.jar:/opt/druid/lib/jdbi-2.32.jar:/opt/druid/lib/jackson-core-asl-1.9.12.jar:/opt/druid/lib/disruptor-3.3.0.jar:/opt/druid/lib/jackson-annotations-2.4.4.jar:/opt/druid/lib/rhino-1.7R5.jar:/opt/druid/lib/commons-lang-2.6.jar:/opt/druid/lib/compress-lzf-1.0.3.jar:/opt/druid/lib/classmate-1.0.0.jar:/opt/druid/lib/jcl-over-slf4j-1.7.10.jar:/opt/druid/lib/druid-aws-common-0.7.1.1.jar:/opt/druid/lib/druid-api-0.3.5.jar:/opt/druid/lib/maxminddb-0.2.0.jar:/opt/druid/lib/jetty-servlet-9.2.5.v20141112.jar:/opt/druid/lib/config-magic-0.9.jar:/opt/druid/lib/curator-recipes-2.7.0.jar:/opt/druid/lib/javax.inject-1.jar:/opt/druid/lib/spymemcached-2.11.4.jar:/opt/druid/lib/bcprov-jdk15on-1.51.jar:/opt/druid/lib/derbynet-10.11.1.1.jar:/opt/druid/lib/log4j-1.2-api-2.2.jar:/opt/druid/lib/jackson-jaxrs-smile-provider-2.4.4.jar:/opt/druid/lib/xpp3-1.1.4c.jar:/opt/druid/lib/log4j-core-2.2.jar:/opt/druid/lib/guice-servlet-4.0-beta.jar:/opt/druid/lib/server-metrics-0.1.0.jar:/opt/druid/lib/jets3t-0.9.3.jar:/opt/druid/lib/druid-indexing-service-0.7.1.1.jar:/opt/druid/lib/jboss-logging-3.1.3.GA.jar:/opt/druid/lib/jsr305-2.0.1.jar:/opt/druid/lib/lz4-1.3.0.jar:/opt/druid/lib/aether-spi-0.9.0.M2.jar:/opt/druid/lib/aopalliance-1.0.jar:/opt/druid/lib/maven-settings-3.1.1.jar:/opt/druid/lib/icu4j-4.8.1.jar:/opt/druid/lib/aws-java-sdk-core-1.8.11.jar:/opt/druid/lib/aether-impl-0.9.0.M2.jar:/opt/druid/lib/jackson-datatype-guava-2.4.4.jar:/opt/druid/lib/jetty-client-9.2.5.v20141112.jar:/opt/druid/lib/jersey-servlet-1.17.1.jar:/opt/druid/lib/tesla-aether-0.0.5.jar:/opt/druid/lib/joda-time-2.6.jar:/opt/druid/lib/aether-connector-okhttp-0.0.9.jar:/opt/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:/opt/druid/lib/jline-0.9.94.jar:/opt/druid/lib/commons-pool2-2.2.jar:/opt/druid/lib/bytebuffer-collections-0.1.5.jar:/opt/druid/lib/druid-server-0.7.1.1.jar:/opt/druid/lib/commons-codec-1.7.jar:/opt/druid/lib/jersey-guice-1.17.1.jar:/opt/druid/lib/jackson-mapper-asl-1.9.13.jar:/opt/druid/lib/aether-util-0.9.0.M2.jar:/opt/druid/lib/maven-repository-metadata-3.1.1.jar:/opt/druid/lib/javax.el-api-3.0.0.jar:/opt/druid/lib/commons-dbcp2-2.0.1.jar:/opt/druid/lib/curator-framework-2.7.0.jar:/opt/druid/lib/derby-10.11.1.1.jar:/opt/druid/lib/jackson-core-2.4.4.jar:/opt/druid/lib/jetty-continuation-9.2.5.v20141112.jar:/opt/druid/lib/httpclient-4.2.jar:/opt/druid/lib/plexus-interpolation-1.19.jar:/opt/druid/lib/jackson-jaxrs-json-provider-2.4.4.jar:/opt/druid/lib/activation-1.1.1.jar:/opt/druid/lib/guice-multibindings-4.0-beta.jar:/opt/druid/lib/antlr4-runtime-4.0.jar:/opt/druid/lib/asm-3.1.jar:/opt/druid/lib/protobuf-java-2.5.0.jar:/opt/druid/lib/jetty-proxy-9.2.5.v20141112.jar:/opt/druid/lib/guice-4.0-beta.jar:/opt/druid/lib/plexus-utils-3.0.15.jar:/opt/druid/lib/druid-processing-0.7.1.1.jar:/opt/druid/lib/java-util-0.26.15.jar:/opt/druid/lib/org.abego.treelayout.core-1.0.1.jar:/opt/druid/lib/airline-0.6.jar:/opt/druid/lib/slf4j-api-1.6.4.jar:/opt/druid/lib/jetty-util-9.2.5.v20141112.jar:/opt/druid/lib/emitter-0.3.0.jar:/opt/druid/lib/jackson-module-jaxb-annotations-2.4.4.jar:/opt/druid/lib/jersey-server-1.17.1.jar:/opt/druid/lib/guava-16.0.1.jar:/opt/druid/lib/jetty-io-9.2.5.v20141112.jar:/opt/druid/lib/druid-indexing-hadoop-0.7.1.1.jar:/opt/druid/lib/zookeeper-3.4.6.jar:/opt/druid/lib/jersey-core-1.17.1.jar:/opt/druid/lib/jackson-dataformat-smile-2.4.4.jar:/opt/druid/lib/aether-api-0.9.0.M2.jar:/opt/druid/lib/validation-api-1.1.0.Final.jar:/opt/druid/lib/javax.servlet-api-3.1.0.jar:/opt/druid/lib/maven-model-builder-3.1.1.jar:/opt/druid/lib/jackson-databind-2.4.4.jar:/opt/druid/lib/extendedset-1.3.8.jar:/opt/druid/lib/commons-io-2.0.1.jar:/opt/druid/lib/jetty-servlets-9.2.5.v20141112.jar:/opt/druid/lib/jetty-server-9.2.5.v20141112.jar:/opt/druid/lib/irc-api-1.0-0011.jar:/opt/druid/lib/javax.el-3.0.0.jar:/opt/druid/lib/druid-common-0.7.1.1.jar:/opt/druid/lib/commons-cli-1.2.jar:/opt/druid/lib/google-http-client-1.15.0-rc.jar:/opt/druid/lib/log4j-slf4j-impl-2.2.jar:/opt/druid/lib/log4j-api-2.2.jar:/opt/druid/lib/netty-3.9.5.Final.jar:/opt/druid/lib/hibernate-validator-5.1.3.Final.jar:/opt/druid/lib/druid-services-0.7.1.1.jar:/opt/druid/lib/aws-java-sdk-1.8.11.jar:/opt/druid/lib/jetty-security-9.2.5.v20141112.jar:/opt/druid/lib/aether-connector-file-0.9.0.M2.jar:/opt/druid/lib/maven-model-3.1.1.jar:/opt/druid/lib/opencsv-2.3.jar:/opt/druid/lib/okhttp-1.0.2.jar:/opt/druid/lib/maven-aether-provider-3.1.1.jar:/opt/druid/lib/commons-logging-1.1.1.jar:/opt/druid/lib/mapdb-1.0.7.jar:/opt/druid/lib/java-xmlbuilder-0.4.jar:/opt/druid/lib/jetty-http-9.2.5.v20141112.jar:/opt/druid/lib/wagon-provider-api-2.4.jar:/opt/druid/lib/geoip2-0.4.0.jar:/opt/druid/lib/jackson-jaxrs-base-2.4.4.jar:/opt/druid/lib/http-client-1.0.1.jar:/opt/druid/lib/mail-1.4.7.jar:/opt/hadoop/etc/hadoop:/opt/hadoop/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/opt/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/opt/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/opt/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/opt/hadoop/share/hadoop/common/lib/zookeeper-3.4.5.jar:/opt/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-annotations-2.4.1.jar:/opt/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-auth-2.4.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.4.1-tests.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.4.1.jar:/opt/hadoop/share/hadoop/common/hadoop-nfs-2.4.1.jar:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.4.1.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.4.1-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jline-0.9.94.jar:/opt/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/opt/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/mapreduce/lib/junit-4.10.jar:/opt/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.4.1.jar
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2015-04-10T22:24:43,132 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2015-04-10T22:24:43,133 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.16.7-tinycore64
2015-04-10T22:24:43,133 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2015-04-10T22:24:43,133 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2015-04-10T22:24:43,133 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/data
2015-04-10T22:24:43,134 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=192.168.59.103:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@59722745
2015-04-10T22:24:43,154 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@3e1d2ca0].
2015-04-10T22:24:43,156 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 192.168.59.103/192.168.59.103:2181. Will not attempt to authenticate using SASL (unknown error)
2015-04-10T22:24:43,163 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 192.168.59.103/192.168.59.103:2181, initiating session
2015-04-10T22:24:43,173 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 192.168.59.103/192.168.59.103:2181, sessionid = 0x14ca55af9090008, negotiated timeout = 30000
2015-04-10T22:24:43,178 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2015-04-10T22:24:44,286 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@1ee69500].
2015-04-10T22:24:44,289 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.client.ServerInventoryView.start() throws java.lang.Exception] on object[io.druid.client.BatchServerInventoryView@f2437e8].
2015-04-10T22:24:44,296 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112
2015-04-10T22:24:44,363 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8083
2015-04-10T22:24:44,363 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8083', host='192.168.59.103:8083', maxSize=5000000000, tier='_default_tier', type='historical', priority='0'}]
2015-04-10T22:24:44,366 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8183
2015-04-10T22:24:44,366 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8183', host='192.168.59.103:8183', maxSize=5000000000, tier='_default_tier', type='historical', priority='0'}]
2015-04-10T22:24:44,390 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - Inventory Initialized
Apr 10, 2015 10:24:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
Apr 10, 2015 10:24:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.StatusResource as a root resource class
Apr 10, 2015 10:24:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.17.1 02/28/2013 12:47 PM'
Apr 10, 2015 10:24:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
Apr 10, 2015 10:24:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
Apr 10, 2015 10:24:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
Apr 10, 2015 10:24:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2015-04-10T22:24:45,222 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@7eedc668{/,null,AVAILABLE}
2015-04-10T22:24:45,232 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@66318691{HTTP/1.1}{0.0.0.0:8100}
2015-04-10T22:24:45,233 INFO [main] org.eclipse.jetty.server.Server - Started @7770ms
2015-04-10T22:24:45,235 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@db9451e].
2015-04-10T22:24:45,235 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/192.168.59.103:8100]
2015-04-10T22:24:45,278 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5367f38a].
2015-04-10T22:24:45,314 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8100
2015-04-10T22:24:45,315 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}]
2015-04-10T22:24:45,450 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T22:24:45,473 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T22:24:45,520 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_pageviews_2015-04-10T22:24:37.335Z",
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2015-04-10T22:24:37.335Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : { },
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
},
"hadoopDependencyCoordinates" : [ "org.apache.hadoop:hadoop-client:2.4.1" ],
"classpathPrefix" : null,
"groupId" : "index_hadoop_pageviews_2015-04-10T22:24:37.335Z",
"dataSource" : "pageviews",
"resource" : {
"availabilityGroup" : "index_hadoop_pageviews_2015-04-10T22:24:37.335Z",
"requiredCapacity" : 1
}
}
2015-04-10T22:24:45,525 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_pageviews_2015-04-10T22:24:37.335Z]: LockTryAcquireAction{interval=2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z}
2015-04-10T22:24:45,536 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_pageviews_2015-04-10T22:24:37.335Z] to overlord[http://192.168.59.103:8085/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z}
2015-04-10T22:24:45,554 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,595 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,598 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,599 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,600 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,600 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,600 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,605 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,606 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,608 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,609 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,611 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,614 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,615 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,615 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,616 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,616 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,619 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,622 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,622 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T22:24:45,702 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_pageviews_2015-04-10T22:24:37.335Z
2015-04-10T22:24:46,086 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.4.1/hadoop-client-2.4.1.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar]
2015-04-10T22:24:46,087 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.4/commons-io-2.4.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T22:24:46,088 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar]
2015-04-10T22:24:46,089 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.4.1/hadoop-auth-2.4.1.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2.5/httpcore-4.2.5.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar]
2015-04-10T22:24:46,090 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar]
2015-04-10T22:24:46,091 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T22:24:46,092 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T22:24:46,093 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1/activation-1.1.jar]
2015-04-10T22:24:46,093 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T22:24:46,093 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar]
2015-04-10T22:24:46,093 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar]
2015-04-10T22:24:46,093 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.1.1/lib/log4j-slf4j-impl-2.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-10T22:24:46,590 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T22:24:46,626 INFO [task-runner-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2015-04-10T22:24:47,299 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T22:24:47,454 INFO [task-runner-0] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:48,251 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/postgresql-metadata-storage/0.7.1.1/postgresql-metadata-storage-0.7.1.1.jar]
2015-04-10T22:24:48,251 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/postgresql/postgresql/9.3-1102-jdbc41/postgresql-9.3-1102-jdbc41.jar]
2015-04-10T22:24:48,252 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]
2015-04-10T22:24:48,254 INFO [task-runner-0] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:48,254 INFO [task-runner-0] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/druid-hdfs-storage/0.7.1.1/druid-hdfs-storage-0.7.1.1.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/net/java/dev/jets3t/jets3t/0.9.3/jets3t-0.9.3.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.9.12/jackson-core-asl-1.9.12.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.12/jackson-mapper-asl-1.9.12.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar]
2015-04-10T22:24:48,512 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/bouncycastle/bcprov-jdk15on/1.51/bcprov-jdk15on-1.51.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2/httpclient-4.2.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2/httpcore-4.2.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T22:24:48,513 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T22:24:48,514 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T22:24:48,515 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T22:24:48,515 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T22:24:48,515 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T22:24:48,515 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T22:24:48,515 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T22:24:48,516 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T22:24:48,516 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T22:24:48,516 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar]
2015-04-10T22:24:48,516 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar]
2015-04-10T22:24:48,516 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2015-04-10T22:24:48,517 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.17.1/jersey-core-1.17.1.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar]
2015-04-10T22:24:48,518 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/emitter/0.3.0/emitter-0.3.0.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/http-client/1.0.1/http-client-1.0.1.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/netty/netty/3.9.5.Final/netty-3.9.5.Final.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar]
2015-04-10T22:24:48,519 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar]
2015-04-10T22:24:48,522 INFO [task-runner-0] io.druid.initialization.Initialization - Adding extension module[class io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule]
2015-04-10T22:24:49,051 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@a7c6cfb]
2015-04-10T22:24:49,059 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2015-04-10T22:24:49,228 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T22:24:49,245 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.1.1', localRepository='/opt/druid/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T22:24:49,245 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2015-04-10T22:24:49,780 WARN [task-runner-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-04-10T22:24:49,813 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
2015-04-10T22:24:50,339 INFO [task-runner-0] io.druid.indexer.HadoopDruidDetermineConfigurationJob - DateTime[2015-03-24T00:00:00.000Z], spec[HadoopyShardSpec{actualSpec=NoneShardSpec, shardNum=0}]
2015-04-10T22:24:50,340 INFO [task-runner-0] io.druid.indexer.JobHelper - Deleting path[hdfs://192.168.59.103:9000/druid-working/pageviews/2015-04-10T222437.335Z]
2015-04-10T22:24:50,598 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_pageviews_2015-04-10T22:24:37.335Z]: LockListAction{}
2015-04-10T22:24:50,601 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_pageviews_2015-04-10T22:24:37.335Z] to overlord[http://192.168.59.103:8085/druid/indexer/v1/action]: LockListAction{}
2015-04-10T22:24:50,611 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Setting version to: 2015-04-10T22:24:37.341Z
2015-04-10T22:24:50,624 INFO [task-runner-0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "hdfs://192.168.59.103:9000/druid/pageviews"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "hdfs://192.168.59.103:9000/druid-working",
"version" : "2015-04-10T22:24:37.341Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : {
"2015-03-24T00:00:00.000Z" : [ {
"actualSpec" : {
"type" : "none"
},
"shardNum" : 0
} ]
},
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
}
}
2015-04-10T22:24:50,624 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop index generator job...
2015-04-10T22:24:50,645 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
2015-04-10T22:24:50,647 INFO [task-runner-0] io.druid.indexer.HadoopDruidIndexerJob - No metadataStorageUpdaterJob set in the config. This is cool if you are running a hadoop index task, otherwise nothing will be uploaded to database.
2015-04-10T22:24:50,674 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
2015-04-10T22:24:51,302 INFO [task-runner-0] org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at hadoop/172.17.0.180:8032
2015-04-10T22:24:51,541 WARN [task-runner-0] org.apache.hadoop.mapreduce.JobSubmitter - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-04-10T22:24:51,548 WARN [task-runner-0] org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2015-04-10T22:24:52,427 INFO [task-runner-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2015-04-10T22:24:52,529 INFO [task-runner-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2015-04-10T22:24:52,659 INFO [task-runner-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1428703369275_0003
2015-04-10T22:24:52,815 INFO [task-runner-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
2015-04-10T22:24:54,839 INFO [task-runner-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1428703369275_0003
2015-04-10T22:24:54,881 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://c6ffe6f5faeb:8088/proxy/application_1428703369275_0003/
2015-04-10T22:24:54,882 INFO [task-runner-0] io.druid.indexer.IndexGeneratorJob - Job pageviews-index-generator-Optional.of([2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z]) submitted, status available at http://c6ffe6f5faeb:8088/proxy/application_1428703369275_0003/
2015-04-10T22:24:54,883 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - Running job: job_1428703369275_0003
2015-04-10T22:24:58,916 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - Job job_1428703369275_0003 running in uber mode : false
2015-04-10T22:24:58,918 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2015-04-10T22:24:58,935 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - Job job_1428703369275_0003 failed with state FAILED due to: Application application_1428703369275_0003 failed 2 times due to AM Container for appattempt_1428703369275_0003_000002 exited with exitCode: -1000 due to: File file:/tmp/hadoop-yarn/staging/root/.staging/job_1428703369275_0003/job.xml does not exist
.Failing this attempt.. Failing the application.
2015-04-10T22:24:58,975 INFO [task-runner-0] org.apache.hadoop.mapreduce.Job - Counters: 0
2015-04-10T22:24:59,000 INFO [task-runner-0] io.druid.indexer.JobHelper - Deleting path[hdfs://192.168.59.103:9000/druid-working/pageviews/2015-04-10T222437.341Z]
2015-04-10T22:24:59,021 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_pageviews_2015-04-10T22:24:37.335Z, type=index_hadoop, dataSource=pageviews}]
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_76]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_76]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_76]
at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_76]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:256) ~[druid-indexing-service-0.7.1.1.jar:0.7.1.1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:235) [druid-indexing-service-0.7.1.1.jar:0.7.1.1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:214) [druid-indexing-service-0.7.1.1.jar:0.7.1.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_76]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_76]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_76]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
Caused by: com.metamx.common.ISE: Job[class io.druid.indexer.LegacyIndexGeneratorJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:155) ~[druid-indexing-hadoop-0.7.1.1.jar:0.7.1.1]
at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.7.1.1.jar:0.7.1.1]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:304) ~[druid-indexing-service-0.7.1.1.jar:0.7.1.1]
... 11 more
2015-04-10T22:24:59,033 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_pageviews_2015-04-10T22:24:37.335Z",
"status" : "FAILED",
"duration" : 13327
}
2015-04-10T22:24:59,037 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@db9451e].
2015-04-10T22:24:59,037 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2015-04-10T22:24:59,037 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/192.168.59.103:8100]
2015-04-10T22:24:59,059 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5367f38a].
2015-04-10T22:24:59,060 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - Server Disappeared[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}]
2015-04-10T22:24:59,067 INFO [main] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@66318691{HTTP/1.1}{0.0.0.0:8100}
2015-04-10T22:24:59,069 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@7eedc668{/,null,UNAVAILABLE}
2015-04-10T22:24:59,096 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@6021df0f].
2015-04-10T22:24:59,098 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.client.ServerInventoryView.stop() throws java.io.IOException] on object[io.druid.client.BatchServerInventoryView@f2437e8].
2015-04-10T22:24:59,099 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@1ee69500].
2015-04-10T22:24:59,100 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@3e1d2ca0].
2015-04-10T22:24:59,109 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2015-04-10T22:24:59,115 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x14ca55af9090008 closed
2015-04-10T22:24:59,115 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2015-04-10T22:24:59,116 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@58e6b9bc].
2015-04-10T22:24:59,150 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@1c4b32fa].
2015-04-10T22:24:59,151 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@11fb9657].
2015-04-10 22:24:59,201 FATAL Unable to register shutdown hook because JVM is shutting down.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment