Skip to content

Instantly share code, notes, and snippets.

@zcox

zcox/gist:bc2861977509cb111683

Created April 10, 2015 17:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save zcox/bc2861977509cb111683 to your computer and use it in GitHub Desktop.
Save zcox/bc2861977509cb111683 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.0/lib/log4j-slf4j-impl-2.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-10T16:56:41,706 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:56:42,623 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.0', localRepository='/opt/druid/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T16:56:42,825 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.cli.CliCommandCreator]
2015-04-10T16:56:43,943 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/postgresql-metadata-storage/0.7.0/postgresql-metadata-storage-0.7.0.jar]
2015-04-10T16:56:43,943 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/postgresql/postgresql/9.3-1102-jdbc41/postgresql-9.3-1102-jdbc41.jar]
2015-04-10T16:56:43,943 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]
2015-04-10T16:56:43,945 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.cli.CliCommandCreator]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/druid-hdfs-storage/0.7.0/druid-hdfs-storage-0.7.0.jar]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/net/java/dev/jets3t/jets3t/0.9.1/jets3t-0.9.1.jar]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.9.12/jackson-core-asl-1.9.12.jar]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.12/jackson-mapper-asl-1.9.12.jar]
2015-04-10T16:56:44,319 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/bouncycastle/bcprov-jdk15/1.46/bcprov-jdk15-1.46.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2/httpclient-4.2.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2/httpcore-4.2.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2015-04-10T16:56:44,320 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T16:56:44,321 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T16:56:44,322 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T16:56:44,323 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar]
2015-04-10T16:56:44,324 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.17.1/jersey-core-1.17.1.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/emitter/0.3.0/emitter-0.3.0.jar]
2015-04-10T16:56:44,325 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/http-client/1.0.0/http-client-1.0.0.jar]
2015-04-10T16:56:44,326 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/netty/netty/3.9.5.Final/netty-3.9.5.Final.jar]
2015-04-10T16:56:44,326 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar]
2015-04-10T16:56:44,326 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar]
2015-04-10T16:56:44,326 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar]
2015-04-10T16:56:44,326 INFO [main] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar]
2015-04-10T16:56:44,577 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T16:56:44,580 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]
2015-04-10T16:56:44,581 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T16:56:44,583 INFO [main] io.druid.initialization.Initialization - Adding extension module[class io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule]
2015-04-10T16:56:45,422 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@5a347342]
2015-04-10T16:56:45,434 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2015-04-10T16:56:45,456 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='192.168.59.103', port=8100}]
2015-04-10T16:56:45,484 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
2015-04-10T16:56:45,495 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@297a2]
2015-04-10T16:56:45,502 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@589a07cc]
2015-04-10T16:56:45,601 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@3d31ef93]
2015-04-10T16:56:45,607 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@701a0f8f]
2015-04-10T16:56:45,613 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2015-04-10T16:56:45,672 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@2143c7dc]
2015-04-10T16:56:45,842 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@49e263a8]
2015-04-10T16:56:45,845 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@58d3e2d4]
2015-04-10T16:56:45,864 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@22e5a865]
2015-04-10T16:56:45,868 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@2bb336f]
2015-04-10T16:56:45,883 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2015-04-10T16:56:45,889 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@661261ba]
2015-04-10T16:56:45,895 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.FilteredServerViewProvider] from props[druid.announcer.] as [io.druid.client.FilteredBatchServerViewProvider@77b2ffee]
2015-04-10T16:56:45,907 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.QueryConfig] from props[druid.query.] as [io.druid.query.QueryConfig@39d51053]
2015-04-10T16:56:45,925 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@614f5cd7]
2015-04-10T16:56:45,933 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@6c1fcf0d]
2015-04-10T16:56:45,935 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2015-04-10T16:56:45,938 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2015-04-10T16:56:45,938 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2015-04-10T16:56:45,939 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2015-04-10T16:56:46,042 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@460d5f9]
2015-04-10T16:56:46,053 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@69e73514]
2015-04-10T16:56:46,064 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5258ms
2015-04-10T16:56:46,142 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@3ce914bc].
2015-04-10T16:56:46,142 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@6a5061e1].
2015-04-10T16:56:46,144 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@397cec35].
2015-04-10T16:56:46,144 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2015-04-10T16:56:46,145 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=f15a8731d792
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_76
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-7-oracle/jre
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/opt/druid/config/_common:/opt/druid/lib/druid-processing-0.7.0.jar:/opt/druid/lib/RoaringBitmap-0.4.5.jar:/opt/druid/lib/druid-api-0.3.4.jar:/opt/druid/lib/httpcore-4.2.jar:/opt/druid/lib/commons-pool-1.6.jar:/opt/druid/lib/maven-settings-builder-3.1.1.jar:/opt/druid/lib/curator-client-2.7.0.jar:/opt/druid/lib/jets3t-0.9.1.jar:/opt/druid/lib/mx4j-3.0.2.jar:/opt/druid/lib/jackson-datatype-joda-2.4.4.jar:/opt/druid/lib/curator-x-discovery-2.7.0.jar:/opt/druid/lib/derbyclient-10.11.1.1.jar:/opt/druid/lib/jdbi-2.32.jar:/opt/druid/lib/jackson-core-asl-1.9.12.jar:/opt/druid/lib/disruptor-3.3.0.jar:/opt/druid/lib/jackson-annotations-2.4.4.jar:/opt/druid/lib/commons-lang-2.6.jar:/opt/druid/lib/compress-lzf-1.0.3.jar:/opt/druid/lib/classmate-1.0.0.jar:/opt/druid/lib/druid-common-0.7.0.jar:/opt/druid/lib/druid-indexing-service-0.7.0.jar:/opt/druid/lib/maxminddb-0.2.0.jar:/opt/druid/lib/log4j-api-2.1.jar:/opt/druid/lib/jetty-servlet-9.2.5.v20141112.jar:/opt/druid/lib/config-magic-0.9.jar:/opt/druid/lib/java-util-0.26.14.jar:/opt/druid/lib/curator-recipes-2.7.0.jar:/opt/druid/lib/javax.inject-1.jar:/opt/druid/lib/spymemcached-2.11.4.jar:/opt/druid/lib/derbynet-10.11.1.1.jar:/opt/druid/lib/jackson-jaxrs-smile-provider-2.4.4.jar:/opt/druid/lib/xpp3-1.1.4c.jar:/opt/druid/lib/guice-servlet-4.0-beta.jar:/opt/druid/lib/server-metrics-0.1.0.jar:/opt/druid/lib/jboss-logging-3.1.3.GA.jar:/opt/druid/lib/jsr305-2.0.1.jar:/opt/druid/lib/lz4-1.3.0.jar:/opt/druid/lib/aether-spi-0.9.0.M2.jar:/opt/druid/lib/aopalliance-1.0.jar:/opt/druid/lib/maven-settings-3.1.1.jar:/opt/druid/lib/icu4j-4.8.1.jar:/opt/druid/lib/aws-java-sdk-core-1.8.11.jar:/opt/druid/lib/druid-server-0.7.0.jar:/opt/druid/lib/bcprov-jdk15-1.46.jar:/opt/druid/lib/aether-impl-0.9.0.M2.jar:/opt/druid/lib/jackson-datatype-guava-2.4.4.jar:/opt/druid/lib/jetty-client-9.2.5.v20141112.jar:/opt/druid/lib/jersey-servlet-1.17.1.jar:/opt/druid/lib/log4j-slf4j-impl-2.1.jar:/opt/druid/lib/tesla-aether-0.0.5.jar:/opt/druid/lib/joda-time-2.6.jar:/opt/druid/lib/aether-connector-okhttp-0.0.9.jar:/opt/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:/opt/druid/lib/jline-0.9.94.jar:/opt/druid/lib/commons-pool2-2.2.jar:/opt/druid/lib/bytebuffer-collections-0.1.5.jar:/opt/druid/lib/commons-codec-1.7.jar:/opt/druid/lib/jersey-guice-1.17.1.jar:/opt/druid/lib/jackson-mapper-asl-1.9.13.jar:/opt/druid/lib/aether-util-0.9.0.M2.jar:/opt/druid/lib/maven-repository-metadata-3.1.1.jar:/opt/druid/lib/javax.el-api-3.0.0.jar:/opt/druid/lib/commons-dbcp2-2.0.1.jar:/opt/druid/lib/log4j-core-2.1.jar:/opt/druid/lib/curator-framework-2.7.0.jar:/opt/druid/lib/derby-10.11.1.1.jar:/opt/druid/lib/jackson-core-2.4.4.jar:/opt/druid/lib/jetty-continuation-9.2.5.v20141112.jar:/opt/druid/lib/httpclient-4.2.jar:/opt/druid/lib/plexus-interpolation-1.19.jar:/opt/druid/lib/jackson-jaxrs-json-provider-2.4.4.jar:/opt/druid/lib/activation-1.1.1.jar:/opt/druid/lib/guice-multibindings-4.0-beta.jar:/opt/druid/lib/druid-indexing-hadoop-0.7.0.jar:/opt/druid/lib/antlr4-runtime-4.0.jar:/opt/druid/lib/asm-3.1.jar:/opt/druid/lib/protobuf-java-2.5.0.jar:/opt/druid/lib/jetty-proxy-9.2.5.v20141112.jar:/opt/druid/lib/guice-4.0-beta.jar:/opt/druid/lib/plexus-utils-3.0.15.jar:/opt/druid/lib/org.abego.treelayout.core-1.0.1.jar:/opt/druid/lib/airline-0.6.jar:/opt/druid/lib/slf4j-api-1.6.4.jar:/opt/druid/lib/jetty-util-9.2.5.v20141112.jar:/opt/druid/lib/emitter-0.3.0.jar:/opt/druid/lib/jackson-module-jaxb-annotations-2.4.4.jar:/opt/druid/lib/log4j-1.2.16.jar:/opt/druid/lib/http-client-1.0.0.jar:/opt/druid/lib/jersey-server-1.17.1.jar:/opt/druid/lib/guava-16.0.1.jar:/opt/druid/lib/jetty-io-9.2.5.v20141112.jar:/opt/druid/lib/zookeeper-3.4.6.jar:/opt/druid/lib/jersey-core-1.17.1.jar:/opt/druid/lib/jackson-dataformat-smile-2.4.4.jar:/opt/druid/lib/aether-api-0.9.0.M2.jar:/opt/druid/lib/validation-api-1.1.0.Final.jar:/opt/druid/lib/javax.servlet-api-3.1.0.jar:/opt/druid/lib/maven-model-builder-3.1.1.jar:/opt/druid/lib/jackson-databind-2.4.4.jar:/opt/druid/lib/extendedset-1.3.8.jar:/opt/druid/lib/commons-io-2.0.1.jar:/opt/druid/lib/jetty-servlets-9.2.5.v20141112.jar:/opt/druid/lib/jetty-server-9.2.5.v20141112.jar:/opt/druid/lib/irc-api-1.0-0011.jar:/opt/druid/lib/javax.el-3.0.0.jar:/opt/druid/lib/commons-cli-1.2.jar:/opt/druid/lib/google-http-client-1.15.0-rc.jar:/opt/druid/lib/druid-aws-common-0.7.0.jar:/opt/druid/lib/netty-3.9.5.Final.jar:/opt/druid/lib/hibernate-validator-5.1.3.Final.jar:/opt/druid/lib/druid-services-0.7.0.jar:/opt/druid/lib/mapdb-1.0.6.jar:/opt/druid/lib/aws-java-sdk-1.8.11.jar:/opt/druid/lib/jetty-security-9.2.5.v20141112.jar:/opt/druid/lib/aether-connector-file-0.9.0.M2.jar:/opt/druid/lib/maven-model-3.1.1.jar:/opt/druid/lib/opencsv-2.3.jar:/opt/druid/lib/okhttp-1.0.2.jar:/opt/druid/lib/maven-aether-provider-3.1.1.jar:/opt/druid/lib/commons-logging-1.1.1.jar:/opt/druid/lib/java-xmlbuilder-0.4.jar:/opt/druid/lib/rhino-1.7R4.jar:/opt/druid/lib/jetty-http-9.2.5.v20141112.jar:/opt/druid/lib/wagon-provider-api-2.4.jar:/opt/druid/lib/geoip2-0.4.0.jar:/opt/druid/lib/jackson-jaxrs-base-2.4.4.jar:/opt/druid/lib/mail-1.4.7.jar:/opt/hadoop/etc/hadoop:/opt/hadoop/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/opt/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/opt/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/opt/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/opt/hadoop/share/hadoop/common/lib/zookeeper-3.4.5.jar:/opt/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-annotations-2.4.1.jar:/opt/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-auth-2.4.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/opt/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.4.1-tests.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.4.1.jar:/opt/hadoop/share/hadoop/common/hadoop-nfs-2.4.1.jar:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.4.1.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.4.1-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jline-0.9.94.jar:/opt/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/opt/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/hadoop/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.4.1.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/mapreduce/lib/junit-4.10.jar:/opt/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.4.1.jar:/contrib/capacity-scheduler/*.jar
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.16.7-tinycore64
2015-04-10T16:56:46,155 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2015-04-10T16:56:46,156 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2015-04-10T16:56:46,156 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/data
2015-04-10T16:56:46,156 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=192.168.59.103:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@5fe8d552
2015-04-10T16:56:46,173 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@149b5c66].
2015-04-10T16:56:46,175 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 192.168.59.103/192.168.59.103:2181. Will not attempt to authenticate using SASL (unknown error)
2015-04-10T16:56:46,182 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 192.168.59.103/192.168.59.103:2181, initiating session
2015-04-10T16:56:46,193 INFO [main-SendThread(192.168.59.103:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 192.168.59.103/192.168.59.103:2181, sessionid = 0x14ca44141600005, negotiated timeout = 30000
2015-04-10T16:56:46,197 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2015-04-10T16:56:47,301 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@37143859].
2015-04-10T16:56:47,303 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.client.ServerInventoryView.start() throws java.lang.Exception] on object[io.druid.client.BatchServerInventoryView@1d792a8e].
2015-04-10T16:56:47,309 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112
2015-04-10T16:56:47,378 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8083
2015-04-10T16:56:47,379 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8083', host='192.168.59.103:8083', maxSize=5000000000, tier='_default_tier', type='historical', priority='0'}]
2015-04-10T16:56:47,380 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8183
2015-04-10T16:56:47,380 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8183', host='192.168.59.103:8183', maxSize=5000000000, tier='_default_tier', type='historical', priority='0'}]
2015-04-10T16:56:47,410 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - Inventory Initialized
Apr 10, 2015 4:56:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
Apr 10, 2015 4:56:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.StatusResource as a root resource class
Apr 10, 2015 4:56:47 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.17.1 02/28/2013 12:47 PM'
Apr 10, 2015 4:56:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
Apr 10, 2015 4:56:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
Apr 10, 2015 4:56:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
Apr 10, 2015 4:56:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2015-04-10T16:56:48,212 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@3905ee13{/,null,AVAILABLE}
2015-04-10T16:56:48,220 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@3ed7988a{HTTP/1.1}{0.0.0.0:8100}
2015-04-10T16:56:48,220 INFO [main] org.eclipse.jetty.server.Server - Started @7417ms
2015-04-10T16:56:48,220 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@36b0dbe].
2015-04-10T16:56:48,224 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/192.168.59.103:8100]
2015-04-10T16:56:48,265 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@20640bf3].
2015-04-10T16:56:48,285 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/segments/192.168.59.103:8100
2015-04-10T16:56:48,288 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - New Server[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}]
2015-04-10T16:56:48,439 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:56:48,458 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.0', localRepository='/opt/druid/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T16:56:48,503 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_pageviews_2015-04-10T16:56:40.622Z",
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2015-04-10T16:56:40.601Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : { },
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
},
"hadoopDependencyCoordinates" : [ "org.apache.hadoop:hadoop-client:2.4.1" ],
"classpathPrefix" : null,
"groupId" : "index_hadoop_pageviews_2015-04-10T16:56:40.622Z",
"dataSource" : "pageviews",
"resource" : {
"availabilityGroup" : "index_hadoop_pageviews_2015-04-10T16:56:40.622Z",
"requiredCapacity" : 1
}
}
2015-04-10T16:56:48,508 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_pageviews_2015-04-10T16:56:40.622Z]: LockTryAcquireAction{interval=2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z}
2015-04-10T16:56:48,518 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_pageviews_2015-04-10T16:56:40.622Z] to overlord[http://192.168.59.103:8085/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z}
2015-04-10T16:56:48,537 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,578 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,579 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,580 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,582 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,583 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,584 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,585 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,586 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,587 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,588 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,592 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,595 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,597 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,598 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,598 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,599 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,601 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,603 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,603 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://192.168.59.103:8085
2015-04-10T16:56:48,688 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_pageviews_2015-04-10T16:56:40.622Z
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.4.1/hadoop-client-2.4.1.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T16:58:29,256 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.4/commons-io-2.4.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar]
2015-04-10T16:58:29,257 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.4.1/hadoop-auth-2.4.1.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2.5/httpcore-4.2.5.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T16:58:29,258 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar]
2015-04-10T16:58:29,259 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1/activation-1.1.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar]
2015-04-10T16:58:29,260 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid-0.7.0/lib/log4j-slf4j-impl-2.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2015-04-10T16:58:29,740 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:58:30,541 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.0', localRepository='/opt/druid/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T16:58:30,722 INFO [task-runner-0] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:postgresql-metadata-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T16:58:31,523 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/postgresql-metadata-storage/0.7.0/postgresql-metadata-storage-0.7.0.jar]
2015-04-10T16:58:31,524 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/postgresql/postgresql/9.3-1102-jdbc41/postgresql-9.3-1102-jdbc41.jar]
2015-04-10T16:58:31,524 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/jdbi/jdbi/2.32/jdbi-2.32.jar]
2015-04-10T16:58:31,527 INFO [task-runner-0] io.druid.initialization.Initialization - Adding extension module[class io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class[io.druid.initialization.DruidModule]
2015-04-10T16:58:31,527 INFO [task-runner-0] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule]
2015-04-10T16:58:31,823 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/druid/extensions/druid-hdfs-storage/0.7.0/druid-hdfs-storage-0.7.0.jar]
2015-04-10T16:58:31,824 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/net/java/dev/jets3t/jets3t/0.9.1/jets3t-0.9.1.jar]
2015-04-10T16:58:31,824 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar]
2015-04-10T16:58:31,824 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-core-asl/1.9.12/jackson-core-asl-1.9.12.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.12/jackson-mapper-asl-1.9.12.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/mx4j/mx4j/3.0.2/mx4j-3.0.2.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/mail/mail/1.4.7/mail-1.4.7.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar]
2015-04-10T16:58:31,825 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/bouncycastle/bcprov-jdk15/1.46/bcprov-jdk15-1.46.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpclient/4.2/httpclient-4.2.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/httpcomponents/httpcore/4.2/httpcore-4.2.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar]
2015-04-10T16:58:31,826 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-net/commons-net/3.1/commons-net-3.1.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar]
2015-04-10T16:58:31,827 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/tukaani/xz/1.0/xz-1.0.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar]
2015-04-10T16:58:31,828 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/sun/jersey/jersey-core/1.17.1/jersey-core-1.17.1.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/emitter/0.3.0/emitter-0.3.0.jar]
2015-04-10T16:58:31,829 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/metamx/http-client/1.0.0/http-client-1.0.0.jar]
2015-04-10T16:58:31,830 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/io/netty/netty/3.9.5.Final/netty-3.9.5.Final.jar]
2015-04-10T16:58:31,830 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar]
2015-04-10T16:58:31,830 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar]
2015-04-10T16:58:31,830 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar]
2015-04-10T16:58:31,830 INFO [task-runner-0] io.druid.initialization.Initialization - Added URL[file:/opt/druid/repository/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar]
2015-04-10T16:58:31,833 INFO [task-runner-0] io.druid.initialization.Initialization - Adding extension module[class io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule]
2015-04-10T16:58:32,397 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@1f2301d8]
2015-04-10T16:58:32,405 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2015-04-10T16:58:32,580 INFO [task-runner-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:58:32,598 INFO [task-runner-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:postgresql-metadata-storage, io.druid.extensions:druid-hdfs-storage], defaultVersion='0.7.0', localRepository='/opt/druid/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-10T16:58:32,598 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
WARN [org.apache.hadoop.util.NativeCodeLoader] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-04-10T16:58:33,125 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
2015-04-10T16:58:33,647 INFO [task-runner-0] io.druid.indexer.HadoopDruidDetermineConfigurationJob - DateTime[2015-03-24T00:00:00.000Z], spec[HadoopyShardSpec{actualSpec=NoneShardSpec, shardNum=0}]
2015-04-10T16:58:33,648 INFO [task-runner-0] io.druid.indexer.JobHelper - Deleting path[hdfs://192.168.59.103:9000/druid-working/pageviews/2015-04-10T165640.601Z]
2015-04-10T16:58:33,913 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_pageviews_2015-04-10T16:56:40.622Z]: LockListAction{}
2015-04-10T16:58:33,915 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_pageviews_2015-04-10T16:56:40.622Z] to overlord[http://192.168.59.103:8085/druid/indexer/v1/action]: LockListAction{}
2015-04-10T16:58:33,929 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Setting version to: 2015-04-10T16:56:40.697Z
2015-04-10T16:58:33,941 INFO [task-runner-0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "hdfs://192.168.59.103:9000/druid/pageviews"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "hdfs://192.168.59.103:9000/druid-working",
"version" : "2015-04-10T16:56:40.697Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : {
"2015-03-24T00:00:00.000Z" : [ {
"actualSpec" : {
"type" : "none"
},
"shardNum" : 0
} ]
},
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
}
}
2015-04-10T16:58:33,942 INFO [task-runner-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop index generator job...
2015-04-10T16:58:33,967 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
2015-04-10T16:58:33,970 INFO [task-runner-0] io.druid.indexer.HadoopDruidIndexerJob - No metadataStorageUpdaterJob set in the config. This is cool if you are running a hadoop index task, otherwise nothing will be uploaded to database.
2015-04-10T16:58:34,007 INFO [task-runner-0] io.druid.indexer.path.StaticPathSpec - Adding paths[hdfs://192.168.59.103:9000/data/events.json]
WARN [org.apache.hadoop.mapreduce.JobSubmitter] Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
WARN [org.apache.hadoop.mapreduce.JobSubmitter] No job jar file set. User classes may not be found. See Job or Job#setJar(String).
WARN [org.apache.hadoop.conf.Configuration] file:/tmp/hadoop-root/mapred/staging/root667327468/.staging/job_local667327468_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
WARN [org.apache.hadoop.conf.Configuration] file:/tmp/hadoop-root/mapred/staging/root667327468/.staging/job_local667327468_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
WARN [org.apache.hadoop.conf.Configuration] file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local667327468_0001/job_local667327468_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
WARN [org.apache.hadoop.conf.Configuration] file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local667327468_0001/job_local667327468_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-04-10T16:58:34,550 INFO [task-runner-0] io.druid.indexer.IndexGeneratorJob - Job pageviews-index-generator-Optional.of([2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z]) submitted, status available at http://localhost:8080/
2015-04-10T16:58:34,980 INFO [LocalJobRunner Map Task Executor #0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "hdfs://192.168.59.103:9000/druid/pageviews"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "hdfs://192.168.59.103:9000/druid-working",
"version" : "2015-04-10T16:56:40.697Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : {
"2015-03-24T00:00:00.000Z" : [ {
"actualSpec" : {
"type" : "none"
},
"shardNum" : 0
} ]
},
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
}
}
2015-04-10T16:58:35,254 INFO [pool-25-thread-1] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "pageviews",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "url" ],
"dimensionExclusions" : [ "timestamp", "eventId", "userId" ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "hyperUnique",
"name" : "userIdHll",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://192.168.59.103:9000/data/events.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "hdfs://192.168.59.103:9000/druid/pageviews"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "hdfs://192.168.59.103:9000/druid-working",
"version" : "2015-04-10T16:56:40.697Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : -1,
"maxPartitionSize" : -1,
"assumeGrouped" : false,
"numShards" : -1
},
"shardSpecs" : {
"2015-03-24T00:00:00.000Z" : [ {
"actualSpec" : {
"type" : "none"
},
"shardNum" : 0
} ]
},
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"persistInHeap" : false,
"ingestOffheap" : false,
"bufferSize" : 134217728,
"aggregationBufferRatio" : 0.5,
"rowFlushBoundary" : 80000
}
}
}
2015-04-10T16:58:35,303 INFO [pool-25-thread-1] io.druid.indexer.IndexGeneratorJob - 12 lines completed.
2015-04-10T16:58:35,309 INFO [pool-25-thread-1] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:58:35,327 INFO [pool-25-thread-1] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [io.druid.segment.data.BitmapSerde$DefaultBitmapSerdeFactory@42cab903]
2015-04-10T16:58:35,328 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - Starting persist for interval[2015-03-24T00:00:00.000Z/2015-03-25T00:00:00.000Z], rows[6]
2015-04-10T16:58:35,353 INFO [pool-25-thread-1] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-04-10T16:58:35,362 INFO [pool-25-thread-1] org.skife.config.ConfigurationObjectFactory - Assigning value [100000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2015-04-10T16:58:35,364 INFO [pool-25-thread-1] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2015-04-10T16:58:35,364 INFO [pool-25-thread-1] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2015-04-10T16:58:35,366 INFO [pool-25-thread-1] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2015-04-10T16:58:35,434 INFO [pool-25-thread-1] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [io.druid.segment.data.BitmapSerde$DefaultBitmapSerdeFactory@12eb9f06]
2015-04-10T16:58:35,434 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - outDir[/tmp/base4366206111758577357flush/merged/v8-tmp] completed index.drd in 90 millis.
2015-04-10T16:58:35,458 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - outDir[/tmp/base4366206111758577357flush/merged/v8-tmp] completed dim conversions in 24 millis.
2015-04-10T16:58:35,510 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - outDir[/tmp/base4366206111758577357flush/merged/v8-tmp] completed walk through of 6 rows in 52 millis.
2015-04-10T16:58:35,512 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - Starting dimension[url] with cardinality[3]
2015-04-10T16:58:35,520 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - Completed dimension[url] in 10 millis.
2015-04-10T16:58:35,520 INFO [pool-25-thread-1] io.druid.segment.IndexMerger - outDir[/tmp/base4366206111758577357flush/merged/v8-tmp] completed inverted.drd in 10 millis.
2015-04-10T16:58:35,527 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/base4366206111758577357flush/merged/v8-tmp] to v9[/tmp/base4366206111758577357flush/merged]
2015-04-10T16:58:35,529 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_url.drd]
2015-04-10T16:58:35,531 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[url] is single value, converting...
2015-04-10T16:58:35,539 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
2015-04-10T16:58:35,539 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
2015-04-10T16:58:35,539 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
2015-04-10T16:58:35,542 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_userIdHll_LITTLE_ENDIAN.drd]
2015-04-10T16:58:35,543 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
2015-04-10T16:58:35,543 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
2015-04-10T16:58:35,547 INFO [pool-25-thread-1] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
WARN [org.apache.hadoop.mapred.LocalJobRunner] job_local667327468_0001
java.lang.Exception: java.lang.IllegalArgumentException: Pathname /druid/pageviews/pageviews/2015-03-24T00:00:00.000Z_2015-03-25T00:00:00.000Z/2015-04-10T16:56:40.697Z/0 from hdfs://192.168.59.103:9000/druid/pageviews/pageviews/2015-03-24T00:00:00.000Z_2015-03-25T00:00:00.000Z/2015-04-10T16:56:40.697Z/0 is not a valid DFS filename.
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: java.lang.IllegalArgumentException: Pathname /druid/pageviews/pageviews/2015-03-24T00:00:00.000Z_2015-03-25T00:00:00.000Z/2015-04-10T16:56:40.697Z/0 from hdfs://192.168.59.103:9000/druid/pageviews/pageviews/2015-03-24T00:00:00.000Z_2015-03-25T00:00:00.000Z/2015-04-10T16:56:40.697Z/0 is not a valid DFS filename.
at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:194)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:102)
at org.apache.hadoop.hdfs.DistributedFileSystem$16.doCall(DistributedFileSystem.java:827)
at org.apache.hadoop.hdfs.DistributedFileSystem$16.doCall(DistributedFileSystem.java:823)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:823)
at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:816)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1815)
at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.serializeOutIndex(IndexGeneratorJob.java:441)
at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:418)
at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:275)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-04-10T16:58:35,605 INFO [task-runner-0] io.druid.indexer.JobHelper - Deleting path[hdfs://192.168.59.103:9000/druid-working/pageviews/2015-04-10T165640.697Z]
2015-04-10T16:58:35,626 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_pageviews_2015-04-10T16:56:40.622Z, type=index_hadoop, dataSource=pageviews}]
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_76]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_76]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_76]
at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_76]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:256) ~[druid-indexing-service-0.7.0.jar:0.7.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:235) [druid-indexing-service-0.7.0.jar:0.7.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:214) [druid-indexing-service-0.7.0.jar:0.7.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_76]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_76]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_76]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
Caused by: com.metamx.common.ISE: Job[class io.druid.indexer.LegacyIndexGeneratorJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:153) ~[druid-indexing-hadoop-0.7.0.jar:0.7.0]
at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.7.0.jar:0.7.0]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:304) ~[druid-indexing-service-0.7.0.jar:0.7.0]
... 11 more
2015-04-10T16:58:35,635 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_pageviews_2015-04-10T16:56:40.622Z",
"status" : "FAILED",
"duration" : 106943
}
2015-04-10T16:58:35,640 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@36b0dbe].
2015-04-10T16:58:35,640 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2015-04-10T16:58:35,640 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/192.168.59.103:8100]
2015-04-10T16:58:35,649 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@20640bf3].
2015-04-10T16:58:35,657 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - Server Disappeared[DruidServerMetadata{name='192.168.59.103:8100', host='192.168.59.103:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}]
2015-04-10T16:58:35,663 INFO [main] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@3ed7988a{HTTP/1.1}{0.0.0.0:8100}
2015-04-10T16:58:35,666 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@3905ee13{/,null,UNAVAILABLE}
2015-04-10T16:58:35,696 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@7147090b].
2015-04-10T16:58:35,698 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.client.ServerInventoryView.stop() throws java.io.IOException] on object[io.druid.client.BatchServerInventoryView@1d792a8e].
2015-04-10T16:58:35,698 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@37143859].
2015-04-10T16:58:35,700 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@149b5c66].
2015-04-10T16:58:35,703 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2015-04-10T16:58:35,708 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x14ca44141600005 closed
2015-04-10T16:58:35,708 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2015-04-10T16:58:35,709 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@397cec35].
2015-04-10T16:58:35,737 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@6a5061e1].
2015-04-10T16:58:35,737 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@3ce914bc].
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment