Skip to content

Instantly share code, notes, and snippets.

@KenjiTakahashi
Created October 6, 2017 13:55
Show Gist options
  • Save KenjiTakahashi/602a3d29055a18855e3cb6e9ccc254ac to your computer and use it in GitHub Desktop.
Save KenjiTakahashi/602a3d29055a18855e3cb6e9ccc254ac to your computer and use it in GitHub Desktop.
2017-10-06T13:47:06,084 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-10-06T13:47:06,087 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
paź 06, 2017 1:47:06 PM org.hibernate.validator.internal.util.Version <clinit>
INFO: HV000001: Hibernate Validator 5.1.3.Final
2017-10-06T13:47:06,766 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-s3-extensions, postgresql-metadata-storage, druid-rabbitmq]}]
2017-10-06T13:47:06,850 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-s3-extensions] for class [interface io.druid.cli.CliCommandCreator]
2017-10-06T13:47:06,863 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/druid-s3-extensions/druid-s3-extensions-0.11.0-SNAPSHOT.jar]
2017-10-06T13:47:06,864 INFO [main] io.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface io.druid.cli.CliCommandCreator]
2017-10-06T13:47:06,865 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar]
2017-10-06T13:47:06,865 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.11.0-SNAPSHOT.jar]
2017-10-06T13:47:06,866 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-rabbitmq] for class [interface io.druid.cli.CliCommandCreator]
2017-10-06T13:47:06,866 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/druid-rabbitmq/amqp-client-3.2.1.jar]
2017-10-06T13:47:06,867 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/druid-rabbitmq/lyra-0.3.1.jar]
2017-10-06T13:47:06,867 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/whdruid/druid-0.11.0-SNAPSHOT/extensions/druid-rabbitmq/druid-rabbitmq-0.11.0-SNAPSHOT.jar]
2017-10-06T13:47:06,977 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2017-10-06T13:47:07,138 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-s3-extensions] for class [interface io.druid.initialization.DruidModule]
2017-10-06T13:47:07,336 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.storage.s3.S3StorageDruidModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2017-10-06T13:47:07,337 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.firehose.s3.S3FirehoseDruidModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2017-10-06T13:47:07,337 INFO [main] io.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface io.druid.initialization.DruidModule]
2017-10-06T13:47:07,339 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2017-10-06T13:47:07,339 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-rabbitmq] for class [interface io.druid.initialization.DruidModule]
2017-10-06T13:47:07,341 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.firehose.rabbitmq.RabbitMQDruidModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2017-10-06T13:47:08,757 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-10-06T13:47:08,785 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain='null', escalatedAuthenticator='allowAll', authorizers='null'}]
2017-10-06T13:47:08,797 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@74075134]
2017-10-06T13:47:08,807 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@2f2d52ef]
2017-10-06T13:47:08,895 INFO [main] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode
2017-10-06T13:47:08,898 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2017-10-06T13:47:09,026 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}]
2017-10-06T13:47:09,038 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/peon', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}]
2017-10-06T13:47:09,046 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2017-10-06T13:47:09,059 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@17b6d426]
2017-10-06T13:47:09,071 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2017-10-06T13:47:09,071 INFO [main] io.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: LoggingEmitter{log=com.metamx.common.logger.Logger@4554de02, level=INFO}
2017-10-06T13:47:09,074 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@58496c97]
2017-10-06T13:47:09,201 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2017-10-06T13:47:09,248 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@6daf7d37]
2017-10-06T13:47:09,479 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@2bc378f7]
2017-10-06T13:47:09,489 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@67514bdd]
2017-10-06T13:47:09,490 INFO [main] io.druid.cli.CliPeon - Starting up with processors[4], memory[1,029,177,344], maxMemory[1,029,177,344].
2017-10-06T13:47:09,502 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@a2341c6]
2017-10-06T13:47:09,511 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@7b122839]
2017-10-06T13:47:09,660 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@608fe01f]
2017-10-06T13:47:09,728 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@4fe64d23]
2017-10-06T13:47:09,738 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.aws.AWSCredentialsConfig] from props[druid.s3.] as [io.druid.common.aws.AWSCredentialsConfig@6deee370]
2017-10-06T13:47:09,839 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentPusherConfig@7c3e4b1a]
2017-10-06T13:47:09,841 INFO [main] io.druid.storage.s3.S3DataSegmentPusher - Configured S3 as deep storage
2017-10-06T13:47:09,846 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@51c8f62c]
2017-10-06T13:47:09,852 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentArchiverConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentArchiverConfig@6fbc1bb]
2017-10-06T13:47:09,860 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@2d55e826]
2017-10-06T13:47:09,868 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@37ad042b]
2017-10-06T13:47:09,875 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@47ac613b]
2017-10-06T13:47:09,878 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@6bccd036]
2017-10-06T13:47:09,882 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@361abd01]
2017-10-06T13:47:09,885 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [250000000] for [druid.computation.buffer.size] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-10-06T13:47:09,889 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-10-06T13:47:09,890 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-10-06T13:47:09,891 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2017-10-06T13:47:09,891 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2017-10-06T13:47:09,891 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-10-06T13:47:09,891 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-10-06T13:47:09,892 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-10-06T13:47:10,003 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@6587305a]
2017-10-06T13:47:10,016 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@2b0e9f30]
2017-10-06T13:47:10,023 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2017-10-06T13:47:10,030 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.TLSServerConfig] from props[druid.server.https.] as [TLSServerConfig{keyStorePath='null', keyStoreType='null', certAlias='null', keyManagerFactoryAlgorithm='null'}]
2017-10-06T13:47:10,048 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5130ms
2017-10-06T13:47:10,066 INFO [main] io.druid.server.initialization.jetty.JettyServerModule - Creating http connector with port [8100]
2017-10-06T13:47:10,327 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.SearchQueryConfig@6e60f18]
2017-10-06T13:47:10,335 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@32456db0]
2017-10-06T13:47:10,341 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [GroupByQueryConfig{defaultStrategy='v2', singleThreaded=false, maxIntermediateRows=50000, maxResults=500000, bufferGrouperMaxSize=2147483647, bufferGrouperMaxLoadFactor=0.0, bufferGrouperInitialBuckets=0, maxMergingDictionarySize=100000000, maxOnDiskStorage=0, forcePushDownLimit=false, forceHashAggregation=false}]
2017-10-06T13:47:10,365 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[250,000,000]
2017-10-06T13:47:10,548 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[250,000,000]
2017-10-06T13:47:10,672 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[250,000,000]
2017-10-06T13:47:10,796 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[250,000,000]
2017-10-06T13:47:10,920 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.scan.ScanQueryConfig] from props[druid.query.scan.] as [ScanQueryConfig{legacy=false}]
2017-10-06T13:47:10,924 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [io.druid.query.select.SelectQueryConfig@438c9aa7]
2017-10-06T13:47:10,926 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@2da99821]
2017-10-06T13:47:10,931 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@6cbbb9c4]
2017-10-06T13:47:10,954 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[LoggingEmitter{log=com.metamx.common.logger.Logger@4554de02, level=INFO}].
2017-10-06T13:47:10,954 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2017-10-06T13:47:10,956 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2017-10-06T13:47:10,956 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2017-10-06T13:47:10,967 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2017-10-06T13:47:10,967 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=demopm1-lin
2017-10-06T13:47:10,967 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_131
2017-10-06T13:47:10,967 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-10-06T13:47:10,967 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-oracle-1.8.0.131/jre
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=../config/_common:../config/coordinator:lib/plexus-utils-3.0.15.jar:lib/json-path-2.1.0.jar:lib/rhino-1.7R5.jar:lib/java-xmlbuilder-1.1.jar:lib/maven-repository-metadata-3.1.1.jar:lib/java-util-0.11.0-SNAPSHOT.jar:lib/derby-10.11.1.1.jar:lib/base64-2.3.8.jar:lib/server-metrics-0.5.2.jar:lib/extendedset-0.11.0-SNAPSHOT.jar:lib/commons-io-2.5.jar:lib/RoaringBitmap-0.5.18.jar:lib/joda-time-2.9.9.jar:lib/curator-x-discovery-4.0.0.jar:lib/jcodings-1.0.13.jar:lib/jackson-jq-0.0.7.jar:lib/irc-api-1.0-0014.jar:lib/maven-aether-provider-3.1.1.jar:lib/jsr311-api-1.1.1.jar:lib/slf4j-api-1.6.4.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/log4j-api-2.5.jar:lib/druid-processing-0.11.0-SNAPSHOT.jar:lib/antlr4-runtime-4.5.1.jar:lib/jetty-security-9.3.19.v20170502.jar:lib/guice-multibindings-4.1.0.jar:lib/druid-sql-0.11.0-SNAPSHOT.jar:lib/jackson-databind-2.4.6.jar:lib/jline-0.9.94.jar:lib/httpclient-4.5.1.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/jackson-dataformat-cbor-2.5.3.jar:lib/javax.el-api-3.0.0.jar:lib/jsr305-2.0.1.jar:lib/javax.el-3.0.0.jar:lib/aether-spi-0.9.0.M2.jar:lib/bytebuffer-collections-0.11.0-SNAPSHOT.jar:lib/druid-server-0.11.0-SNAPSHOT.jar:lib/log4j-core-2.5.jar:lib/druid-services-0.11.0-SNAPSHOT.jar:lib/aether-impl-0.9.0.M2.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/curator-recipes-4.0.0.jar:lib/emitter-0.6.0.jar:lib/asm-commons-5.2.jar:lib/jackson-annotations-2.4.6.jar:lib/maven-settings-3.1.1.jar:lib/aopalliance-1.0.jar:lib/joni-2.1.11.jar:lib/fastutil-7.2.0.jar:lib/commons-dbcp-1.4.jar:lib/aggdesigner-algorithm-6.0.jar:lib/guice-4.1.0.jar:lib/jets3t-0.9.4.jar:lib/httpcore-4.4.3.jar:lib/log4j-1.2-api-2.5.jar:lib/jackson-core-asl-1.9.13.jar:lib/asm-tree-5.2.jar:lib/jetty-proxy-9.3.19.v20170502.jar:lib/jackson-core-2.4.6.jar:lib/javax.inject-1.jar:lib/lz4-1.3.0.jar:lib/wagon-provider-api-2.4.jar:lib/commons-codec-1.7.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/jetty-http-9.3.19.v20170502.jar:lib/calcite-linq4j-1.12.0.jar:lib/maven-model-builder-3.1.1.jar:lib/aether-util-0.9.0.M2.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/jersey-server-1.19.3.jar:lib/spymemcached-2.12.3.jar:lib/derbynet-10.11.1.1.jar:lib/maven-model-3.1.1.jar:lib/http-client-1.1.0.jar:lib/druid-common-0.11.0-SNAPSHOT.jar:lib/druid-aws-common-0.11.0-SNAPSHOT.jar:lib/commons-lang3-3.2.jar:lib/jboss-logging-3.1.3.GA.jar:lib/commons-pool2-2.2.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/asm-5.2.jar:lib/airline-0.7.jar:lib/protobuf-java-3.1.0.jar:lib/jersey-guice-1.19.3.jar:lib/opencsv-2.3.jar:lib/commons-logging-1.1.1.jar:lib/maxminddb-0.2.0.jar:lib/druid-indexing-service-0.11.0-SNAPSHOT.jar:lib/jetty-servlets-9.3.19.v20170502.jar:lib/derbyclient-10.11.1.1.jar:lib/icu4j-54.1.1.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/zookeeper-3.4.10.jar:lib/plexus-interpolation-1.19.jar:lib/druid-console-0.0.2.jar:lib/jetty-server-9.3.19.v20170502.jar:lib/aws-java-sdk-ec2-1.10.77.jar:lib/disruptor-3.3.6.jar:lib/avatica-metrics-1.9.0.jar:lib/geoip2-0.4.0.jar:lib/avatica-core-1.9.0.jar:lib/classmate-1.0.0.jar:lib/avatica-server-1.9.0.jar:lib/jersey-servlet-1.19.3.jar:lib/commons-compiler-2.7.6.jar:lib/guava-16.0.1.jar:lib/commons-math3-3.6.1.jar:lib/okhttp-1.0.2.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/javax.servlet-api-3.1.0.jar:lib/janino-2.7.6.jar:lib/jdbi-2.63.1.jar:lib/aether-api-0.9.0.M2.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/guice-servlet-4.1.0.jar:lib/aws-java-sdk-core-1.10.77.jar:lib/jetty-servlet-9.3.19.v20170502.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/druid-api-0.11.0-SNAPSHOT.jar:lib/config-magic-0.9.jar:lib/log4j-slf4j-impl-2.5.jar:lib/activation-1.1.1.jar:lib/commons-pool-1.6.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-client-9.3.19.v20170502.jar:lib/netty-3.10.6.Final.jar:lib/netty-all-4.1.11.Final.jar:lib/druid-hll-0.11.0-SNAPSHOT.jar:lib/calcite-core-1.12.0.jar:lib/validation-api-1.1.0.Final.jar:lib/curator-client-4.0.0.jar:lib/commons-dbcp2-2.0.1.jar:lib/java-util-0.28.2.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/jetty-continuation-9.3.19.v20170502.jar:lib/maven-settings-builder-3.1.1.jar:lib/mapdb-1.0.8.jar:lib/jetty-util-9.3.19.v20170502.jar:lib/jetty-io-9.3.19.v20170502.jar:lib/commons-cli-1.2.jar:lib/curator-framework-4.0.0.jar:lib/bcprov-jdk15on-1.52.jar:lib/jersey-core-1.19.3.jar:lib/druid-indexing-hadoop-0.11.0-SNAPSHOT.jar:lib/compress-lzf-1.0.3.jar:lib/commons-lang-2.6.jar:lib/log4j-jul-2.5.jar:lib/jvm-attach-api-1.2.jar:lib/jackson-datatype-guava-2.4.6.jar
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.9.0-3-amd64
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=whdruid
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/whdruid
2017-10-06T13:47:10,968 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/whdruid/druid-0.11.0-SNAPSHOT
2017-10-06T13:47:10,969 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=sv-zookeeper sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@1989e8c6
2017-10-06T13:47:10,989 INFO [main-SendThread(demopm1-lin:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server demopm1-lin/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2017-10-06T13:47:10,993 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2017-10-06T13:47:10,993 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@d611f1c].
2017-10-06T13:47:10,994 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[ServiceEmitter{serviceDimensions={service=druid/peon, host=demopm1-lin:8100, version=0.11.0-SNAPSHOT}, emitter=LoggingEmitter{log=com.metamx.common.logger.Logger@4554de02, level=INFO}}].
2017-10-06T13:47:10,994 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@4f2d014a].
2017-10-06T13:47:10,994 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2017-10-06T13:47:10,995 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2017-10-06T13:47:10,996 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@28e0e464].
2017-10-06T13:47:10,998 INFO [main-SendThread(demopm1-lin:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to demopm1-lin/127.0.0.1:2181, initiating session
2017-10-06T13:47:11,005 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@8bd076a].
2017-10-06T13:47:11,005 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider.start()] on object[io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider@1de4285e].
2017-10-06T13:47:11,005 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - starting
2017-10-06T13:47:11,005 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - started
2017-10-06T13:47:11,006 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@634ff56].
2017-10-06T13:47:11,031 INFO [main-SendThread(demopm1-lin:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server demopm1-lin/127.0.0.1:2181, sessionid = 0x15eed016893010f, negotiated timeout = 30000
2017-10-06T13:47:11,039 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2017-10-06T13:47:11,171 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.discovery.DruidLeaderClient.start()] on object[io.druid.discovery.DruidLeaderClient@47248a48].
2017-10-06T13:47:11,175 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [overlord].
2017-10-06T13:47:11,178 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [overlord].
2017-10-06T13:47:11,178 INFO [main] io.druid.discovery.DruidLeaderClient - Started.
2017-10-06T13:47:11,180 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@609319c3].
2017-10-06T13:47:11,180 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@6bbab114].
2017-10-06T13:47:11,195 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.discovery.DruidLeaderClient.start()] on object[io.druid.discovery.DruidLeaderClient@25f61c2c].
2017-10-06T13:47:11,195 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [coordinator].
2017-10-06T13:47:11,196 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [coordinator].
2017-10-06T13:47:11,197 INFO [main] io.druid.discovery.DruidLeaderClient - Started.
2017-10-06T13:47:11,200 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@d7bbf12].
2017-10-06T13:47:11,219 INFO [NodeTypeWatcher[overlord]] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received event [CHILD_ADDED] for Node[overlord:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='demopm1-lin', plaintextPort=10040, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='overlord', services={}}].
2017-10-06T13:47:11,220 INFO [NodeTypeWatcher[overlord]] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher for type [overlord].
2017-10-06T13:47:11,223 INFO [NodeTypeWatcher[coordinator]] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received event [CHILD_ADDED] for Node[coordinator:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='demopm1-lin', plaintextPort=10040, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='coordinator', services={}}].
2017-10-06T13:47:11,223 INFO [NodeTypeWatcher[coordinator]] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher for type [coordinator].
2017-10-06T13:47:11,260 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_realtime",
"id" : "index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif",
"resource" : {
"availabilityGroup" : "index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif",
"requiredCapacity" : 1
},
"spec" : {
"dataSchema" : {
"dataSource" : "logdb_data",
"parser" : {
"type" : "map",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "millis"
},
"dimensionsSpec" : {
"dimensions" : [ "config_id", "stream_name" ],
"dimensionExclusions" : [ ],
"spatialDimensions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "doubleSum",
"name" : "data_num",
"fieldName" : "data_num",
"expression" : null
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : null
}
},
"ioConfig" : {
"type" : "realtime",
"firehose" : {
"type" : "receiver",
"serviceName" : "whdruid_receiver",
"bufferSize" : 100000
},
"firehoseV2" : null
},
"tuningConfig" : {
"type" : "realtime",
"maxRowsInMemory" : 75000,
"intermediatePersistPeriod" : "PT10M",
"windowPeriod" : "PT10M",
"basePersistDirectory" : "/tmp/1507297624900-0",
"versioningPolicy" : {
"type" : "intervalStart"
},
"rejectionPolicy" : {
"type" : "none"
},
"maxPendingPersists" : 0,
"shardSpec" : {
"type" : "none"
},
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"buildV9Directly" : true,
"persistThreadPriority" : 0,
"mergeThreadPriority" : 0,
"reportParseExceptions" : false,
"handoffConditionTimeout" : 0,
"alertTimeout" : 0
}
},
"context" : null,
"groupId" : "index_realtime_logdb_data",
"dataSource" : "logdb_data"
}
2017-10-06T13:47:11,262 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/persistent/task/index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif/lock].
2017-10-06T13:47:11,265 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/persistent/task/index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif/lock] in 3ms.
2017-10-06T13:47:11,270 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif
2017-10-06T13:47:11,271 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif] location changed to [TaskLocation{host='demopm1-lin', port=8100, tlsPort=-1}].
2017-10-06T13:47:11,272 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif] status changed to [RUNNING].
2017-10-06T13:47:11,280 INFO [main] org.eclipse.jetty.server.Server - jetty-9.3.19.v20170502
2017-10-06T13:47:11,340 INFO [task-runner-0-priority-0] io.druid.segment.realtime.plumber.RealtimePlumber - Creating plumber using rejectionPolicy[io.druid.segment.realtime.plumber.NoopRejectionPolicyFactory$1@4c8fff24]
2017-10-06T13:47:11,349 INFO [task-runner-0-priority-0] io.druid.server.coordination.CuratorDataSegmentServerAnnouncer - Announcing self[DruidServerMetadata{name='demopm1-lin:8100', hostAndPort='demopm1-lin:8100', hostAndTlsPort='null', maxSize=0, tier='_default_tier', type=realtime, priority=0}] at [/druid/announcements/demopm1-lin:8100]
2017-10-06T13:47:11,414 INFO [task-runner-0-priority-0] io.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announcing [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/peon', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='peon', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=realtime, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2017-10-06T13:47:11,452 INFO [task-runner-0-priority-0] io.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announced [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/peon', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='peon', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=realtime, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2017-10-06T13:47:11,456 INFO [task-runner-0-priority-0] io.druid.segment.realtime.plumber.RealtimePlumber - Expect to run at [2017-10-07T00:10:00.000Z]
2017-10-06T13:47:11,466 INFO [task-runner-0-priority-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2017-10-06T13:47:11,466 INFO [task-runner-0-priority-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2017-10-06T13:47:11,467 INFO [task-runner-0-priority-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.initialization.jetty.ForbiddenExceptionMapper as a provider class
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.StatusResource as a root resource class
paź 06, 2017 1:47:11 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.initialization.jetty.ForbiddenExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
paź 06, 2017 1:47:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-10-06T13:47:11,810 INFO [task-runner-0-priority-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Connecting firehose: whdruid_receiver
2017-10-06T13:47:11,813 INFO [task-runner-0-priority-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Found chathandler of class[io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider]
2017-10-06T13:47:11,813 INFO [task-runner-0-priority-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[whdruid_receiver]
2017-10-06T13:47:11,815 INFO [task-runner-0-priority-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='whdruid_receiver', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}]
2017-10-06T13:47:11,884 INFO [task-runner-0-priority-0] io.druid.server.metrics.EventReceiverFirehoseRegister - Registering EventReceiverFirehoseMetric for service [whdruid_receiver]
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.http.SegmentListerResource to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.http.security.ConfigResourceFilter to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
paź 06, 2017 1:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
paź 06, 2017 1:47:12 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void io.druid.server.http.SegmentListerResource.getSegments(long,long,long,javax.servlet.http.HttpServletRequest) throws java.io.IOException, MUST return a non-void type.
2017-10-06T13:47:12,248 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@58b311ba{/,null,AVAILABLE}
2017-10-06T13:47:12,262 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@37554e7a{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-10-06T13:47:12,262 INFO [main] org.eclipse.jetty.server.Server - Started @7346ms
2017-10-06T13:47:12,263 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@560271a1].
2017-10-06T13:47:12,270 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/http:demopm1-lin:8100]
2017-10-06T13:47:13,582 INFO [task-runner-0-priority-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif]: SegmentAllocateAction{dataSource='logdb_data', timestamp=2017-09-07T00:00:00.000Z, queryGranularity=NoneGranularity, preferredSegmentGranularity={type=period, period=P1D, timeZone=UTC, origin=null}, sequenceName='index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif', previousSegmentId='null'}
2017-10-06T13:47:13,606 INFO [task-runner-0-priority-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif] to overlord: [SegmentAllocateAction{dataSource='logdb_data', timestamp=2017-09-07T00:00:00.000Z, queryGranularity=NoneGranularity, preferredSegmentGranularity={type=period, period=P1D, timeZone=UTC, origin=null}, sequenceName='index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif', previousSegmentId='null'}].
2017-10-06T13:47:13,635 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,714 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,716 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,720 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,726 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,728 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,729 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,741 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,742 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,744 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,748 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,753 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,761 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,766 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,768 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,769 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,771 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,783 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,784 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,785 INFO [task-runner-0-priority-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://demopm1-lin:10040
2017-10-06T13:47:13,900 WARN [task-runner-0-priority-0] io.druid.segment.realtime.SegmentTracker - Cannot allocate segment for timestamp[2017-09-07T00:00:00.000Z], sequenceName[index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif].
2017-10-06T13:47:13,909 ERROR [task-runner-0-priority-0] io.druid.indexing.common.task.RealtimeIndexTask - Exception aborted realtime processing[logdb_data]: {class=io.druid.indexing.common.task.RealtimeIndexTask, exceptionType=class java.lang.NullPointerException, exceptionMessage=null}
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) ~[?:1.8.0_131]
at io.druid.segment.realtime.plumber.RealtimePlumber.getSink(RealtimePlumber.java:255) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.segment.realtime.plumber.RealtimePlumber.add(RealtimePlumber.java:238) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.segment.realtime.plumber.Plumbers.addNextRow(Plumbers.java:77) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:350) [druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
2017-10-06T13:47:13,932 INFO [task-runner-0-priority-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"alerts","timestamp":"2017-10-06T13:47:13.916Z","service":"druid/peon","host":"demopm1-lin:8100","version":"0.11.0-SNAPSHOT","severity":"component-failure","description":"Exception aborted realtime processing[logdb_data]","data":{"class":"io.druid.indexing.common.task.RealtimeIndexTask","exceptionType":"java.lang.NullPointerException","exceptionMessage":null,"exceptionStackTrace":"java.lang.NullPointerException\n\tat java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)\n\tat io.druid.segment.realtime.plumber.RealtimePlumber.getSink(RealtimePlumber.java:255)\n\tat io.druid.segment.realtime.plumber.RealtimePlumber.add(RealtimePlumber.java:238)\n\tat io.druid.segment.realtime.plumber.Plumbers.addNextRow(Plumbers.java:77)\n\tat io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:350)\n\tat io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)\n\tat io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)\n\tat java.lang.Thread.run(Thread.java:748)\n"}}]
2017-10-06T13:47:13,932 INFO [task-runner-0-priority-0] io.druid.server.coordination.CuratorDataSegmentServerAnnouncer - Unannouncing self[DruidServerMetadata{name='demopm1-lin:8100', hostAndPort='demopm1-lin:8100', hostAndTlsPort='null', maxSize=0, tier='_default_tier', type=realtime, priority=0}] at [/druid/announcements/demopm1-lin:8100]
2017-10-06T13:47:13,932 INFO [task-runner-0-priority-0] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/demopm1-lin:8100]
2017-10-06T13:47:13,987 INFO [task-runner-0-priority-0] io.druid.curator.discovery.CuratorDruidNodeAnnouncer - Unannouncing [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/peon', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='peon', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=realtime, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2017-10-06T13:47:13,987 INFO [task-runner-0-priority-0] io.druid.curator.announcement.Announcer - unannouncing [/druid/internal-discovery/peon/demopm1-lin:8100]
2017-10-06T13:47:14,005 INFO [task-runner-0-priority-0] io.druid.curator.discovery.CuratorDruidNodeAnnouncer - Unannounced [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/peon', host='demopm1-lin', plaintextPort=8100, tlsPort=-1, serverConfig=ServerConfig{numThreads=40, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807, plaintext=true, tls=false}}, nodeType='peon', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=realtime, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2017-10-06T13:47:14,007 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[RealtimeIndexTask{id=index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif, type=index_realtime, dataSource=logdb_data}]
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) ~[?:1.8.0_131]
at io.druid.segment.realtime.plumber.RealtimePlumber.getSink(RealtimePlumber.java:255) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.segment.realtime.plumber.RealtimePlumber.add(RealtimePlumber.java:238) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.segment.realtime.plumber.Plumbers.addNextRow(Plumbers.java:77) ~[druid-server-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:350) ~[druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.11.0-SNAPSHOT.jar:0.11.0-SNAPSHOT]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
2017-10-06T13:47:14,008 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif] status changed to [FAILED].
2017-10-06T13:47:14,013 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_realtime_logdb_data_0_2017-10-06T13:47:04.901Z_hmlgmnif",
"status" : "FAILED",
"duration" : 2738
}
2017-10-06T13:47:14,024 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@560271a1].
2017-10-06T13:47:14,024 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/http:demopm1-lin:8100]
2017-10-06T13:47:14,039 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/http:demopm1-lin:8100]
2017-10-06T13:47:14,048 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@37554e7a{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-10-06T13:47:14,050 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@58b311ba{/,null,UNAVAILABLE}
2017-10-06T13:47:14,056 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@d7bbf12].
2017-10-06T13:47:14,057 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@1ee5632d].
2017-10-06T13:47:14,058 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.discovery.DruidLeaderClient.stop()] on object[io.druid.discovery.DruidLeaderClient@25f61c2c].
2017-10-06T13:47:14,058 INFO [main] io.druid.discovery.DruidLeaderClient - Stopped.
2017-10-06T13:47:14,058 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@6bbab114].
2017-10-06T13:47:14,061 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@609319c3].
2017-10-06T13:47:14,061 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.discovery.DruidLeaderClient.stop()] on object[io.druid.discovery.DruidLeaderClient@47248a48].
2017-10-06T13:47:14,062 INFO [main] io.druid.discovery.DruidLeaderClient - Stopped.
2017-10-06T13:47:14,062 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@634ff56].
2017-10-06T13:47:14,062 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider.stop()] on object[io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider@1de4285e].
2017-10-06T13:47:14,062 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - stopping
2017-10-06T13:47:14,063 INFO [main] io.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - stopped
2017-10-06T13:47:14,063 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@8bd076a].
2017-10-06T13:47:14,102 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@28e0e464].
2017-10-06T13:47:14,110 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@4f2d014a].
2017-10-06T13:47:14,110 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopping.
2017-10-06T13:47:14,110 INFO [LookupReferencesManager-MainThread] io.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited, Lookup notices are not handled anymore.
2017-10-06T13:47:14,111 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopped.
2017-10-06T13:47:14,111 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[ServiceEmitter{serviceDimensions={service=druid/peon, host=demopm1-lin:8100, version=0.11.0-SNAPSHOT}, emitter=LoggingEmitter{log=com.metamx.common.logger.Logger@4554de02, level=INFO}}].
2017-10-06T13:47:14,111 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2017-10-06T13:47:14,111 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@d611f1c].
@kevinconaway
Copy link

I think you need to enable DEBUG logging on io.druid.indexing.common.actions.SegmentAllocateAction to get more information on why the segment can't be allocated.

If you can reproduce this locally, it might be helpful to step through SegmentAllocateAction to see where its failing.

@kevinconaway
Copy link

@KenjiTakahashi were you able to learn anything from the DEBUG logs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment