Skip to content

Instantly share code, notes, and snippets.

@giaosudau

giaosudau/druid task log

Created August 11, 2016 08:48
Show Gist options
  • Save giaosudau/a9255367bd131ff85ad39264d2965720 to your computer and use it in GitHub Desktop.
Save giaosudau/a9255367bd131ff85ad39264d2965720 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
druid task log
2016-08-11T01:22:00,555 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2016-08-11T01:22:00,557 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2016-08-11T01:22:00,592 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2016-08-11T01:22:01,143 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='dist/druid/extensions', hadoopDependenciesDir='dist/druid/hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-datasketches, druid-avro-extensions, druid-parquet-extensions, postgresql-metadata-storage, druid-hdfs-storage]}]
2016-08-11T01:22:01,150 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.cli.CliCommandCreator]
2016-08-11T01:22:01,161 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-datasketches/sketches-core-0.2.2.jar]
2016-08-11T01:22:01,161 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-datasketches/druid-datasketches-0.9.1.1.jar]
2016-08-11T01:22:01,163 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-avro-extensions] for class [io.druid.cli.CliCommandCreator]
2016-08-11T01:22:01,163 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/schema-repo-avro-0.1.3.jar]
2016-08-11T01:22:01,164 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/druid-avro-extensions-0.9.1.1.jar]
2016-08-11T01:22:01,164 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jackson-core-asl-1.9.13.jar]
2016-08-11T01:22:01,164 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/schema-repo-common-0.1.3.jar]
2016-08-11T01:22:01,164 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jetty-6.1.26.jar]
2016-08-11T01:22:01,165 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/xz-1.0.jar]
2016-08-11T01:22:01,165 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/schema-repo-client-0.1.3.jar]
2016-08-11T01:22:01,165 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jersey-client-1.15.jar]
2016-08-11T01:22:01,165 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jackson-mapper-asl-1.9.13.jar]
2016-08-11T01:22:01,165 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/commons-collections-3.2.1.jar]
2016-08-11T01:22:01,166 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/avro-ipc-1.7.7.jar]
2016-08-11T01:22:01,166 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/snappy-java-1.0.5.jar]
2016-08-11T01:22:01,166 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jetty-util-6.1.26.jar]
2016-08-11T01:22:01,166 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/avro-mapred-1.7.7-hadoop2.jar]
2016-08-11T01:22:01,167 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/netty-3.4.0.Final.jar]
2016-08-11T01:22:01,167 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/gson-2.3.1.jar]
2016-08-11T01:22:01,167 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/slf4j-api-1.6.4.jar]
2016-08-11T01:22:01,167 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/commons-lang-2.6.jar]
2016-08-11T01:22:01,168 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/servlet-api-2.5-20081211.jar]
2016-08-11T01:22:01,168 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/commons-compress-1.4.1.jar]
2016-08-11T01:22:01,168 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/schema-repo-api-0.1.3.jar]
2016-08-11T01:22:01,168 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/velocity-1.7.jar]
2016-08-11T01:22:01,168 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jersey-core-1.19.jar]
2016-08-11T01:22:01,169 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/avro-1.7.7.jar]
2016-08-11T01:22:01,169 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/paranamer-2.3.jar]
2016-08-11T01:22:01,169 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/guava-16.0.1.jar]
2016-08-11T01:22:01,169 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/avro-ipc-1.7.7-tests.jar]
2016-08-11T01:22:01,170 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-avro-extensions/jsr311-api-1.1.1.jar]
2016-08-11T01:22:01,177 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-parquet-extensions] for class [io.druid.cli.CliCommandCreator]
2016-08-11T01:22:01,177 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-parquet-extensions/druid-parquet-extensions-0.9.1.1.jar]
2016-08-11T01:22:01,178 INFO [main] io.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [io.druid.cli.CliCommandCreator]
2016-08-11T01:22:01,178 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar]
2016-08-11T01:22:01,178 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.9.1.1.jar]
2016-08-11T01:22:01,179 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.cli.CliCommandCreator]
2016-08-11T01:22:01,180 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar]
2016-08-11T01:22:01,180 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2016-08-11T01:22:01,181 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2016-08-11T01:22:01,181 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar]
2016-08-11T01:22:01,181 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar]
2016-08-11T01:22:01,181 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/xz-1.0.jar]
2016-08-11T01:22:01,181 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/druid-hdfs-storage-0.9.1.1.jar]
2016-08-11T01:22:01,182 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar]
2016-08-11T01:22:01,182 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2016-08-11T01:22:01,182 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2016-08-11T01:22:01,182 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar]
2016-08-11T01:22:01,182 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2016-08-11T01:22:01,183 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2016-08-11T01:22:01,183 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2016-08-11T01:22:01,183 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar]
2016-08-11T01:22:01,183 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2016-08-11T01:22:01,183 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar]
2016-08-11T01:22:01,184 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar]
2016-08-11T01:22:01,184 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2016-08-11T01:22:01,184 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2016-08-11T01:22:01,184 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2016-08-11T01:22:01,184 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar]
2016-08-11T01:22:01,185 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2016-08-11T01:22:01,185 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2016-08-11T01:22:01,185 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2016-08-11T01:22:01,185 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar]
2016-08-11T01:22:01,185 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2016-08-11T01:22:01,186 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar]
2016-08-11T01:22:01,186 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2016-08-11T01:22:01,186 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar]
2016-08-11T01:22:01,186 INFO [main] io.druid.initialization.Initialization - added URL[file:/data/imply-1.3.0/dist/druid/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2016-08-11T01:22:01,409 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,412 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,412 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,412 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-avro-extensions] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,414 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.data.input.avro.AvroExtensionsModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,414 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-parquet-extensions] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,415 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.data.input.parquet.ParquetExtensionsModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,415 INFO [main] io.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,417 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,417 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:01,419 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2016-08-11T01:22:02,060 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-08-11T01:22:02,599 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2016-08-11T01:22:02,673 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@4b2d44bc]
2016-08-11T01:22:02,684 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2016-08-11T01:22:02,714 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='master3', port=8100}]
2016-08-11T01:22:02,900 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2016-08-11T01:22:02,901 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2016-08-11T01:22:02,916 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='dist/druid/extensions', hadoopDependenciesDir='dist/druid/hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-datasketches, druid-avro-extensions, druid-parquet-extensions, postgresql-metadata-storage, druid-hdfs-storage]}]
2016-08-11T01:22:02,920 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@6a48a7f3]
2016-08-11T01:22:02,921 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@3d278b4d]
2016-08-11T01:22:02,921 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@9d3c67]
2016-08-11T01:22:02,933 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@5eed2d86]
2016-08-11T01:22:02,933 INFO [main] io.druid.cli.CliPeon - Starting up with processors[8], memory[413,663,232].
2016-08-11T01:22:02,934 INFO [main] io.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.emitter: logging
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.extensions.directory: dist/druid/extensions
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: dist/druid/hadoop-dependencies
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-datasketches", "druid-avro-extensions", "druid-parquet-extensions", "postgresql-metadata-storage", "druid-hdfs-storage"]
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.host: master3
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.directory: hdfs://master1:9000/druid/indexing-logs
2016-08-11T01:22:02,935 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.javaOpts: -server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: var/druid/task
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: var/druid/hadoop-tmp
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: true
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:postgresql://master1:5432/druid
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.host: master1
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.password: druid123
2016-08-11T01:22:02,936 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.user: druid
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.type: postgresql
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: ad_cookie
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.port: 8100
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 536870912
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.processing.numThreads: 2
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2016-08-11T01:22:02,937 INFO [main] io.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2016-08-11T01:22:02,938 INFO [main] io.druid.cli.CliPeon - * druid.server.http.numThreads: 40
2016-08-11T01:22:02,938 INFO [main] io.druid.cli.CliPeon - * druid.service: druid/middlemanager
2016-08-11T01:22:02,938 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2016-08-11T01:22:02,938 INFO [main] io.druid.cli.CliPeon - * druid.storage.storageDirectory: hdfs://master1:9000/druid/segments
2016-08-11T01:22:02,938 INFO [main] io.druid.cli.CliPeon - * druid.storage.type: hdfs
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * druid.worker.capacity: 5
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.host: master1:2181,master2:2181,master3:2181
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * file.encoding: UTF-8
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * file.separator: /
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2016-08-11T01:22:02,939 INFO [main] io.druid.cli.CliPeon - * java.class.path: /data/imply-1.3.0/conf/druid/_common:/data/imply-1.3.0/conf/druid/middleManager:dist/druid/lib/jetty-servlets-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-config-1.10.21.jar:dist/druid/lib/jersey-servlet-1.19.jar:dist/druid/lib/log4j-1.2-api-2.5.jar:dist/druid/lib/aws-java-sdk-rds-1.10.21.jar:dist/druid/lib/activation-1.1.1.jar:dist/druid/lib/aether-connector-okhttp-0.0.9.jar:dist/druid/lib/log4j-jul-2.5.jar:dist/druid/lib/jsr305-2.0.1.jar:dist/druid/lib/jackson-core-asl-1.9.13.jar:dist/druid/lib/aws-java-sdk-datapipeline-1.10.21.jar:dist/druid/lib/aws-java-sdk-kms-1.10.21.jar:dist/druid/lib/aws-java-sdk-cognitosync-1.10.21.jar:dist/druid/lib/java-util-0.27.9.jar:dist/druid/lib/slf4j-api-1.7.12.jar:dist/druid/lib/aws-java-sdk-ec2-1.10.21.jar:dist/druid/lib/javax.inject-1.jar:dist/druid/lib/jetty-client-9.2.5.v20141112.jar:dist/druid/lib/druid-indexing-service-0.9.1.1.jar:dist/druid/lib/server-metrics-0.2.8.jar:dist/druid/lib/curator-recipes-2.10.0.jar:dist/druid/lib/javax.el-3.0.0.jar:dist/druid/lib/wagon-provider-api-2.4.jar:dist/druid/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:dist/druid/lib/aws-java-sdk-machinelearning-1.10.21.jar:dist/druid/lib/aws-java-sdk-core-1.10.21.jar:dist/druid/lib/RoaringBitmap-0.5.16.jar:dist/druid/lib/maven-repository-metadata-3.1.1.jar:dist/druid/lib/guice-multibindings-4.0-beta.jar:dist/druid/lib/aws-java-sdk-sts-1.10.21.jar:dist/druid/lib/antlr4-runtime-4.5.1.jar:dist/druid/lib/aws-java-sdk-cloudformation-1.10.21.jar:dist/druid/lib/aws-java-sdk-codecommit-1.10.21.jar:dist/druid/lib/aws-java-sdk-s3-1.10.21.jar:dist/druid/lib/aws-java-sdk-emr-1.10.21.jar:dist/druid/lib/http-client-1.0.4.jar:dist/druid/lib/validation-api-1.1.0.Final.jar:dist/druid/lib/mapdb-1.0.8.jar:dist/druid/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:dist/druid/lib/rhino-1.7R5.jar:dist/druid/lib/aws-java-sdk-codepipeline-1.10.21.jar:dist/druid/lib/aws-java-sdk-route53-1.10.21.jar:dist/druid/lib/curator-client-2.10.0.jar:dist/druid/lib/commons-pool-1.6.jar:dist/druid/lib/jetty-io-9.2.5.v20141112.jar:dist/druid/lib/guice-4.0-beta.jar:dist/druid/lib/commons-dbcp2-2.0.1.jar:dist/druid/lib/jackson-jaxrs-base-2.4.6.jar:dist/druid/lib/irc-api-1.0-0014.jar:dist/druid/lib/aws-java-sdk-swf-libraries-1.10.21.jar:dist/druid/lib/curator-framework-2.10.0.jar:dist/druid/lib/aws-java-sdk-redshift-1.10.21.jar:dist/druid/lib/disruptor-3.3.0.jar:dist/druid/lib/aws-java-sdk-cloudfront-1.10.21.jar:dist/druid/lib/json-path-2.1.0.jar:dist/druid/lib/aws-java-sdk-iam-1.10.21.jar:dist/druid/lib/jackson-annotations-2.4.6.jar:dist/druid/lib/aws-java-sdk-1.10.21.jar:dist/druid/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:dist/druid/lib/aws-java-sdk-lambda-1.10.21.jar:dist/druid/lib/bytebuffer-collections-0.2.4.jar:dist/druid/lib/jetty-util-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-importexport-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudtrail-1.10.21.jar:dist/druid/lib/java-xmlbuilder-1.1.jar:dist/druid/lib/icu4j-4.8.1.jar:dist/druid/lib/derbyclient-10.11.1.1.jar:dist/druid/lib/aws-java-sdk-efs-1.10.21.jar:dist/druid/lib/jackson-mapper-asl-1.9.13.jar:dist/druid/lib/aws-java-sdk-codedeploy-1.10.21.jar:dist/druid/lib/bcprov-jdk15on-1.52.jar:dist/druid/lib/derbytools-10.11.1.1.jar:dist/druid/lib/druid-server-0.9.1.1.jar:dist/druid/lib/druid-indexing-hadoop-0.9.1.1.jar:dist/druid/lib/jackson-databind-2.4.6.jar:dist/druid/lib/aws-java-sdk-kinesis-1.10.21.jar:dist/druid/lib/aws-java-sdk-workspaces-1.10.21.jar:dist/druid/lib/commons-math3-3.6.1.jar:dist/druid/lib/aws-java-sdk-sqs-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudwatch-1.10.21.jar:dist/druid/lib/aws-java-sdk-directory-1.10.21.jar:dist/druid/lib/aether-connector-file-0.9.0.M2.jar:dist/druid/lib/aws-java-sdk-autoscaling-1.10.21.jar:dist/druid/lib/aws-java-sdk-elasticache-1.10.21.jar:dist/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:dist/druid/lib/aws-java-sdk-support-1.10.21.jar:dist/druid/lib/jets3t-0.9.4.jar:dist/druid/lib/log4j-slf4j-impl-2.5.jar:dist/druid/lib/jetty-http-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudhsm-1.10.21.jar:dist/druid/lib/guice-servlet-4.0-beta.jar:dist/druid/lib/tesla-aether-0.0.5.jar:dist/druid/lib/aws-java-sdk-devicefarm-1.10.21.jar:dist/druid/lib/jetty-server-9.2.5.v20141112.jar:dist/druid/lib/extendedset-1.3.9.jar:dist/druid/lib/plexus-utils-3.0.15.jar:dist/druid/lib/jcl-over-slf4j-1.7.12.jar:dist/druid/lib/curator-x-discovery-2.10.0.jar:dist/druid/lib/jetty-proxy-9.2.5.v20141112.jar:dist/druid/lib/log4j-api-2.5.jar:dist/druid/lib/aws-java-sdk-glacier-1.10.21.jar:dist/druid/lib/maven-model-3.1.1.jar:dist/druid/lib/jline-0.9.94.jar:dist/druid/lib/aether-spi-0.9.0.M2.jar:dist/druid/lib/aws-java-sdk-ecs-1.10.21.jar:dist/druid/lib/log4j-core-2.5.jar:dist/druid/lib/jetty-servlet-9.2.5.v20141112.jar:dist/druid/lib/base64-2.3.8.jar:dist/druid/lib/jersey-guice-1.19.jar:dist/druid/lib/opencsv-2.3.jar:dist/druid/lib/aws-java-sdk-dynamodb-1.10.21.jar:dist/druid/lib/aether-impl-0.9.0.M2.jar:dist/druid/lib/javax.servlet-api-3.1.0.jar:dist/druid/lib/druid-aws-common-0.9.1.1.jar:dist/druid/lib/spymemcached-2.11.7.jar:dist/druid/lib/aws-java-sdk-logs-1.10.21.jar:dist/druid/lib/jetty-security-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-opsworks-1.10.21.jar:dist/druid/lib/maven-settings-3.1.1.jar:dist/druid/lib/commons-lang-2.6.jar:dist/druid/lib/zookeeper-3.4.8.jar:dist/druid/lib/commons-pool2-2.2.jar:dist/druid/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:dist/druid/lib/jackson-dataformat-smile-2.4.6.jar:dist/druid/lib/jackson-datatype-guava-2.4.6.jar:dist/druid/lib/hibernate-validator-5.1.3.Final.jar:dist/druid/lib/aether-util-0.9.0.M2.jar:dist/druid/lib/maven-model-builder-3.1.1.jar:dist/druid/lib/compress-lzf-1.0.3.jar:dist/druid/lib/druid-common-0.9.1.1.jar:dist/druid/lib/emitter-0.3.6.jar:dist/druid/lib/druid-processing-0.9.1.1.jar:dist/druid/lib/aws-java-sdk-storagegateway-1.10.21.jar:dist/druid/lib/lz4-1.3.0.jar:dist/druid/lib/aws-java-sdk-cloudsearch-1.10.21.jar:dist/druid/lib/jdbi-2.63.1.jar:dist/druid/lib/airline-0.7.jar:dist/druid/lib/okhttp-1.0.2.jar:dist/druid/lib/commons-logging-1.1.1.jar:dist/druid/lib/aether-api-0.9.0.M2.jar:dist/druid/lib/maven-aether-provider-3.1.1.jar:dist/druid/lib/druid-console-0.0.2.jar:dist/druid/lib/derby-10.11.1.1.jar:dist/druid/lib/plexus-interpolation-1.19.jar:dist/druid/lib/annotations-2.0.3.jar:dist/druid/lib/commons-codec-1.7.jar:dist/druid/lib/jackson-core-2.4.6.jar:dist/druid/lib/config-magic-0.9.jar:dist/druid/lib/aopalliance-1.0.jar:dist/druid/lib/derbynet-10.11.1.1.jar:dist/druid/lib/maven-settings-builder-3.1.1.jar:dist/druid/lib/druid-services-0.9.1.1.jar:dist/druid/lib/aws-java-sdk-directconnect-1.10.21.jar:dist/druid/lib/aws-java-sdk-sns-1.10.21.jar:dist/druid/lib/jersey-core-1.19.jar:dist/druid/lib/httpclient-4.5.1.jar:dist/druid/lib/commons-cli-1.2.jar:dist/druid/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:dist/druid/lib/jboss-logging-3.1.3.GA.jar:dist/druid/lib/geoip2-0.4.0.jar:dist/druid/lib/javax.el-api-3.0.0.jar:dist/druid/lib/aws-java-sdk-simpledb-1.10.21.jar:dist/druid/lib/netty-3.10.4.Final.jar:dist/druid/lib/jackson-datatype-joda-2.4.6.jar:dist/druid/lib/jetty-continuation-9.2.5.v20141112.jar:dist/druid/lib/jackson-module-jaxb-annotations-2.4.6.jar:dist/druid/lib/classmate-1.0.0.jar:dist/druid/lib/druid-api-0.9.1.1.jar:dist/druid/lib/commons-io-2.4.jar:dist/druid/lib/protobuf-java-2.5.0.jar:dist/druid/lib/aws-java-sdk-ses-1.10.21.jar:dist/druid/lib/guava-16.0.1.jar:dist/druid/lib/jersey-server-1.19.jar:dist/druid/lib/aws-java-sdk-ssm-1.10.21.jar:dist/druid/lib/joda-time-2.8.2.jar:dist/druid/lib/jackson-jaxrs-json-provider-2.4.6.jar:dist/druid/lib/httpcore-4.4.3.jar:dist/druid/lib/jackson-jaxrs-smile-provider-2.4.6.jar:dist/druid/lib/maxminddb-0.2.0.jar:dist/druid/lib/jsr311-api-1.1.1.jar
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.class.version: 52.0
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.endorsed.dirs: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/endorsed
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.ext.dirs: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/ext:/usr/java/packages/lib/ext
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.io.tmpdir: var/tmp
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-08-11T01:22:02,940 INFO [main] io.druid.cli.CliPeon - * java.runtime.name: OpenJDK Runtime Environment
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.runtime.version: 1.8.0_91-b14
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.specification.version: 1.8
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2016-08-11T01:22:02,941 INFO [main] io.druid.cli.CliPeon - * java.version: 1.8.0_91
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.info: mixed mode
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.name: OpenJDK 64-Bit Server VM
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * java.vm.version: 25.91-b14
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * line.separator:
2016-08-11T01:22:02,942 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: io.druid.common.config.Log4jShutdown
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * os.arch: amd64
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * os.name: Linux
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * os.version: 2.6.32-642.1.1.el6.x86_64
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * path.separator: :
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * ruid.indexer.logs.type: hdfs
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * sun.arch.data.model: 64
2016-08-11T01:22:02,943 INFO [main] io.druid.cli.CliPeon - * sun.boot.class.path: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/resources.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/rt.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/jsse.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/jce.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/charsets.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/jfr.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/classes
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.boot.library.path: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre/lib/amd64
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.cpu.endian: little
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.cpu.isalist:
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.java.command: io.druid.cli.Main internal peon var/druid/task/index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z/task.json var/druid/task/index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z/f23d6865-7fdf-419b-85e2-7d0c2efdbc04/status.json
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.jnu.encoding: ANSI_X3.4-1968
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2016-08-11T01:22:02,944 INFO [main] io.druid.cli.CliPeon - * sun.os.patch.level: unknown
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.country: US
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.dir: /data/imply-1.3.0
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.home: /root
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.language: en
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.name: root
2016-08-11T01:22:02,945 INFO [main] io.druid.cli.CliPeon - * user.timezone: UTC
2016-08-11T01:22:02,957 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@6cd166b8]
2016-08-11T01:22:02,962 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@5ac6c4f2]
2016-08-11T01:22:03,068 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@4cb40e3b]
2016-08-11T01:22:03,072 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@64f1fd08]
2016-08-11T01:22:03,077 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2016-08-11T01:22:03,104 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@2b10ace9]
2016-08-11T01:22:03,256 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@a5272be]
2016-08-11T01:22:03,259 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@6f911326]
2016-08-11T01:22:03,260 INFO [main] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2016-08-11T01:22:03,267 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@52f57666]
2016-08-11T01:22:03,271 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@3ba46e63]
2016-08-11T01:22:03,275 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2016-08-11T01:22:03,282 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@625dfff3]
2016-08-11T01:22:03,284 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@1de9b505]
2016-08-11T01:22:03,288 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@19a64eae]
2016-08-11T01:22:03,291 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [536870912] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2016-08-11T01:22:03,294 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2016-08-11T01:22:03,294 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2016-08-11T01:22:03,296 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2016-08-11T01:22:03,296 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2016-08-11T01:22:03,296 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2016-08-11T01:22:03,396 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@201c3cda]
2016-08-11T01:22:03,399 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@1b495d4]
2016-08-11T01:22:03,402 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@60d40ff4]
2016-08-11T01:22:03,423 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@7c2dfa2]
2016-08-11T01:22:03,432 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@37b56ac7]
2016-08-11T01:22:03,439 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@3206174f]
2016-08-11T01:22:03,455 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
2016-08-11T01:22:03,457 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@459b6c53]
2016-08-11T01:22:03,460 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2016-08-11T01:22:03,470 INFO [main] org.eclipse.jetty.util.log - Logging initialized @4157ms
2016-08-11T01:22:03,563 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2016-08-11T01:22:03,568 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2016-08-11T01:22:03,569 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@6a756082].
2016-08-11T01:22:03,570 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2016-08-11T01:22:03,570 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@2a53f215].
2016-08-11T01:22:03,570 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@6b63e6ad].
2016-08-11T01:22:03,571 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@7beae796].
2016-08-11T01:22:03,575 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@59c70ceb].
2016-08-11T01:22:03,575 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2016-08-11T01:22:03,575 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2016-08-11T01:22:03,584 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.8--1, built on 02/06/2016 03:18 GMT
2016-08-11T01:22:03,584 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=master3
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_91
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.91-3.b14.el6_8.x86_64/jre
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/data/imply-1.3.0/conf/druid/_common:/data/imply-1.3.0/conf/druid/middleManager:dist/druid/lib/jetty-servlets-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-config-1.10.21.jar:dist/druid/lib/jersey-servlet-1.19.jar:dist/druid/lib/log4j-1.2-api-2.5.jar:dist/druid/lib/aws-java-sdk-rds-1.10.21.jar:dist/druid/lib/activation-1.1.1.jar:dist/druid/lib/aether-connector-okhttp-0.0.9.jar:dist/druid/lib/log4j-jul-2.5.jar:dist/druid/lib/jsr305-2.0.1.jar:dist/druid/lib/jackson-core-asl-1.9.13.jar:dist/druid/lib/aws-java-sdk-datapipeline-1.10.21.jar:dist/druid/lib/aws-java-sdk-kms-1.10.21.jar:dist/druid/lib/aws-java-sdk-cognitosync-1.10.21.jar:dist/druid/lib/java-util-0.27.9.jar:dist/druid/lib/slf4j-api-1.7.12.jar:dist/druid/lib/aws-java-sdk-ec2-1.10.21.jar:dist/druid/lib/javax.inject-1.jar:dist/druid/lib/jetty-client-9.2.5.v20141112.jar:dist/druid/lib/druid-indexing-service-0.9.1.1.jar:dist/druid/lib/server-metrics-0.2.8.jar:dist/druid/lib/curator-recipes-2.10.0.jar:dist/druid/lib/javax.el-3.0.0.jar:dist/druid/lib/wagon-provider-api-2.4.jar:dist/druid/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:dist/druid/lib/aws-java-sdk-machinelearning-1.10.21.jar:dist/druid/lib/aws-java-sdk-core-1.10.21.jar:dist/druid/lib/RoaringBitmap-0.5.16.jar:dist/druid/lib/maven-repository-metadata-3.1.1.jar:dist/druid/lib/guice-multibindings-4.0-beta.jar:dist/druid/lib/aws-java-sdk-sts-1.10.21.jar:dist/druid/lib/antlr4-runtime-4.5.1.jar:dist/druid/lib/aws-java-sdk-cloudformation-1.10.21.jar:dist/druid/lib/aws-java-sdk-codecommit-1.10.21.jar:dist/druid/lib/aws-java-sdk-s3-1.10.21.jar:dist/druid/lib/aws-java-sdk-emr-1.10.21.jar:dist/druid/lib/http-client-1.0.4.jar:dist/druid/lib/validation-api-1.1.0.Final.jar:dist/druid/lib/mapdb-1.0.8.jar:dist/druid/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:dist/druid/lib/rhino-1.7R5.jar:dist/druid/lib/aws-java-sdk-codepipeline-1.10.21.jar:dist/druid/lib/aws-java-sdk-route53-1.10.21.jar:dist/druid/lib/curator-client-2.10.0.jar:dist/druid/lib/commons-pool-1.6.jar:dist/druid/lib/jetty-io-9.2.5.v20141112.jar:dist/druid/lib/guice-4.0-beta.jar:dist/druid/lib/commons-dbcp2-2.0.1.jar:dist/druid/lib/jackson-jaxrs-base-2.4.6.jar:dist/druid/lib/irc-api-1.0-0014.jar:dist/druid/lib/aws-java-sdk-swf-libraries-1.10.21.jar:dist/druid/lib/curator-framework-2.10.0.jar:dist/druid/lib/aws-java-sdk-redshift-1.10.21.jar:dist/druid/lib/disruptor-3.3.0.jar:dist/druid/lib/aws-java-sdk-cloudfront-1.10.21.jar:dist/druid/lib/json-path-2.1.0.jar:dist/druid/lib/aws-java-sdk-iam-1.10.21.jar:dist/druid/lib/jackson-annotations-2.4.6.jar:dist/druid/lib/aws-java-sdk-1.10.21.jar:dist/druid/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:dist/druid/lib/aws-java-sdk-lambda-1.10.21.jar:dist/druid/lib/bytebuffer-collections-0.2.4.jar:dist/druid/lib/jetty-util-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-importexport-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudtrail-1.10.21.jar:dist/druid/lib/java-xmlbuilder-1.1.jar:dist/druid/lib/icu4j-4.8.1.jar:dist/druid/lib/derbyclient-10.11.1.1.jar:dist/druid/lib/aws-java-sdk-efs-1.10.21.jar:dist/druid/lib/jackson-mapper-asl-1.9.13.jar:dist/druid/lib/aws-java-sdk-codedeploy-1.10.21.jar:dist/druid/lib/bcprov-jdk15on-1.52.jar:dist/druid/lib/derbytools-10.11.1.1.jar:dist/druid/lib/druid-server-0.9.1.1.jar:dist/druid/lib/druid-indexing-hadoop-0.9.1.1.jar:dist/druid/lib/jackson-databind-2.4.6.jar:dist/druid/lib/aws-java-sdk-kinesis-1.10.21.jar:dist/druid/lib/aws-java-sdk-workspaces-1.10.21.jar:dist/druid/lib/commons-math3-3.6.1.jar:dist/druid/lib/aws-java-sdk-sqs-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudwatch-1.10.21.jar:dist/druid/lib/aws-java-sdk-directory-1.10.21.jar:dist/druid/lib/aether-connector-file-0.9.0.M2.jar:dist/druid/lib/aws-java-sdk-autoscaling-1.10.21.jar:dist/druid/lib/aws-java-sdk-elasticache-1.10.21.jar:dist/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:dist/druid/lib/aws-java-sdk-support-1.10.21.jar:dist/druid/lib/jets3t-0.9.4.jar:dist/druid/lib/log4j-slf4j-impl-2.5.jar:dist/druid/lib/jetty-http-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:dist/druid/lib/aws-java-sdk-cloudhsm-1.10.21.jar:dist/druid/lib/guice-servlet-4.0-beta.jar:dist/druid/lib/tesla-aether-0.0.5.jar:dist/druid/lib/aws-java-sdk-devicefarm-1.10.21.jar:dist/druid/lib/jetty-server-9.2.5.v20141112.jar:dist/druid/lib/extendedset-1.3.9.jar:dist/druid/lib/plexus-utils-3.0.15.jar:dist/druid/lib/jcl-over-slf4j-1.7.12.jar:dist/druid/lib/curator-x-discovery-2.10.0.jar:dist/druid/lib/jetty-proxy-9.2.5.v20141112.jar:dist/druid/lib/log4j-api-2.5.jar:dist/druid/lib/aws-java-sdk-glacier-1.10.21.jar:dist/druid/lib/maven-model-3.1.1.jar:dist/druid/lib/jline-0.9.94.jar:dist/druid/lib/aether-spi-0.9.0.M2.jar:dist/druid/lib/aws-java-sdk-ecs-1.10.21.jar:dist/druid/lib/log4j-core-2.5.jar:dist/druid/lib/jetty-servlet-9.2.5.v20141112.jar:dist/druid/lib/base64-2.3.8.jar:dist/druid/lib/jersey-guice-1.19.jar:dist/druid/lib/opencsv-2.3.jar:dist/druid/lib/aws-java-sdk-dynamodb-1.10.21.jar:dist/druid/lib/aether-impl-0.9.0.M2.jar:dist/druid/lib/javax.servlet-api-3.1.0.jar:dist/druid/lib/druid-aws-common-0.9.1.1.jar:dist/druid/lib/spymemcached-2.11.7.jar:dist/druid/lib/aws-java-sdk-logs-1.10.21.jar:dist/druid/lib/jetty-security-9.2.5.v20141112.jar:dist/druid/lib/aws-java-sdk-opsworks-1.10.21.jar:dist/druid/lib/maven-settings-3.1.1.jar:dist/druid/lib/commons-lang-2.6.jar:dist/druid/lib/zookeeper-3.4.8.jar:dist/druid/lib/commons-pool2-2.2.jar:dist/druid/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:dist/druid/lib/jackson-dataformat-smile-2.4.6.jar:dist/druid/lib/jackson-datatype-guava-2.4.6.jar:dist/druid/lib/hibernate-validator-5.1.3.Final.jar:dist/druid/lib/aether-util-0.9.0.M2.jar:dist/druid/lib/maven-model-builder-3.1.1.jar:dist/druid/lib/compress-lzf-1.0.3.jar:dist/druid/lib/druid-common-0.9.1.1.jar:dist/druid/lib/emitter-0.3.6.jar:dist/druid/lib/druid-processing-0.9.1.1.jar:dist/druid/lib/aws-java-sdk-storagegateway-1.10.21.jar:dist/druid/lib/lz4-1.3.0.jar:dist/druid/lib/aws-java-sdk-cloudsearch-1.10.21.jar:dist/druid/lib/jdbi-2.63.1.jar:dist/druid/lib/airline-0.7.jar:dist/druid/lib/okhttp-1.0.2.jar:dist/druid/lib/commons-logging-1.1.1.jar:dist/druid/lib/aether-api-0.9.0.M2.jar:dist/druid/lib/maven-aether-provider-3.1.1.jar:dist/druid/lib/druid-console-0.0.2.jar:dist/druid/lib/derby-10.11.1.1.jar:dist/druid/lib/plexus-interpolation-1.19.jar:dist/druid/lib/annotations-2.0.3.jar:dist/druid/lib/commons-codec-1.7.jar:dist/druid/lib/jackson-core-2.4.6.jar:dist/druid/lib/config-magic-0.9.jar:dist/druid/lib/aopalliance-1.0.jar:dist/druid/lib/derbynet-10.11.1.1.jar:dist/druid/lib/maven-settings-builder-3.1.1.jar:dist/druid/lib/druid-services-0.9.1.1.jar:dist/druid/lib/aws-java-sdk-directconnect-1.10.21.jar:dist/druid/lib/aws-java-sdk-sns-1.10.21.jar:dist/druid/lib/jersey-core-1.19.jar:dist/druid/lib/httpclient-4.5.1.jar:dist/druid/lib/commons-cli-1.2.jar:dist/druid/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:dist/druid/lib/jboss-logging-3.1.3.GA.jar:dist/druid/lib/geoip2-0.4.0.jar:dist/druid/lib/javax.el-api-3.0.0.jar:dist/druid/lib/aws-java-sdk-simpledb-1.10.21.jar:dist/druid/lib/netty-3.10.4.Final.jar:dist/druid/lib/jackson-datatype-joda-2.4.6.jar:dist/druid/lib/jetty-continuation-9.2.5.v20141112.jar:dist/druid/lib/jackson-module-jaxb-annotations-2.4.6.jar:dist/druid/lib/classmate-1.0.0.jar:dist/druid/lib/druid-api-0.9.1.1.jar:dist/druid/lib/commons-io-2.4.jar:dist/druid/lib/protobuf-java-2.5.0.jar:dist/druid/lib/aws-java-sdk-ses-1.10.21.jar:dist/druid/lib/guava-16.0.1.jar:dist/druid/lib/jersey-server-1.19.jar:dist/druid/lib/aws-java-sdk-ssm-1.10.21.jar:dist/druid/lib/joda-time-2.8.2.jar:dist/druid/lib/jackson-jaxrs-json-provider-2.4.6.jar:dist/druid/lib/httpcore-4.4.3.jar:dist/druid/lib/jackson-jaxrs-smile-provider-2.4.6.jar:dist/druid/lib/maxminddb-0.2.0.jar:dist/druid/lib/jsr311-api-1.1.1.jar
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-642.1.1.el6.x86_64
2016-08-11T01:22:03,585 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2016-08-11T01:22:03,586 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2016-08-11T01:22:03,586 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/data/imply-1.3.0
2016-08-11T01:22:03,587 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=master1:2181,master2:2181,master3:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@2b38b1f
2016-08-11T01:22:03,604 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@18a25bbd].
2016-08-11T01:22:03,607 INFO [main-SendThread(master1:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server master1/10.197.0.3:2181. Will not attempt to authenticate using SASL (unknown error)
2016-08-11T01:22:03,684 INFO [main-SendThread(master1:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to master1/10.197.0.3:2181, initiating session
2016-08-11T01:22:03,694 INFO [main-SendThread(master1:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server master1/10.197.0.3:2181, sessionid = 0x15570c124f30135, negotiated timeout = 30000
2016-08-11T01:22:03,698 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2016-08-11T01:22:03,721 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@f5ce0bb].
2016-08-11T01:22:03,728 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@47e51549].
2016-08-11T01:22:03,816 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@4364863].
2016-08-11T01:22:03,878 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z",
"spec" : {
"dataSchema" : {
"dataSource" : "ad_cookie",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"dimensionsSpec" : {
"dimensions" : [ "advertiser_id", "campaign_id", "payment_id", "creative_id", "website_id", "channel_id", "section_id", "zone_id", "ad_default", "topic_id", "interest_id", "inmarket_id", "audience_id", "os_id", "browser_id", "device_type", "device_id", "location_id", "age_id", "gender_id", "network_id", "merchant_cate", "userId" ]
},
"timestampSpec" : {
"format" : "yyyy-mm-dd-HH",
"column" : "time"
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "impression",
"fieldName" : "impression"
}, {
"type" : "longSum",
"name" : "viewable",
"fieldName" : "viewable"
}, {
"type" : "longSum",
"name" : "revenue",
"fieldName" : "revenue"
}, {
"type" : "longSum",
"name" : "proceeds",
"fieldName" : "proceeds"
}, {
"type" : "longSum",
"name" : "spent",
"fieldName" : "spent"
}, {
"type" : "longSum",
"name" : "click_fraud",
"fieldName" : "click_fraud"
}, {
"type" : "longSum",
"name" : "click",
"fieldName" : "clickdelta"
}, {
"type" : "hyperUnique",
"name" : "user_unique",
"fieldName" : "userId"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "duration",
"duration" : 3600000,
"origin" : "1970-01-01T00:00:00.000Z"
},
"intervals" : [ "2016-08-09T00:00:00.000Z/2016-08-11T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "hdfs://master1:9000/AD_COOKIE_REPORT"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2016-08-11T01:22:02.178Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : null,
"metricCompression" : null
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : false,
"numBackgroundPersistThreads" : 0
},
"uniqueId" : "e678aaf7a6984a0c9235e731130fab0f"
},
"hadoopDependencyCoordinates" : null,
"classpathPrefix" : null,
"context" : null,
"groupId" : "index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z",
"dataSource" : "ad_cookie",
"resource" : {
"availabilityGroup" : "index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z",
"requiredCapacity" : 1
}
}
2016-08-11T01:22:03,885 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[var/druid/task/index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z/lock].
2016-08-11T01:22:03,886 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[var/druid/task/index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z/lock] in 1ms.
2016-08-11T01:22:03,890 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]: LockTryAcquireAction{interval=2016-08-09T00:00:00.000Z/2016-08-11T00:00:00.000Z}
2016-08-11T01:22:03,899 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:22:03,900 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:22:03,905 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT4.902S].
2016-08-11T01:22:08,808 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:22:08,808 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:22:08,809 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT6.246S].
2016-08-11T01:22:15,055 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:22:15,055 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:22:15,056 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT21.128S].
2016-08-11T01:22:36,184 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:22:36,184 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:22:36,185 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT35.159S].
2016-08-11T01:23:03,597 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.578Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:23:03,603 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:23:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:23:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":38628688,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:23:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:23:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:23:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":53714944,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:23:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52568440,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:23:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:23:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:23:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":10813440,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:23:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":10712832,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:23:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:23:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:23:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38182912,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:23:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37354880,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:23:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:23:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:23:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:23:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4519216,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:23:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:23:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:23:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:23:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":23582440,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:23:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:23:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:23:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:23:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:23:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:23:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:23:03,620 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:23:03,620 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.620Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:23:03,620 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.620Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:23:03,621 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.621Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,621 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.621Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,622 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.621Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,622 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.622Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,622 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.622Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:03,623 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:23:03.623Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:23:11,344 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:23:11,344 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:23:11,345 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT67.600S].
2016-08-11T01:24:03,574 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.574Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:24:03,599 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.598Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:24:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:24:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":39293304,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:24:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:24:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:24:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":53780480,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:24:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52694608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:24:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:24:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:24:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":10878976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:24:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":10807936,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:24:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:24:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:24:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38182912,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:24:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37391248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:24:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:24:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:24:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:24:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4519736,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:24:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:24:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:24:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:24:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":24247056,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:24:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:24:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:24:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:24:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:24:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:24:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:24:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:24:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:24:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:24:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:24:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:24:18,946 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:24:18,947 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:24:18,949 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT61.673S].
2016-08-11T01:25:03,574 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.574Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:25:03,599 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:25:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:25:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":40622392,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:25:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:25:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:25:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":53911552,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:25:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52859616,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:25:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:25:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:25:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11010048,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:25:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":10925632,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:25:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:25:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:25:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38273024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:25:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37419456,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:25:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:25:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:25:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:25:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:25:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:25:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:25:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:25:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":26241256,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:25:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:25:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:25:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:25:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:25:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:25:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:25:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:25:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:25:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:25:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:25:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:25:20,622 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:25:20,622 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:25:20,623 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT62.846S].
2016-08-11T01:26:03,574 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.574Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:26:03,599 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:26:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:26:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":41287504,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:26:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:26:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:26:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54067200,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:26:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52973488,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:26:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:26:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:26:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11075584,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:26:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":11019456,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:26:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:26:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:26:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38273024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:26:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37434392,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:26:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:26:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:26:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:26:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:26:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:26:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:26:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:26:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":26241256,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:26:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:26:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:26:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:26:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:26:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:26:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:26:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:26:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:26:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:26:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:26:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:26:23,469 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:26:23,469 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:26:23,470 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT47.688S].
2016-08-11T01:27:03,575 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.574Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:27:03,599 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,604 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:27:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:27:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":41287504,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:27:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:27:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:27:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54198272,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:27:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":53085592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:27:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:27:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:27:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11206656,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:27:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":11124544,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:27:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:27:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:27:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38273024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:27:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37456392,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:27:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:27:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:27:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:27:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:27:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:27:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:27:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:27:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":26906944,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:27:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:27:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:27:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:27:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:27:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:27:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:27:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:27:03,615 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:27:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.615Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:27:03,616 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.616Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,617 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.617Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,618 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.618Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:03,619 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:27:03.619Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:27:11,158 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:27:11,158 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:27:11,159 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT68.086S].
2016-08-11T01:28:03,575 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.575Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:28:03,599 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:28:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:28:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":41953192,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:28:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:28:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:28:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54263808,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:28:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":53231000,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:28:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:28:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:28:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11272192,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:28:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":11227584,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:28:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:28:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:28:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38273024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:28:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37493008,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:28:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:28:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:28:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:28:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:28:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:28:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:28:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":26906944,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:28:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:28:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:28:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:28:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:28:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:28:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:03,614 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:28:03.614Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:28:19,245 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:28:19,245 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:28:19,246 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT71.359S].
2016-08-11T01:29:03,577 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.575Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:29:03,600 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.599Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.604Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":41953192,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:29:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54657024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:29:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":53303408,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:29:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:29:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:29:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11403264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:29:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":11248896,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:29:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:29:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:29:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38535168,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:29:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37536552,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:29:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:29:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:29:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:29:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:29:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:29:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:29:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:29:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":27571464,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:29:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:29:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:29:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:29:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:29:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:29:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:29:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:29:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:29:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:29:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:29:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:29:30,605 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:29:30,606 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:29:30,606 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT66.338S].
2016-08-11T01:30:03,575 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.575Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:30:03,600 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.600Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:30:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:30:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":42617712,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:30:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54657024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52847624,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:30:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11403264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":10764224,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38535168,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37554840,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:30:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:30:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:30:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:30:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:30:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:30:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:30:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:30:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":27571464,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:30:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:30:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:30:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:30:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:30:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:30:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:30:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:30:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:30:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:30:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:30:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:30:36,944 ERROR [main] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found
2016-08-11T01:30:36,945 WARN [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z]
java.io.IOException: Failed to locate service uri
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:93) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.task.HadoopIndexTask.isReady(HadoopIndexTask.java:137) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.worker.executor.ExecutorLifecycle.start(ExecutorLifecycle.java:168) [druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_91]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_91]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_91]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_91]
at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:350) [java-util-0.27.9.jar:?]
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:259) [java-util-0.27.9.jar:?]
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:155) [druid-api-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid-services-0.9.1.1.jar:0.9.1.1]
at io.druid.cli.Main.main(Main.java:105) [druid-services-0.9.1.1.jar:0.9.1.1]
Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to!
at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceInstance(RemoteTaskActionClient.java:167) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:88) ~[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
... 12 more
2016-08-11T01:30:36,945 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT49.696S].
2016-08-11T01:31:03,576 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.575Z","service":"druid/middlemanager","host":"master3:8100","metric":"segment/scan/pending","value":0}]
2016-08-11T01:31:03,600 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.600Z","service":"druid/middlemanager","host":"master3:8100","metric":"jetty/numOpenConnections","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":1908932608,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:31:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":617611264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:31:03,605 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":43946912,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:31:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.605Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":658505728,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"heap"}]
2016-08-11T01:31:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:31:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/committed","value":54657024,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:31:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/used","value":52844776,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:31:03,606 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/mem/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"memKind":"nonheap"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.606Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":251658240,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":11403264,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":10762496,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":2555904,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":-1,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:31:03,607 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.607Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":38535168,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:31:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":37565216,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:31:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2016-08-11T01:31:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1073741824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:31:03,608 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":4718592,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:31:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.608Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":4521032,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:31:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2016-08-11T01:31:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":663224320,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:31:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":265814016,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:31:03,609 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":28900664,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:31:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.609Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":164626432,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2016-08-11T01:31:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:31:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":25165824,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:31:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":0,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:31:03,610 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":27262976,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2016-08-11T01:31:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.610Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/max","value":1431830528,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:31:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/committed","value":326631424,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:31:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/used","value":15046248,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:31:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/pool/init","value":439353344,"dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2016-08-11T01:31:03,611 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.611Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS Scavenge","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/count","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/gc/time","value":0,"dataSource":["ad_cookie"],"gcName":"PS MarkSweep","id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,612 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":1048877,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.612Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":18,"bufferpoolName":"direct","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
2016-08-11T01:31:03,613 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2016-08-11T01:31:03.613Z","service":"druid/middlemanager","host":"master3:8100","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["ad_cookie"],"id":["index_hadoop_ad_cookie_2016-08-11T01:22:02.197Z"]}]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment