Created
November 3, 2016 16:21
-
-
Save anonymous/242e22801f289d38f30182ff44cd317d to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2016-10-17 14:50:52,133 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting NodeManager | |
| STARTUP_MSG: user = yarn | |
| STARTUP_MSG: host = quickstart.cloudera/127.0.0.1 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 2.6.0-cdh5.8.0 | |
| STARTUP_MSG: classpath = /etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/curator-framework-2.7.1.jar:/usr/lib/hadoop/lib/jersey-server-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/avro.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/jersey-core-1.9.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/junit-4.11.jar:/usr/lib/hadoop/lib/jersey-json-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jsr305-3.0.0.jar:/usr/lib/hadoop/lib/api-util-1.0.0-M20.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/lib/hadoop/lib/logredactor-1.0.3.jar:/usr/lib/hadoop/lib/curator-recipes-2.7.1.jar:/usr/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/lib/hadoop/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/httpcore-4.2.5.jar:/usr/lib/hadoop/lib/httpclient-4.2.5.jar:/usr/lib/hadoop/lib/curator-client-2.7.1.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/jets3t-0.9.0.jar:/usr/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.8.0.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/stax-api-1.0-2.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/commons-io-2.4.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.5.jar:/usr/lib/hadoop/lib/gson-2.2.4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/slf4j-log4j12.jar:/usr/lib/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/zookeeper.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/.//parquet-tools.jar:/usr/lib/hadoop/.//parquet-hadoop-bundle.jar:/usr/lib/hadoop/.//parquet-format-javadoc.jar:/usr/lib/hadoop/.//parquet-avro.jar:/usr/lib/hadoop/.//parquet-pig.jar:/usr/lib/hadoop/.//hadoop-nfs.jar:/usr/lib/hadoop/.//parquet-pig-bundle.jar:/usr/lib/hadoop/.//parquet-column.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-format-sources.jar:/usr/lib/hadoop/.//hadoop-aws-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-protobuf.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop/.//hadoop-annotations-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-scrooge_2.10.jar:/usr/lib/hadoop/.//parquet-generator.jar:/usr/lib/hadoop/.//hadoop-common-tests.jar:/usr/lib/hadoop/.//parquet-common.jar:/usr/lib/hadoop/.//hadoop-aws.jar:/usr/lib/hadoop/.//parquet-test-hadoop2.jar:/usr/lib/hadoop/.//parquet-scala_2.10.jar:/usr/lib/hadoop/.//hadoop-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-jackson.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//parquet-encoding.jar:/usr/lib/hadoop/.//parquet-format.jar:/usr/lib/hadoop/.//parquet-cascading.jar:/usr/lib/hadoop/.//parquet-hadoop.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//parquet-thrift.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/lib/avro.jar:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-mapreduce/lib/junit-4.11.jar:/usr/lib/hadoop-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/lib/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/lib/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-annotations-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/lib/hadoop-mapreduce/.//activation-1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-mapreduce/.//htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/lib/hadoop-mapreduce/.//avro.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/lib/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//commons-el-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//junit-4.11.jar:/usr/lib/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/lib/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/lib/hadoop-mapreduce/.//metrics-core-3.0.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/.//jettison-1.1.jar:/usr/lib/hadoop-mapreduce/.//xz-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/lib/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives.jar:/usr/lib/hadoop-mapreduce/.//jackson-databind-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/lib/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/.//asm-3.2.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-mapreduce/.//jasper-compiler-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/lib/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/lib/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/.//jackson-xc-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/lib/hadoop-mapreduce/.//jasper-runtime-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/lib/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant.jar:/usr/lib/hadoop-mapreduce/.//zookeeper.jar:/usr/lib/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs.jar::/usr/lib/llama/llama.jar:/usr/lib/llama/llama-1.0.0-cdh5.8.0.jar:/usr/lib/llama/lib/guava-11.0.2.jar:/usr/lib/llama/lib/slf4j-log4j12-1.7.5.jar:/usr/lib/llama/lib/curator-framework-2.5.0.jar:/usr/lib/llama/lib/jsr305-1.3.9.jar:/usr/lib/llama/lib/libthrift-0.9.0.jar:/usr/lib/llama/lib/metrics-core-3.0.1.jar:/usr/lib/llama/lib/netty-3.2.2.Final.jar:/usr/lib/llama/lib/jline-2.11.jar:/usr/lib/llama/lib/curator-client-2.5.0.jar:/usr/lib/llama/lib/log4j-1.2.17.jar:/usr/lib/llama/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/etc/hadoop/conf/nm-config/log4j.properties | |
| STARTUP_MSG: build = http://github.com/cloudera/hadoop -r 57e7b8556919574d517e874abfb7ebe31a366c2b; compiled by 'jenkins' on 2016-06-16T19:38Z | |
| STARTUP_MSG: java = 1.7.0_67 | |
| ************************************************************/ | |
| 2016-10-17 14:50:52,138 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT] | |
| 2016-10-17 14:50:53,699 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher | |
| 2016-10-17 14:50:53,699 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher | |
| 2016-10-17 14:50:53,700 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService | |
| 2016-10-17 14:50:53,700 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices | |
| 2016-10-17 14:50:53,700 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl | |
| 2016-10-17 14:50:53,701 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher | |
| 2016-10-17 14:50:53,724 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl | |
| 2016-10-17 14:50:53,725 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager | |
| 2016-10-17 14:50:53,738 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-nodemanager.properties,hadoop-metrics2.properties | |
| 2016-10-17 14:50:53,773 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). | |
| 2016-10-17 14:50:53,773 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started | |
| 2016-10-17 14:50:53,826 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService | |
| 2016-10-17 14:50:53,826 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192 | |
| 2016-10-17 14:50:53,864 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker | |
| 2016-10-17 14:50:53,936 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config. | |
| 2016-10-17 14:50:53,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle" | |
| 2016-10-17 14:50:53,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@3f5d80d | |
| 2016-10-17 14:50:53,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null | |
| 2016-10-17 14:50:53,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true | |
| 2016-10-17 14:50:53,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: false | |
| 2016-10-17 14:50:53,983 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (3.7 G). Thrashing might happen. | |
| 2016-10-17 14:50:53,998 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 | |
| 2016-10-17 14:50:54,072 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 14:50:54,086 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 59044 | |
| 2016-10-17 14:50:54,103 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server | |
| 2016-10-17 14:50:54,103 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting. | |
| 2016-10-17 14:50:54,103 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 14:50:54,104 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 59044: starting | |
| 2016-10-17 14:50:54,109 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : quickstart.cloudera:59044 | |
| 2016-10-17 14:50:54,144 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 14:50:54,146 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040 | |
| 2016-10-17 14:50:54,148 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server | |
| 2016-10-17 14:50:54,151 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 14:50:54,151 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting | |
| 2016-10-17 14:50:54,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040 | |
| 2016-10-17 14:50:54,185 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760 | |
| 2016-10-17 14:50:54,198 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562 | |
| 2016-10-17 14:50:54,200 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at quickstart.cloudera/127.0.0.1:59044 | |
| 2016-10-17 14:50:54,200 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0 | |
| 2016-10-17 14:50:54,201 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042 | |
| 2016-10-17 14:50:54,243 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2016-10-17 14:50:54,247 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. | |
| 2016-10-17 14:50:54,250 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined | |
| 2016-10-17 14:50:54,267 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) | |
| 2016-10-17 14:50:54,269 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node | |
| 2016-10-17 14:50:54,269 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs | |
| 2016-10-17 14:50:54,269 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static | |
| 2016-10-17 14:50:54,282 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/* | |
| 2016-10-17 14:50:54,282 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* | |
| 2016-10-17 14:50:54,288 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042 | |
| 2016-10-17 14:50:54,288 INFO org.mortbay.log: jetty-6.1.26.cloudera.4 | |
| 2016-10-17 14:50:54,319 INFO org.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.8.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp | |
| 2016-10-17 14:50:54,731 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042 | |
| 2016-10-17 14:50:54,731 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042 | |
| 2016-10-17 14:50:55,056 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules | |
| 2016-10-17 14:50:55,064 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031 | |
| 2016-10-17 14:50:55,070 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor | |
| 2016-10-17 14:50:55,087 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: [] | |
| 2016-10-17 14:50:55,091 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[] | |
| 2016-10-17 14:50:56,138 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:50:57,139 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:50:58,140 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:50:59,141 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:00,141 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:01,142 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:02,150 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:03,151 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:04,161 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:05,171 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 14:51:36,217 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 135663236 | |
| 2016-10-17 14:51:36,355 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id -2064755842 | |
| 2016-10-17 14:51:36,355 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as quickstart.cloudera:59044 with total resource of <memory:8192, vCores:8> | |
| 2016-10-17 14:51:36,355 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests | |
| 2016-10-17 15:24:02,540 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:02,653 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000001 by user cloudera | |
| 2016-10-17 15:24:02,689 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1476741065528_0001 | |
| 2016-10-17 15:24:02,695 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0001 transitioned from NEW to INITING | |
| 2016-10-17 15:24:02,699 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:24:03,175 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished. | |
| 2016-10-17 15:24:03,199 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000001 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:03,200 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0001 transitioned from INITING to RUNNING | |
| 2016-10-17 15:24:03,203 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000001 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:03,203 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:03,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:24:03,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0001_01_000001.tokens. Credentials list: | |
| 2016-10-17 15:24:03,276 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user cloudera | |
| 2016-10-17 15:24:03,316 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0001_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000001.tokens | |
| 2016-10-17 15:24:03,317 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001 = file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001 | |
| 2016-10-17 15:24:03,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000001 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:03,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000001 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:03,783 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000001/default_container_executor.sh] | |
| 2016-10-17 15:24:06,558 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:24:06,683 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 110.7 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:09,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 141.9 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:10,633 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:10,635 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:10,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000002 by user cloudera | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000002 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000002 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:10,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:10,641 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:10,642 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000002 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:10,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000003 by user cloudera | |
| 2016-10-17 15:24:10,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000003 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:10,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000003 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:10,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:10,663 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:10,663 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:10,663 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:10,663 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000003 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:10,662 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:10,704 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000003 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:10,707 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000002 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:10,709 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000002/default_container_executor.sh] | |
| 2016-10-17 15:24:10,712 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000003/default_container_executor.sh] | |
| 2016-10-17 15:24:11,473 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:11,487 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000004 by user cloudera | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000004 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000004 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:11,488 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:11,489 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000004 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:11,569 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000004 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:11,573 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000004/default_container_executor.sh] | |
| 2016-10-17 15:24:12,489 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:12,520 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000005 by user cloudera | |
| 2016-10-17 15:24:12,520 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000005 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000005 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:12,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000005 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:12,681 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000005 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:12,700 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000005/default_container_executor.sh] | |
| 2016-10-17 15:24:12,707 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:12,707 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:12,707 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:12,707 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:12,830 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 72.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:12,886 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 49.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:13,002 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 71.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:13,066 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 15.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:13,195 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 144.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:13,501 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:13,550 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000006 by user cloudera | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000006 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000006 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:13,551 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:13,552 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000006 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:13,677 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000006 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:13,682 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000006/default_container_executor.sh] | |
| 2016-10-17 15:24:14,535 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:14,550 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000007 by user cloudera | |
| 2016-10-17 15:24:14,550 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:14,550 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000007 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000007 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:14,551 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000007 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:14,748 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000007 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:14,751 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000007/default_container_executor.sh] | |
| 2016-10-17 15:24:16,197 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:16,197 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:16,298 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 88.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:16,466 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 73.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:16,629 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 89.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:16,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 64.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:17,007 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 48.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:17,170 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 58.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:17,376 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 144.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:20,482 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 100.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:20,653 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 91.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:20,823 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 100.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:21,061 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 85.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:21,297 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 68.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:21,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 75.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:21,647 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 144.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:24,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 112.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:24,941 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 99.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:25,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 105.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:25,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 95.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:25,358 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 86.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:25,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 89.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:25,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 144.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:28,655 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 158.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:28,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 91.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:28,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 151.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:28,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 86.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:29,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 84.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:29,113 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 87.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:29,153 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:32,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 195.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,176 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 92.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 193.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 89.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,219 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 85.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,237 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 90.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:32,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 128.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:35,680 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 199.5 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,703 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 193.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,716 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 197.5 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 91.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 86.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 85.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:35,774 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 128.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:38,908 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: 195.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:39,033 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: 194.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:39,319 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: 193.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:39,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 192.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:40,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 88.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:40,429 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 88.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:40,436 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 127.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:43,144 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000002 succeeded | |
| 2016-10-17 15:24:43,145 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000003 succeeded | |
| 2016-10-17 15:24:43,145 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000004 succeeded | |
| 2016-10-17 15:24:43,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:43,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:43,450 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10757 for container-id container_1476741065528_0001_01_000002: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000003 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:43,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000004 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:43,483 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10793 for container-id container_1476741065528_0001_01_000004: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,544 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:43,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10758 for container-id container_1476741065528_0001_01_000003: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,565 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:43,582 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10819 for container-id container_1476741065528_0001_01_000005: 194.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,617 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10874 for container-id container_1476741065528_0001_01_000007: 91.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,667 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:43,672 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: 91.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:43,675 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:43,684 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 128.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:43,745 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:43,746 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:43,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:43,807 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:43,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000003 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:43,808 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:43,808 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000004 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:43,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000002 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:43,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000002 for log-aggregation | |
| 2016-10-17 15:24:43,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000003 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000003 for log-aggregation | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000004 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000004 for log-aggregation | |
| 2016-10-17 15:24:43,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:43,844 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000005 succeeded | |
| 2016-10-17 15:24:43,844 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000005 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:43,844 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:43,889 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:43,895 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:43,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000005 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:43,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000005 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:43,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000005 for log-aggregation | |
| 2016-10-17 15:24:43,898 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,833 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:44,839 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:44,849 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:44,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000037 by user cloudera | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000037 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000037 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:44,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000037 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:44,874 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000036 by user cloudera | |
| 2016-10-17 15:24:44,874 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000036 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000036 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:44,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000036 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:44,933 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000035 by user cloudera | |
| 2016-10-17 15:24:44,933 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:24:44,933 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000035 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:44,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:44,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000036 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:44,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000037 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:45,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:45,074 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000037/default_container_executor.sh] | |
| 2016-10-17 15:24:45,076 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000036/default_container_executor.sh] | |
| 2016-10-17 15:24:45,078 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000035/default_container_executor.sh] | |
| 2016-10-17 15:24:45,759 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:45,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000038 by user cloudera | |
| 2016-10-17 15:24:45,771 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:24:45,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000038 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000038 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:45,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000038 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:45,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000038 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:45,815 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000038/default_container_executor.sh] | |
| 2016-10-17 15:24:45,959 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000002, container_1476741065528_0001_01_000004, container_1476741065528_0001_01_000003, container_1476741065528_0001_01_000005] | |
| 2016-10-17 15:24:46,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000007 succeeded | |
| 2016-10-17 15:24:46,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000007 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:46,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:46,232 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:46,232 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:46,233 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000007 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:46,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000007 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:46,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000007 for log-aggregation | |
| 2016-10-17 15:24:46,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:46,686 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:24:46,686 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:24:46,686 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:24:46,686 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:24:46,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000002 | |
| 2016-10-17 15:24:46,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000003 | |
| 2016-10-17 15:24:46,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000004 | |
| 2016-10-17 15:24:46,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000005 | |
| 2016-10-17 15:24:46,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000007 | |
| 2016-10-17 15:24:46,693 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 25.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:46,699 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 28.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:46,709 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 28.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:46,715 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10840 for container-id container_1476741065528_0001_01_000006: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:46,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:46,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 26.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:46,763 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000040 by user cloudera | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000040 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000040 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:46,768 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:46,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000040 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000040 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:46,794 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000040/default_container_executor.sh] | |
| 2016-10-17 15:24:47,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000006 succeeded | |
| 2016-10-17 15:24:47,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000006 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:24:47,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:47,096 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:47,098 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:47,098 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000006 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:24:47,102 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000006 from application application_1476741065528_0001 | |
| 2016-10-17 15:24:47,102 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000006 for log-aggregation | |
| 2016-10-17 15:24:47,102 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:48,520 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000007] | |
| 2016-10-17 15:24:48,525 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000041 by user cloudera | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000041 to application application_1476741065528_0001 | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000041 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:24:48,541 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:24:48,542 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000041 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:24:48,576 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000041 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:24:48,610 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000041/default_container_executor.sh] | |
| 2016-10-17 15:24:49,753 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:24:49,753 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:24:49,753 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000006 | |
| 2016-10-17 15:24:49,764 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 60.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:49,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 54.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:49,896 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 58.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:49,902 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 59 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:50,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 59.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:50,063 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:50,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 59.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:50,533 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000006] | |
| 2016-10-17 15:24:53,122 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 74.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:53,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 73.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:53,334 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 73.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:53,440 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 73 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:53,446 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 72.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:53,614 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:53,690 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 73.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,703 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 90.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,765 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 88.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,796 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 86.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,861 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 87.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,886 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 91.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:56,892 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:24:56,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 86.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:59,951 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 92.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:24:59,956 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 98.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:00,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 94.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:00,290 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 97.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:00,295 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 96.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:00,451 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:00,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 99.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,462 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 95.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 102.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,580 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 101.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,623 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 101.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,683 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 99.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:03,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:03,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 105.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:06,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 103.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:06,866 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 106.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:06,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 111.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:06,914 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 107.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:06,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 108.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:07,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:07,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 113.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:08,162 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:10,165 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11217 for container-id container_1476741065528_0001_01_000040: 192.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:10,301 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11241 for container-id container_1476741065528_0001_01_000041: 195.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:10,306 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11177 for container-id container_1476741065528_0001_01_000038: 199.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:10,450 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 93.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:10,539 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11138 for container-id container_1476741065528_0001_01_000036: 196.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:10,545 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 129.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:10,695 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11137 for container-id container_1476741065528_0001_01_000037: 200.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:11,392 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:11,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000040 succeeded | |
| 2016-10-17 15:25:11,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000040 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:11,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:25:11,632 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000036 succeeded | |
| 2016-10-17 15:25:11,633 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000041 succeeded | |
| 2016-10-17 15:25:11,685 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:25:11,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000036 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:11,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000041 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:11,687 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:25:11,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000040 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:11,689 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:25:11,716 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:11,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000065 by user cloudera | |
| 2016-10-17 15:25:11,722 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:11,741 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:25:11,743 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:25:11,754 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000040 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000040 for log-aggregation | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000065 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:25:11,756 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000036 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:11,759 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:25:11,759 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000041 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000065 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000036 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000036 for log-aggregation | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000041 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000041 for log-aggregation | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:11,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000065 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:11,780 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000065 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:11,783 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000065/default_container_executor.sh] | |
| 2016-10-17 15:25:11,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000037 succeeded | |
| 2016-10-17 15:25:11,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000037 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:11,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:25:11,872 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:25:11,872 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:25:11,873 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000037 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:11,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000037 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000037 for log-aggregation | |
| 2016-10-17 15:25:11,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:11,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000038 succeeded | |
| 2016-10-17 15:25:11,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000038 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:11,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:25:11,923 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:25:11,924 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:25:11,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000038 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000038 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000038 for log-aggregation | |
| 2016-10-17 15:25:11,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,394 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:12,723 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000066 by user cloudera | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000066 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000066 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:12,735 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:12,736 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000066 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:12,752 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:12,764 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:12,766 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:12,769 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000067 by user cloudera | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000067 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000067 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:12,804 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:12,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000067 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:12,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000068 by user cloudera | |
| 2016-10-17 15:25:12,808 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:12,839 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000066/default_container_executor.sh] | |
| 2016-10-17 15:25:12,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000068 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:12,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000066 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:12,840 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000068 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:12,840 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000068 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000069 by user cloudera | |
| 2016-10-17 15:25:12,841 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000069 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000069 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:12,867 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:12,868 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000069 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:12,892 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000067 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:12,896 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000067/default_container_executor.sh] | |
| 2016-10-17 15:25:12,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000068 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:12,928 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000068/default_container_executor.sh] | |
| 2016-10-17 15:25:12,939 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000040] | |
| 2016-10-17 15:25:12,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000069 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:12,964 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000069/default_container_executor.sh] | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000040 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000036 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000041 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000037 | |
| 2016-10-17 15:25:13,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000038 | |
| 2016-10-17 15:25:13,704 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 37.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,750 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 43.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 43.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 39.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,846 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 94.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,913 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:13,932 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 65.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:13,944 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000041, container_1476741065528_0001_01_000038, container_1476741065528_0001_01_000036, container_1476741065528_0001_01_000037] | |
| 2016-10-17 15:25:16,942 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 70.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:17,031 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 72.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:17,036 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 72.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:17,212 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 71.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:17,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 94.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:17,322 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:17,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 86.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,476 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 87.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 88.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,550 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 89.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 90.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 94.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:20,702 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:20,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 94.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:23,794 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 105.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:23,849 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 103.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:23,941 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 100.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:23,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 98.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:24,137 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 94.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:24,146 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:24,278 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 98.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,292 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 111.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,347 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 110.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,381 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 106.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,427 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 106.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,432 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 96.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:27,525 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:27,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 106.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,552 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11527 for container-id container_1476741065528_0001_01_000068: 218.7 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,659 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11511 for container-id container_1476741065528_0001_01_000066: 212.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11522 for container-id container_1476741065528_0001_01_000067: 209.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,853 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11543 for container-id container_1476741065528_0001_01_000069: 206.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,882 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 96.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:30,952 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:31,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11472 for container-id container_1476741065528_0001_01_000065: 207.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:31,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000065 succeeded | |
| 2016-10-17 15:25:31,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000065 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:31,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:31,608 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:31,760 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:31,760 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:31,761 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000065 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:31,763 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000065 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:31,763 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000065 for log-aggregation | |
| 2016-10-17 15:25:31,763 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:31,877 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:31,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0001_01_000089 by user cloudera | |
| 2016-10-17 15:25:31,909 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0001_01_000089 to application application_1476741065528_0001 | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000089 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0001 | |
| 2016-10-17 15:25:31,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000089 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:25:32,039 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000089 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:25:32,043 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000089/default_container_executor.sh] | |
| 2016-10-17 15:25:32,611 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:32,637 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000069 succeeded | |
| 2016-10-17 15:25:32,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000069 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:32,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:32,667 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:32,668 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:32,668 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000069 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000069 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000069 for log-aggregation | |
| 2016-10-17 15:25:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:32,774 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000066 succeeded | |
| 2016-10-17 15:25:32,774 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000066 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:32,774 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:32,798 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:32,799 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:32,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000066 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:32,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000066 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:32,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000066 for log-aggregation | |
| 2016-10-17 15:25:32,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:32,997 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000068 succeeded | |
| 2016-10-17 15:25:32,997 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000068 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:32,997 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:33,057 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000067 succeeded | |
| 2016-10-17 15:25:33,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:33,058 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000067 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:33,059 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:33,059 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000068 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:33,061 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000065] | |
| 2016-10-17 15:25:33,062 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:33,122 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:33,123 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000068 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:33,123 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000068 for log-aggregation | |
| 2016-10-17 15:25:33,123 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:33,123 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:33,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000067 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:33,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000067 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:33,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000067 for log-aggregation | |
| 2016-10-17 15:25:33,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:34,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:34,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000065 | |
| 2016-10-17 15:25:34,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000069 | |
| 2016-10-17 15:25:34,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000066 | |
| 2016-10-17 15:25:34,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000068 | |
| 2016-10-17 15:25:34,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000067 | |
| 2016-10-17 15:25:34,062 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 96.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:34,093 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11750 for container-id container_1476741065528_0001_01_000089: 95.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:34,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:34,128 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000066, container_1476741065528_0001_01_000069] | |
| 2016-10-17 15:25:35,138 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000068, container_1476741065528_0001_01_000067] | |
| 2016-10-17 15:25:36,603 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000089 succeeded | |
| 2016-10-17 15:25:36,604 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000089 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:36,604 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:36,635 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:36,635 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:36,636 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000089 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:36,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000089 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:36,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000089 for log-aggregation | |
| 2016-10-17 15:25:36,638 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:36,643 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:25:37,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000089 | |
| 2016-10-17 15:25:37,133 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11139 for container-id container_1476741065528_0001_01_000035: 100.6 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:25:37,138 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 130.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:38,652 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000089] | |
| 2016-10-17 15:25:38,748 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:38,761 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:38,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:25:38,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:38,769 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:38,787 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0001_01_000035 is : 143 | |
| 2016-10-17 15:25:38,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:25:38,835 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:38,843 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:38,843 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000035 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:25:38,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000035 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:38,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000035 for log-aggregation | |
| 2016-10-17 15:25:38,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:40,138 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000035 | |
| 2016-10-17 15:25:40,146 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 126.4 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:43,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10641 for container-id container_1476741065528_0001_01_000001: 126.8 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:25:45,036 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0001_01_000001 succeeded | |
| 2016-10-17 15:25:45,036 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:25:45,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:45,057 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001/container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:45,059 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:45,059 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:25:45,061 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0001_01_000001 from application application_1476741065528_0001 | |
| 2016-10-17 15:25:45,062 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0001_01_000001 for log-aggregation | |
| 2016-10-17 15:25:45,062 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:45,129 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0001_000001 (auth:SIMPLE) | |
| 2016-10-17 15:25:45,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:45,132 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0001 CONTAINERID=container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:46,063 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0001_01_000001] | |
| 2016-10-17 15:25:46,137 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP | |
| 2016-10-17 15:25:46,138 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1476741065528_0001 | |
| 2016-10-17 15:25:46,138 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0001 | |
| 2016-10-17 15:25:46,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0001_01_000001 | |
| 2016-10-17 15:25:46,156 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED | |
| 2016-10-17 15:25:46,156 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1476741065528_0001 | |
| 2016-10-17 15:25:46,708 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000068. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,718 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000068/stderr | |
| 2016-10-17 15:25:46,718 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000068/stdout | |
| 2016-10-17 15:25:46,718 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000068/syslog | |
| 2016-10-17 15:25:46,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000067. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,719 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000067/stderr | |
| 2016-10-17 15:25:46,719 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000067/syslog | |
| 2016-10-17 15:25:46,719 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000067/stdout | |
| 2016-10-17 15:25:46,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000066. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,727 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000066/syslog | |
| 2016-10-17 15:25:46,727 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000066/stderr | |
| 2016-10-17 15:25:46,727 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000066/stdout | |
| 2016-10-17 15:25:46,727 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000069. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,728 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000069/stderr | |
| 2016-10-17 15:25:46,728 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000069/stdout | |
| 2016-10-17 15:25:46,728 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000069/syslog | |
| 2016-10-17 15:25:46,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000065. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,729 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000065/stderr | |
| 2016-10-17 15:25:46,729 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000065/syslog | |
| 2016-10-17 15:25:46,729 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000065/stdout | |
| 2016-10-17 15:25:46,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000002. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,759 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000040. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,760 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000002/stdout | |
| 2016-10-17 15:25:46,760 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000002/syslog | |
| 2016-10-17 15:25:46,760 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000002/stderr | |
| 2016-10-17 15:25:46,771 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000040/stderr | |
| 2016-10-17 15:25:46,771 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000040/syslog | |
| 2016-10-17 15:25:46,771 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000040/stdout | |
| 2016-10-17 15:25:46,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000041. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,788 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000041/syslog | |
| 2016-10-17 15:25:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000041/stderr | |
| 2016-10-17 15:25:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000041/stdout | |
| 2016-10-17 15:25:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000004. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,814 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000004/stdout | |
| 2016-10-17 15:25:46,814 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000004/stderr | |
| 2016-10-17 15:25:46,814 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000004/syslog | |
| 2016-10-17 15:25:46,814 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000003. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,825 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000003/stdout | |
| 2016-10-17 15:25:46,825 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000003/syslog | |
| 2016-10-17 15:25:46,826 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000003/stderr | |
| 2016-10-17 15:25:46,826 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000038. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,826 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000038/stdout | |
| 2016-10-17 15:25:46,826 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000038/stderr | |
| 2016-10-17 15:25:46,826 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000038/syslog | |
| 2016-10-17 15:25:46,827 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000005. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,827 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000005/stderr | |
| 2016-10-17 15:25:46,827 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000005/stdout | |
| 2016-10-17 15:25:46,827 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000005/syslog | |
| 2016-10-17 15:25:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000035. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000035/stderr | |
| 2016-10-17 15:25:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000035/syslog.shuffle | |
| 2016-10-17 15:25:46,828 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000035/stdout | |
| 2016-10-17 15:25:46,829 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000035/syslog | |
| 2016-10-17 15:25:46,829 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000007. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,830 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000007/syslog | |
| 2016-10-17 15:25:46,830 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000007/stdout | |
| 2016-10-17 15:25:46,830 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000007/stderr | |
| 2016-10-17 15:25:46,830 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000089. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,831 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000089/stderr | |
| 2016-10-17 15:25:46,831 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000089/stdout | |
| 2016-10-17 15:25:46,831 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000089/syslog | |
| 2016-10-17 15:25:46,831 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000036. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,831 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000036/syslog | |
| 2016-10-17 15:25:46,832 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000036/stderr | |
| 2016-10-17 15:25:46,832 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000036/stdout | |
| 2016-10-17 15:25:46,832 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000001. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,871 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000001/syslog | |
| 2016-10-17 15:25:46,872 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000001/stdout | |
| 2016-10-17 15:25:46,872 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000001/stderr | |
| 2016-10-17 15:25:46,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000006. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,962 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000006/syslog | |
| 2016-10-17 15:25:46,962 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000006/stderr | |
| 2016-10-17 15:25:46,962 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000006/stdout | |
| 2016-10-17 15:25:46,962 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0001_01_000037. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:25:46,973 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000037/stdout | |
| 2016-10-17 15:25:46,973 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000037/syslog | |
| 2016-10-17 15:25:46,974 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001/container_1476741065528_0001_01_000037/stderr | |
| 2016-10-17 15:25:47,063 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0001 | |
| 2016-10-17 15:31:07,858 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:07,861 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000001 by user cloudera | |
| 2016-10-17 15:31:07,861 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1476741065528_0002 | |
| 2016-10-17 15:31:07,862 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:31:07,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0002 transitioned from NEW to INITING | |
| 2016-10-17 15:31:07,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000001 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:07,867 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished. | |
| 2016-10-17 15:31:07,874 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0002 transitioned from INITING to RUNNING | |
| 2016-10-17 15:31:07,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000001 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:07,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:07,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:31:07,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0002_01_000001.tokens. Credentials list: | |
| 2016-10-17 15:31:07,876 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user cloudera | |
| 2016-10-17 15:31:07,891 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0002_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000001.tokens | |
| 2016-10-17 15:31:07,891 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002 = file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002 | |
| 2016-10-17 15:31:07,997 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000001 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:08,010 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000001 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:08,013 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000001/default_container_executor.sh] | |
| 2016-10-17 15:31:10,254 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:31:10,266 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 97.8 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:13,273 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 131.5 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:15,026 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:15,029 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000002 by user cloudera | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000002 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000002 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:15,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000002 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:15,052 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000002 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:15,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000002/default_container_executor.sh] | |
| 2016-10-17 15:31:15,839 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:15,847 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000003 by user cloudera | |
| 2016-10-17 15:31:15,847 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:15,847 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000003 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000003 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:15,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000003 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:15,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000003 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:15,912 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000003/default_container_executor.sh] | |
| 2016-10-17 15:31:16,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:16,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:16,280 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 136.4 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:16,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 77.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:16,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 31.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:16,838 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:16,853 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000004 by user cloudera | |
| 2016-10-17 15:31:16,853 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:16,858 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000004 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000004 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:16,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000004 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:16,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000004 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:16,928 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000004/default_container_executor.sh] | |
| 2016-10-17 15:31:17,860 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:17,888 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000005 by user cloudera | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000005 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000005 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:17,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000005 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:18,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000005 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:18,040 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000005/default_container_executor.sh] | |
| 2016-10-17 15:31:18,878 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:18,917 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000006 by user cloudera | |
| 2016-10-17 15:31:18,917 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000006 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000006 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:18,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000006 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:19,066 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000006 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:19,069 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000006/default_container_executor.sh] | |
| 2016-10-17 15:31:19,335 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:19,335 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:19,335 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:31:19,340 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 136.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:19,405 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 98.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:19,480 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 60.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:19,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 77.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:19,562 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 43.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:19,655 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 15.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:19,907 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:19,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000007 by user cloudera | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000007 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000007 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:19,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000007 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:20,059 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000007 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:20,062 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000007/default_container_executor.sh] | |
| 2016-10-17 15:31:22,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:31:22,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 137.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:22,788 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 103.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:22,794 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 80.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:22,901 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 88.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:23,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 57.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:23,031 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 70.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:23,137 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 60.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,197 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 136.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:26,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 107.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,348 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 91.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 99.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,489 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 71.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,614 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 85.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:26,620 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 78.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,633 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 124.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:29,659 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 195.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,720 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 90.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,750 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 93.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,816 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 74.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,821 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 80.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:29,853 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 72.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:32,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: 194.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 89.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,881 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 90.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 73.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 82.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:32,902 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 71.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,565 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000002 succeeded | |
| 2016-10-17 15:31:35,565 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:31:35,565 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:35,908 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:35,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10492 for container-id container_1476741065528_0002_01_000002: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 91.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,943 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 91.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,959 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 72.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,973 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 83.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:35,998 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 72.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:36,505 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:36,506 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:36,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:31:36,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000002 from application application_1476741065528_0002 | |
| 2016-10-17 15:31:36,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000002 for log-aggregation | |
| 2016-10-17 15:31:36,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:37,245 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:37,266 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000025 by user cloudera | |
| 2016-10-17 15:31:37,266 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:31:37,266 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000025 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000025 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:37,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000025 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:37,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000025 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:37,331 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000025/default_container_executor.sh] | |
| 2016-10-17 15:31:38,516 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000002] | |
| 2016-10-17 15:31:39,003 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:31:39,003 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000002 | |
| 2016-10-17 15:31:39,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:39,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 97.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:39,140 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 15.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:39,222 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 94.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:39,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 85.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:39,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 92.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:39,424 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 87.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,483 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:42,491 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 201.5 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 22.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,504 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 196.6 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,512 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 85.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,519 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 194.8 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:42,524 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 92.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:47,374 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 203.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,380 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 24.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,388 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 198.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,394 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 83.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,399 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 196.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:47,405 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 88.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,420 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:50,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 200.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,606 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 24.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,629 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 195.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,680 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 83.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,735 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 193.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:50,755 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 88.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:54,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10543 for container-id container_1476741065528_0002_01_000004: 199.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 35.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10515 for container-id container_1476741065528_0002_01_000003: 195.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,100 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 87.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,111 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10568 for container-id container_1476741065528_0002_01_000005: 193.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:54,129 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 92.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:55,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000005 succeeded | |
| 2016-10-17 15:31:55,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000005 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:31:55,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:55,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000003 succeeded | |
| 2016-10-17 15:31:55,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000004 succeeded | |
| 2016-10-17 15:31:55,483 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:55,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000003 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:31:55,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000004 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:31:55,485 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:55,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000005 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:31:55,486 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:55,687 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:55,688 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:55,764 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:55,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000005 from application application_1476741065528_0002 | |
| 2016-10-17 15:31:55,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000005 for log-aggregation | |
| 2016-10-17 15:31:55,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:55,766 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:55,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000003 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:31:55,769 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:55,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000004 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:31:55,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000003 from application application_1476741065528_0002 | |
| 2016-10-17 15:31:55,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000003 for log-aggregation | |
| 2016-10-17 15:31:55,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:55,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000004 from application application_1476741065528_0002 | |
| 2016-10-17 15:31:55,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000004 for log-aggregation | |
| 2016-10-17 15:31:55,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:55,780 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000044 by user cloudera | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000044 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000044 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:55,784 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:55,785 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:55,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000044 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:55,814 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000044 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:55,889 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000044/default_container_executor.sh] | |
| 2016-10-17 15:31:56,776 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000005] | |
| 2016-10-17 15:31:56,826 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:56,834 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:31:56,974 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000046 by user cloudera | |
| 2016-10-17 15:31:56,974 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:31:56,974 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000046 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000046 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:56,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000046 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:56,983 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000045 by user cloudera | |
| 2016-10-17 15:31:56,984 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:31:56,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000045 to application application_1476741065528_0002 | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:31:56,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:31:57,014 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000046 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:57,017 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000046/default_container_executor.sh] | |
| 2016-10-17 15:31:57,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:31:57,021 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000045/default_container_executor.sh] | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000005 | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000003 | |
| 2016-10-17 15:31:57,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000004 | |
| 2016-10-17 15:31:57,139 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 13.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:31:57,219 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 16.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,237 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 70.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,249 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 90.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,265 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 15.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,303 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 95.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:31:57,784 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000004, container_1476741065528_0002_01_000003] | |
| 2016-10-17 15:32:00,312 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 48.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:00,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:00,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 51.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:00,348 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 70.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:00,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: 195.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:00,467 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 49.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:00,472 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: 201.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 69.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,624 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:03,630 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 70.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,691 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 84.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,694 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000007 succeeded | |
| 2016-10-17 15:32:03,695 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000007 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:03,695 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:32:03,695 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000006 succeeded | |
| 2016-10-17 15:32:03,806 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10626 for container-id container_1476741065528_0002_01_000007: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,857 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 70.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10598 for container-id container_1476741065528_0002_01_000006: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:03,865 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:32:03,866 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000006 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:03,866 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:32:03,867 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000007 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:03,886 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:32:04,024 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:32:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000007 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000007 for log-aggregation | |
| 2016-10-17 15:32:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:32:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000006 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:04,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000006 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:04,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000006 for log-aggregation | |
| 2016-10-17 15:32:04,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,795 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:04,815 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:04,844 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000055 by user cloudera | |
| 2016-10-17 15:32:04,844 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:04,844 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000055 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000055 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:04,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000055 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000056 by user cloudera | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000056 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000056 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:04,885 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:04,886 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:04,886 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000056 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:04,982 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000056/default_container_executor.sh] | |
| 2016-10-17 15:32:04,982 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000055 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:04,982 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000056 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:05,005 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000055/default_container_executor.sh] | |
| 2016-10-17 15:32:06,046 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000007, container_1476741065528_0002_01_000006] | |
| 2016-10-17 15:32:06,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:06,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:06,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000007 | |
| 2016-10-17 15:32:06,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000006 | |
| 2016-10-17 15:32:06,870 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 88.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:06,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.5 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:07,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 87.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:07,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 90.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:07,229 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 43.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:07,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 86.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:07,270 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 43.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,302 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 95.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,357 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.5 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:10,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 103.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,542 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 98.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,588 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 63.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,594 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 95.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:10,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 63.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:13,868 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 99.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:13,873 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:13,959 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 104.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:14,050 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 102.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:14,159 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 76.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:14,264 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 107.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:14,280 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 76.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,289 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 114.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,405 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:17,429 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 111.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10741 for container-id container_1476741065528_0002_01_000025: 205.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,533 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 89.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,656 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 115.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:17,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 92.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:18,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000025 succeeded | |
| 2016-10-17 15:32:18,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000025 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:18,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:32:18,664 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:32:18,666 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:32:18,666 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000025 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:18,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000025 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:18,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000025 for log-aggregation | |
| 2016-10-17 15:32:18,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:18,913 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:18,928 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:18,949 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000071 by user cloudera | |
| 2016-10-17 15:32:18,949 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000071 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000071 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:18,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000071 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:19,137 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000071/default_container_executor.sh] | |
| 2016-10-17 15:32:19,138 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000071 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:20,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:20,665 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000025 | |
| 2016-10-17 15:32:20,671 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 114.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:20,686 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000025] | |
| 2016-10-17 15:32:20,757 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:20,854 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10870 for container-id container_1476741065528_0002_01_000044: 213.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:20,919 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 102.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:20,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10887 for container-id container_1476741065528_0002_01_000046: 223.0 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 43.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:21,118 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 110.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:22,148 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:22,507 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000044 succeeded | |
| 2016-10-17 15:32:22,507 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000044 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:22,507 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:32:22,559 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:32:22,561 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:32:22,561 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000044 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:22,563 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000044 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:22,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000044 for log-aggregation | |
| 2016-10-17 15:32:22,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:22,951 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000075 by user cloudera | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000075 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000075 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:22,961 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:22,962 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000075 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:23,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000075 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:23,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000075/default_container_executor.sh] | |
| 2016-10-17 15:32:23,165 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:23,193 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000046 succeeded | |
| 2016-10-17 15:32:23,193 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000046 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:23,193 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:32:23,329 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:32:23,330 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:32:23,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000046 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:23,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000046 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:23,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000046 for log-aggregation | |
| 2016-10-17 15:32:23,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:23,961 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:23,966 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000076 by user cloudera | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000076 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000076 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000076 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:24,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000076 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:24,029 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000076/default_container_executor.sh] | |
| 2016-10-17 15:32:24,185 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:24,185 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:24,185 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000044 | |
| 2016-10-17 15:32:24,185 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000046 | |
| 2016-10-17 15:32:24,219 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 114.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:24,269 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:24,336 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000044] | |
| 2016-10-17 15:32:24,344 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 46.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:24,368 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 111.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:24,389 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 14.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:24,465 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 75.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:24,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 119.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:25,346 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000046] | |
| 2016-10-17 15:32:27,520 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 115.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:27,656 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:27,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 70.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:27,751 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10982 for container-id container_1476741065528_0002_01_000055: 212.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:27,857 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 59.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:27,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 91.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:27,940 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10985 for container-id container_1476741065528_0002_01_000056: 221.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:28,208 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:28,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000055 succeeded | |
| 2016-10-17 15:32:28,515 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000055 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:28,516 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:28,616 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:28,617 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:28,617 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000055 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:28,619 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000055 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:28,619 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000055 for log-aggregation | |
| 2016-10-17 15:32:28,619 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:28,836 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000056 succeeded | |
| 2016-10-17 15:32:28,836 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000056 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:28,836 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:28,946 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:28,947 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:28,947 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000056 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:28,949 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000056 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:28,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000056 for log-aggregation | |
| 2016-10-17 15:32:28,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:29,006 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:29,016 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000083 by user cloudera | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000083 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000083 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:29,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000083 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:29,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000082 by user cloudera | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000082 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000082 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:29,076 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:29,077 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000082 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:29,150 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000083 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:29,174 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000083/default_container_executor.sh] | |
| 2016-10-17 15:32:29,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000082 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:29,181 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000082/default_container_executor.sh] | |
| 2016-10-17 15:32:30,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:30,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:30,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000055 | |
| 2016-10-17 15:32:30,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000056 | |
| 2016-10-17 15:32:30,949 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 115.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:31,020 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000055, container_1476741065528_0002_01_000056] | |
| 2016-10-17 15:32:31,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:31,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 90.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:31,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 86.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:31,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 46.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:31,300 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 46.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:31,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 108.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,412 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 115.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,516 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:34,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 107.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 96.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,692 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 72.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 71.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:34,896 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 113.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:37,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 117.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:37,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:38,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 115.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:38,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 102.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:38,078 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 87 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:38,162 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 86.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:38,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11153 for container-id container_1476741065528_0002_01_000071: 209.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:40,245 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000071 succeeded | |
| 2016-10-17 15:32:40,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000071 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:40,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:40,327 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:40,359 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:40,360 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:40,360 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000071 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:40,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000071 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:40,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000071 for log-aggregation | |
| 2016-10-17 15:32:40,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:41,129 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0002_01_000095 by user cloudera | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0002_01_000095 to application application_1476741065528_0002 | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000095 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:32:41,147 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0002 | |
| 2016-10-17 15:32:41,148 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000095 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:32:41,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000071 | |
| 2016-10-17 15:32:41,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000095 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:32:41,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 117.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:41,253 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 122.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:41,256 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000095/default_container_executor.sh] | |
| 2016-10-17 15:32:41,359 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: 215.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:41,420 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 107.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:41,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 101.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:41,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 101.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:42,426 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000071] | |
| 2016-10-17 15:32:44,365 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:44,514 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:44,522 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 117.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,575 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000075 succeeded | |
| 2016-10-17 15:32:44,575 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000075 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:44,576 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:44,576 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:44,581 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11454 for container-id container_1476741065528_0002_01_000095: 59.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,610 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11204 for container-id container_1476741065528_0002_01_000075: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,665 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11242 for container-id container_1476741065528_0002_01_000076: 208.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 216.7 MB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,717 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 109.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:44,731 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:44,732 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:44,732 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000075 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:44,734 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000075 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:44,734 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000075 for log-aggregation | |
| 2016-10-17 15:32:44,734 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:45,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000076 succeeded | |
| 2016-10-17 15:32:45,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000076 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:45,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:45,124 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:45,125 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:45,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000076 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:45,127 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000076 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:45,127 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000076 for log-aggregation | |
| 2016-10-17 15:32:45,127 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:47,146 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000075, container_1476741065528_0002_01_000076] | |
| 2016-10-17 15:32:47,725 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000075 | |
| 2016-10-17 15:32:47,725 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000076 | |
| 2016-10-17 15:32:47,751 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 117.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:47,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:47,783 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11454 for container-id container_1476741065528_0002_01_000095: 87.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:47,811 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11318 for container-id container_1476741065528_0002_01_000082: 212.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:47,858 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11315 for container-id container_1476741065528_0002_01_000083: 214.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:48,398 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:48,446 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000082 succeeded | |
| 2016-10-17 15:32:48,446 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000082 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:48,446 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:48,505 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:48,506 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:48,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000082 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:48,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000082 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:48,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000082 for log-aggregation | |
| 2016-10-17 15:32:48,508 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:48,536 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000083 succeeded | |
| 2016-10-17 15:32:48,536 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000083 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:48,536 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:48,592 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:48,593 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:48,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000083 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:48,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000083 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:48,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000083 for log-aggregation | |
| 2016-10-17 15:32:48,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:50,409 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:32:50,615 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000082, container_1476741065528_0002_01_000083] | |
| 2016-10-17 15:32:50,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000082 | |
| 2016-10-17 15:32:50,864 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000083 | |
| 2016-10-17 15:32:50,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10889 for container-id container_1476741065528_0002_01_000045: 121.1 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:50,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000095 succeeded | |
| 2016-10-17 15:32:50,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000095 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:50,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:50,886 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 123.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:50,891 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 11454 for container-id container_1476741065528_0002_01_000095: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:32:50,906 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:50,907 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:50,907 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000095 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:50,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000095 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:50,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000095 for log-aggregation | |
| 2016-10-17 15:32:50,909 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:52,397 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:52,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:52,407 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:52,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:32:52,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:52,457 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0002_01_000045 is : 143 | |
| 2016-10-17 15:32:52,457 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:32:52,458 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:52,459 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:52,459 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000045 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:32:52,461 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000095] | |
| 2016-10-17 15:32:52,461 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000045 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:52,461 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000045 for log-aggregation | |
| 2016-10-17 15:32:52,461 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:53,891 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000095 | |
| 2016-10-17 15:32:53,892 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000045 | |
| 2016-10-17 15:32:53,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 119.2 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:56,904 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 10386 for container-id container_1476741065528_0002_01_000001: 119.6 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:32:58,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0002_01_000001 succeeded | |
| 2016-10-17 15:32:58,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:32:58,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:32:58,552 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002/container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:32:58,553 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:32:58,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:32:58,557 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0002_01_000001 from application application_1476741065528_0002 | |
| 2016-10-17 15:32:58,557 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0002_01_000001 for log-aggregation | |
| 2016-10-17 15:32:58,557 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:58,561 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0002_000001 (auth:SIMPLE) | |
| 2016-10-17 15:32:58,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:32:58,564 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0002 CONTAINERID=container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0002_01_000001] | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1476741065528_0002 | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1476741065528_0002 | |
| 2016-10-17 15:32:59,559 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0002 | |
| 2016-10-17 15:32:59,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000025. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000082. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000083. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000071. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000045. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000001. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000025/stdout | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000025/syslog | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000025/stderr | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000082/stderr | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000082/syslog | |
| 2016-10-17 15:32:59,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000082/stdout | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000083/syslog | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000083/stdout | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000083/stderr | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000071/syslog | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000071/stdout | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000071/stderr | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000045/stderr | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000045/syslog | |
| 2016-10-17 15:32:59,589 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000045/syslog.shuffle | |
| 2016-10-17 15:32:59,590 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000045/stdout | |
| 2016-10-17 15:32:59,596 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000002. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,597 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000001/stdout | |
| 2016-10-17 15:32:59,597 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000001/stderr | |
| 2016-10-17 15:32:59,597 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000001/syslog | |
| 2016-10-17 15:32:59,598 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000002/stdout | |
| 2016-10-17 15:32:59,598 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000002/syslog | |
| 2016-10-17 15:32:59,598 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000002/stderr | |
| 2016-10-17 15:32:59,598 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000004. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,599 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000004/syslog | |
| 2016-10-17 15:32:59,599 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000004/stdout | |
| 2016-10-17 15:32:59,599 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000004/stderr | |
| 2016-10-17 15:32:59,599 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000044. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,600 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000044/stderr | |
| 2016-10-17 15:32:59,600 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000044/syslog | |
| 2016-10-17 15:32:59,600 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000044/stdout | |
| 2016-10-17 15:32:59,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000003. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,601 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000003/stderr | |
| 2016-10-17 15:32:59,601 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000003/syslog | |
| 2016-10-17 15:32:59,601 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000003/stdout | |
| 2016-10-17 15:32:59,601 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000095. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,601 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000095/stderr | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000095/stdout | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000095/syslog | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000075. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000075/stderr | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000075/syslog | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000075/stdout | |
| 2016-10-17 15:32:59,602 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000055. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,605 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000055/stdout | |
| 2016-10-17 15:32:59,605 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000055/syslog | |
| 2016-10-17 15:32:59,605 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000055/stderr | |
| 2016-10-17 15:32:59,605 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000007. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,606 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000007/stdout | |
| 2016-10-17 15:32:59,606 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000007/syslog | |
| 2016-10-17 15:32:59,606 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000007/stderr | |
| 2016-10-17 15:32:59,606 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000076. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,607 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000076/stdout | |
| 2016-10-17 15:32:59,607 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000076/syslog | |
| 2016-10-17 15:32:59,607 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000076/stderr | |
| 2016-10-17 15:32:59,607 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000005. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000005/stderr | |
| 2016-10-17 15:32:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000005/stdout | |
| 2016-10-17 15:32:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000005/syslog | |
| 2016-10-17 15:32:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000046. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000046/syslog | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000046/stdout | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000046/stderr | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000006. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000006/stderr | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000006/stdout | |
| 2016-10-17 15:32:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000006/syslog | |
| 2016-10-17 15:32:59,610 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0002_01_000056. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:32:59,610 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000056/stderr | |
| 2016-10-17 15:32:59,610 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000056/stdout | |
| 2016-10-17 15:32:59,610 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002/container_1476741065528_0002_01_000056/syslog | |
| 2016-10-17 15:32:59,627 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0002 | |
| 2016-10-17 15:32:59,905 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0002_01_000001 | |
| 2016-10-17 15:48:20,985 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:20,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000001 by user cloudera | |
| 2016-10-17 15:48:20,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1476741065528_0003 | |
| 2016-10-17 15:48:20,989 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:48:20,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0003 transitioned from NEW to INITING | |
| 2016-10-17 15:48:20,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000001 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:20,993 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished. | |
| 2016-10-17 15:48:21,000 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0003 transitioned from INITING to RUNNING | |
| 2016-10-17 15:48:21,000 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000001 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:21,001 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:21,001 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:48:21,001 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0003_01_000001.tokens. Credentials list: | |
| 2016-10-17 15:48:21,002 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user cloudera | |
| 2016-10-17 15:48:21,003 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0003_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000001.tokens | |
| 2016-10-17 15:48:21,003 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003 = file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003 | |
| 2016-10-17 15:48:21,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000001 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:21,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000001 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:21,098 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000001/default_container_executor.sh] | |
| 2016-10-17 15:48:24,007 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:48:24,024 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 111.6 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:27,029 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 140.2 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:28,091 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000002 by user cloudera | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000002 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000002 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:28,095 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:28,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000002 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:28,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000002 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:28,123 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000002/default_container_executor.sh] | |
| 2016-10-17 15:48:28,930 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000003 by user cloudera | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000003 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000003 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:28,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000003 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:28,977 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000003 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:28,980 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000003/default_container_executor.sh] | |
| 2016-10-17 15:48:29,947 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:29,956 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000004 by user cloudera | |
| 2016-10-17 15:48:29,956 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:29,956 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000004 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000004 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:29,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000004 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:30,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000004 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:30,018 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000004/default_container_executor.sh] | |
| 2016-10-17 15:48:30,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:30,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:30,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:30,042 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12493 for container-id container_1476741065528_0003_01_000002: 88.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:30,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12512 for container-id container_1476741065528_0003_01_000003: 57.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:30,121 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 142.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:30,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 13.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:30,959 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000005 by user cloudera | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000005 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000005 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:30,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:30,981 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:30,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000005 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:31,087 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000005 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:31,092 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000005/default_container_executor.sh] | |
| 2016-10-17 15:48:31,981 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:31,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000006 by user cloudera | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000006 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000006 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:31,990 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000006 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:32,098 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000006 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:32,101 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000006/default_container_executor.sh] | |
| 2016-10-17 15:48:32,973 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:33,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000007 by user cloudera | |
| 2016-10-17 15:48:33,008 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:33,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000007 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000007 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:33,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000007 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:33,149 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000007 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:33,152 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000007/default_container_executor.sh] | |
| 2016-10-17 15:48:33,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:33,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:33,167 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:33,172 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12493 for container-id container_1476741065528_0003_01_000002: 103.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:33,289 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12512 for container-id container_1476741065528_0003_01_000003: 85.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:33,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:33,420 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 56.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:33,425 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 63.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:33,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 40.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:33,602 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 15.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:36,612 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12493 for container-id container_1476741065528_0003_01_000002: 113.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:36,699 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12512 for container-id container_1476741065528_0003_01_000003: 99.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:36,704 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:36,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 71.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:36,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 87.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:37,036 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 63.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:37,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 58.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,085 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12493 for container-id container_1476741065528_0003_01_000002: 212.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,151 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12512 for container-id container_1476741065528_0003_01_000003: 104.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,156 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:40,301 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 88.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000002 succeeded | |
| 2016-10-17 15:48:40,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:40,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:40,396 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 96.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,431 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 82.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,518 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 76.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:40,627 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:40,628 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:40,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:40,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000002 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:40,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000002 for log-aggregation | |
| 2016-10-17 15:48:40,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:41,109 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:41,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000016 by user cloudera | |
| 2016-10-17 15:48:41,116 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:48:41,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000016 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000016 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:41,117 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000016 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:41,297 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000016 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:41,300 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000016/default_container_executor.sh] | |
| 2016-10-17 15:48:42,648 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000002] | |
| 2016-10-17 15:48:43,527 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:48:43,527 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000002 | |
| 2016-10-17 15:48:43,536 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: 44.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:43,649 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12512 for container-id container_1476741065528_0003_01_000003: 109.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:43,654 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:43,808 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 98.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:43,813 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 102.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:43,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 99.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:43,933 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 92.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:46,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000003 succeeded | |
| 2016-10-17 15:48:46,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000003 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:46,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:46,692 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:46,693 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:46,693 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000003 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:46,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000003 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:46,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000003 for log-aggregation | |
| 2016-10-17 15:48:46,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:46,937 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000003 | |
| 2016-10-17 15:48:46,958 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: 70.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:46,963 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:47,040 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 104.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:47,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12540 for container-id container_1476741065528_0003_01_000004: 109.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:47,139 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:47,143 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 106.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:47,212 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 94.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000023 by user cloudera | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000023 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000023 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:47,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000023 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:47,277 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000023 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:47,280 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000023/default_container_executor.sh] | |
| 2016-10-17 15:48:48,718 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000003] | |
| 2016-10-17 15:48:49,298 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000004 succeeded | |
| 2016-10-17 15:48:49,299 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000004 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:49,299 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:49,360 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:49,361 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:49,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000004 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:49,363 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000004 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:49,363 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000004 for log-aggregation | |
| 2016-10-17 15:48:49,363 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:50,217 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:48:50,218 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000004 | |
| 2016-10-17 15:48:50,225 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: 91.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:50,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 144.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:50,282 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12561 for container-id container_1476741065528_0003_01_000005: 209.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:50,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: 60.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:50,335 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12582 for container-id container_1476741065528_0003_01_000006: 202.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:50,394 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12608 for container-id container_1476741065528_0003_01_000007: 105.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:50,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000005 succeeded | |
| 2016-10-17 15:48:50,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000005 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:50,521 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:50,658 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:50,659 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:50,659 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000005 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:50,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000005 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:50,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000005 for log-aggregation | |
| 2016-10-17 15:48:50,661 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,166 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:51,190 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000027 by user cloudera | |
| 2016-10-17 15:48:51,190 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:48:51,190 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000027 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:51,190 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000027 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:51,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:51,191 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:51,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000027 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:51,198 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000026 by user cloudera | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000026 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000026 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:51,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000026 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:51,254 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000027/default_container_executor.sh] | |
| 2016-10-17 15:48:51,327 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000026 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:51,327 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000027 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:51,331 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000026/default_container_executor.sh] | |
| 2016-10-17 15:48:51,426 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000006 succeeded | |
| 2016-10-17 15:48:51,426 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000006 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:51,426 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:51,522 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:51,523 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:51,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000006 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:51,526 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000004] | |
| 2016-10-17 15:48:51,526 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000006 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:51,526 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000006 for log-aggregation | |
| 2016-10-17 15:48:51,526 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:51,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000007 succeeded | |
| 2016-10-17 15:48:51,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000007 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:48:51,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:52,057 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:52,058 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:52,058 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000007 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:48:52,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000007 from application application_1476741065528_0003 | |
| 2016-10-17 15:48:52,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000007 for log-aggregation | |
| 2016-10-17 15:48:52,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:52,190 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:52,200 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000028 by user cloudera | |
| 2016-10-17 15:48:52,200 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:48:52,200 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000028 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000028 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:52,201 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000028 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:52,217 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:48:52,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000029 by user cloudera | |
| 2016-10-17 15:48:52,239 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000029 to application application_1476741065528_0003 | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000029 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:48:52,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000029 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:48:52,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000029 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:52,336 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000028 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:48:52,339 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000028/default_container_executor.sh] | |
| 2016-10-17 15:48:52,349 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000029/default_container_executor.sh] | |
| 2016-10-17 15:48:53,069 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000005] | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000005 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000006 | |
| 2016-10-17 15:48:53,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000007 | |
| 2016-10-17 15:48:53,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: 98.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:53,432 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 33.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:53,492 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 144.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:53,532 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 52.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:53,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 35.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:53,674 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: 87.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:53,710 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 58.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000006, container_1476741065528_0003_01_000007] | |
| 2016-10-17 15:48:56,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: 105.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:56,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 64.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:56,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 144.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:48:56,882 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 69.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:57,059 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 64.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:57,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: 100.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:48:57,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 72.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000016 succeeded | |
| 2016-10-17 15:49:00,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000016 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:00,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:49:00,240 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:49:00,244 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12702 for container-id container_1476741065528_0003_01_000016: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,245 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:49:00,245 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000016 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:00,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000016 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:00,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000016 for log-aggregation | |
| 2016-10-17 15:49:00,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:00,254 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 84.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,294 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:00,309 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000038 by user cloudera | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000038 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000038 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:00,310 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000038 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:00,413 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 144.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:00,457 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000038 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:00,459 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 87.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,464 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 85.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,538 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000038/default_container_executor.sh] | |
| 2016-10-17 15:49:00,541 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: 102.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:00,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 88.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:02,258 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000016] | |
| 2016-10-17 15:49:03,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:03,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000016 | |
| 2016-10-17 15:49:03,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 45.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:03,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 91.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:03,771 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:03,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 100.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:03,923 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 96.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:04,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: 104.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:04,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 100.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 62.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,161 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 100.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000023 succeeded | |
| 2016-10-17 15:49:07,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000023 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:07,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:49:07,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:07,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 105.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 107.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,365 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12769 for container-id container_1476741065528_0003_01_000023: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:07,438 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:49:07,438 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:49:07,438 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000023 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:07,441 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000023 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:07,442 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000023 for log-aggregation | |
| 2016-10-17 15:49:07,442 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:07,471 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 105.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:08,342 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000046 by user cloudera | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000046 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000046 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:08,350 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:08,351 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000046 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:08,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000046 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:08,419 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000046/default_container_executor.sh] | |
| 2016-10-17 15:49:09,449 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000023] | |
| 2016-10-17 15:49:10,471 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:10,472 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000023 | |
| 2016-10-17 15:49:10,477 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 84.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:10,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 113.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:10,493 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 143.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:10,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 111.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:10,505 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 114.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:10,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: 46.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:10,516 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 111.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:14,069 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 67.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:14,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 189.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:14,743 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:15,418 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 181.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:16,158 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 201.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:16,262 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: 60.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:16,870 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 199.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:20,377 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 70.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:20,382 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12919 for container-id container_1476741065528_0003_01_000029: 199 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:22,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 127.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:22,857 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12874 for container-id container_1476741065528_0003_01_000026: 198.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:22,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12922 for container-id container_1476741065528_0003_01_000028: 201.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:23,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: 63.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:23,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12872 for container-id container_1476741065528_0003_01_000027: 198.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:23,739 INFO org.apache.hadoop.util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 1726ms | |
| GC pool 'Copy' had collection(s): count=1 time=769ms | |
| 2016-10-17 15:49:25,458 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000026 succeeded | |
| 2016-10-17 15:49:25,460 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000028 succeeded | |
| 2016-10-17 15:49:25,461 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000029 succeeded | |
| 2016-10-17 15:49:25,463 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000027 succeeded | |
| 2016-10-17 15:49:25,580 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000026 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:25,581 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000028 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:25,581 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000029 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:25,581 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000027 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:25,581 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:49:25,872 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:49:25,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:49:25,917 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:49:25,917 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:49:25,967 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:49:25,971 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:49:26,021 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:49:26,021 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:49:26,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000026 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:26,023 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:49:26,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000028 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:26,024 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:49:26,024 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000029 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:26,025 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:49:26,025 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000027 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000026 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000026 for log-aggregation | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000028 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000028 for log-aggregation | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000029 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000029 for log-aggregation | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000027 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000027 for log-aggregation | |
| 2016-10-17 15:49:26,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000026 | |
| 2016-10-17 15:49:26,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000028 | |
| 2016-10-17 15:49:26,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000029 | |
| 2016-10-17 15:49:26,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000027 | |
| 2016-10-17 15:49:26,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 92.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:26,761 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.2 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:26,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: 86.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:26,781 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:26,781 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:26,824 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000063 by user cloudera | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000063 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000063 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:26,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000063 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:26,827 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:26,838 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000062 by user cloudera | |
| 2016-10-17 15:49:26,839 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000062 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000062 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:26,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000062 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:26,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000063 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:26,896 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000063/default_container_executor.sh] | |
| 2016-10-17 15:49:26,947 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000062 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:26,950 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000062/default_container_executor.sh] | |
| 2016-10-17 15:49:27,766 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:27,800 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000064 by user cloudera | |
| 2016-10-17 15:49:27,800 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000064 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000064 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:27,801 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000064 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:27,823 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000064 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:27,826 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000064/default_container_executor.sh] | |
| 2016-10-17 15:49:28,032 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000029, container_1476741065528_0003_01_000026, container_1476741065528_0003_01_000028, container_1476741065528_0003_01_000027] | |
| 2016-10-17 15:49:28,780 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:28,789 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000065 by user cloudera | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000065 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000065 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:28,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000065 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:28,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000065 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:28,856 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000065/default_container_executor.sh] | |
| 2016-10-17 15:49:29,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:29,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:29,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:29,766 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:30,082 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: 93.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:30,102 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 43.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:30,174 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.5 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:30,215 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 45.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:30,275 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: 91.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:30,292 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 46.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:30,394 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 46.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,339 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000046 succeeded | |
| 2016-10-17 15:49:33,339 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000046 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:33,339 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:33,350 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000038 succeeded | |
| 2016-10-17 15:49:33,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13018 for container-id container_1476741065528_0003_01_000038: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,522 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000038 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000046 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:33,525 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:33,527 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 70.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,532 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:33,536 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 70.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,671 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13081 for container-id container_1476741065528_0003_01_000046: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,676 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 71.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000046 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000046 for log-aggregation | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000038 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000038 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000038 for log-aggregation | |
| 2016-10-17 15:49:33,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,780 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:33,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 71.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:33,806 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:33,813 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:33,821 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000072 by user cloudera | |
| 2016-10-17 15:49:33,821 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:33,821 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000072 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000072 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:33,822 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000072 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:33,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000071 by user cloudera | |
| 2016-10-17 15:49:33,834 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:33,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000071 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:33,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000071 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:33,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:33,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:33,835 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:33,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000071 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:33,901 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000072/default_container_executor.sh] | |
| 2016-10-17 15:49:33,913 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000071 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:33,913 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000072 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:33,917 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000071/default_container_executor.sh] | |
| 2016-10-17 15:49:35,799 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000038, container_1476741065528_0003_01_000046] | |
| 2016-10-17 15:49:36,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:36,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:36,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000046 | |
| 2016-10-17 15:49:36,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000038 | |
| 2016-10-17 15:49:36,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 54.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:36,842 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 87.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:36,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:36,941 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 87.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:37,014 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 58.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:37,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 90.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:37,093 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 85.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,105 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 70.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,241 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 96.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:40,443 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 96.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,588 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 72.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 94.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:40,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 97.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:43,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 80.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:43,797 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 98.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:44,048 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:44,053 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 100.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:44,169 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 85.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:44,261 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 96.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:44,266 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 98.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,277 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 95.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,336 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 104.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,435 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:47,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 105.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,660 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 97.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,723 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: 102.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:47,832 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 105.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:50,842 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 103.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:50,894 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13289 for container-id container_1476741065528_0003_01_000065: 209.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:51,004 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 128.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:51,036 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13271 for container-id container_1476741065528_0003_01_000064: 209.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:51,068 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000062 succeeded | |
| 2016-10-17 15:49:51,069 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000062 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:51,069 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:51,113 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 101.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:51,169 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13242 for container-id container_1476741065528_0003_01_000062: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:51,228 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:51,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000062 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:51,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000062 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:51,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000062 for log-aggregation | |
| 2016-10-17 15:49:51,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,229 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:51,233 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13236 for container-id container_1476741065528_0003_01_000063: 209.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:51,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000065 succeeded | |
| 2016-10-17 15:49:51,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000065 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:51,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:51,539 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000064 succeeded | |
| 2016-10-17 15:49:51,539 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:51,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000064 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:51,540 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:51,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000065 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:51,542 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:51,627 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:51,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000065 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:51,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000065 for log-aggregation | |
| 2016-10-17 15:49:51,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,628 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:51,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000064 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:51,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000064 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:51,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000064 for log-aggregation | |
| 2016-10-17 15:49:51,631 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,803 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000063 succeeded | |
| 2016-10-17 15:49:51,803 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000063 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:51,803 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:51,851 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:51,852 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:51,853 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000063 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:51,856 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000063 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:51,856 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000063 for log-aggregation | |
| 2016-10-17 15:49:51,856 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,972 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:51,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000090 by user cloudera | |
| 2016-10-17 15:49:51,980 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:49:51,980 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000090 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:51,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:51,992 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:52,003 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:52,003 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000093 by user cloudera | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000093 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:52,009 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:52,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:52,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000091 by user cloudera | |
| 2016-10-17 15:49:52,080 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:49:52,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000092 by user cloudera | |
| 2016-10-17 15:49:52,081 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000091 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000092 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000091 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000092 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:52,084 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:52,085 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000091 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:52,085 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000092 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:52,152 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000091 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:52,153 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000092 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:52,162 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000092/default_container_executor.sh] | |
| 2016-10-17 15:49:52,216 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:52,219 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000090/default_container_executor.sh] | |
| 2016-10-17 15:49:52,229 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000091/default_container_executor.sh] | |
| 2016-10-17 15:49:52,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:52,261 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000093/default_container_executor.sh] | |
| 2016-10-17 15:49:53,869 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000065, container_1476741065528_0003_01_000064, container_1476741065528_0003_01_000062, container_1476741065528_0003_01_000063] | |
| 2016-10-17 15:49:54,237 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000062 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000065 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000064 | |
| 2016-10-17 15:49:54,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000063 | |
| 2016-10-17 15:49:54,243 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13357 for container-id container_1476741065528_0003_01_000072: 112.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:54,391 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 47.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:54,396 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:54,463 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 49.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:54,555 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13360 for container-id container_1476741065528_0003_01_000071: 111.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:54,561 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 50.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:54,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 50.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:56,128 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000072 succeeded | |
| 2016-10-17 15:49:56,129 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000072 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:56,129 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:56,252 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:56,253 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:56,253 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000072 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:56,256 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000072 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:56,256 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000072 for log-aggregation | |
| 2016-10-17 15:49:56,257 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:56,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000071 succeeded | |
| 2016-10-17 15:49:56,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000071 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:49:56,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:56,824 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:56,824 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:56,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000071 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:49:56,827 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000071 from application application_1476741065528_0003 | |
| 2016-10-17 15:49:56,827 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000071 for log-aggregation | |
| 2016-10-17 15:49:56,827 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:57,028 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:57,037 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000099 by user cloudera | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000099 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:57,067 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:57,068 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:57,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0003_01_000098 by user cloudera | |
| 2016-10-17 15:49:57,079 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0003_01_000098 to application application_1476741065528_0003 | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0003 | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0003 | |
| 2016-10-17 15:49:57,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:49:57,263 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000098/default_container_executor.sh] | |
| 2016-10-17 15:49:57,263 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:57,263 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:49:57,266 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000099/default_container_executor.sh] | |
| 2016-10-17 15:49:57,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:49:57,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:49:57,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000072 | |
| 2016-10-17 15:49:57,588 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000071 | |
| 2016-10-17 15:49:57,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 70.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:57,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:49:57,772 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 72.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:57,832 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 71.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:57,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 71.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:57,898 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13714 for container-id container_1476741065528_0003_01_000099: 20.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:57,903 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13716 for container-id container_1476741065528_0003_01_000098: 20.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:49:58,840 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000072, container_1476741065528_0003_01_000071] | |
| 2016-10-17 15:50:00,912 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 86.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:00,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:00,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 86.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:01,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 86.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:01,035 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 86.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:01,111 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13714 for container-id container_1476741065528_0003_01_000099: 60.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:01,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13716 for container-id container_1476741065528_0003_01_000098: 60.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,122 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 96.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,242 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:04,292 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 99.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,467 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 98.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,542 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 96.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13714 for container-id container_1476741065528_0003_01_000099: 75.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:04,702 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13716 for container-id container_1476741065528_0003_01_000098: 74.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:07,730 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 103.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:07,736 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:07,851 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 102.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:07,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 101.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:07,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 99.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:08,052 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13714 for container-id container_1476741065528_0003_01_000099: 88.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:08,057 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13716 for container-id container_1476741065528_0003_01_000098: 88.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13574 for container-id container_1476741065528_0003_01_000090: 114.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,135 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:11,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13576 for container-id container_1476741065528_0003_01_000091: 106.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,262 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13587 for container-id container_1476741065528_0003_01_000093: 108.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13567 for container-id container_1476741065528_0003_01_000092: 104.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13714 for container-id container_1476741065528_0003_01_000099: 100.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:11,493 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 13716 for container-id container_1476741065528_0003_01_000098: 98.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:50:13,237 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,239 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,243 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,245 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,282 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:13,282 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:13,282 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:50:13,282 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:13,285 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:13,285 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:13,327 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:13,327 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:13,327 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:13,327 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:13,404 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0003_01_000090 is : 143 | |
| 2016-10-17 15:50:13,408 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:50:13,408 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:50:13,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:50:13,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:50:13,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:13,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:13,461 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0003_01_000099 is : 143 | |
| 2016-10-17 15:50:13,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:13,546 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0003_01_000098 is : 143 | |
| 2016-10-17 15:50:13,556 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0003_01_000093 is : 143 | |
| 2016-10-17 15:50:13,566 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:13,582 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:50:13,582 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:50:13,582 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:50:13,583 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:13,583 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000090 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:50:13,586 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:13,587 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:13,588 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:13,588 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000090 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000090 for log-aggregation | |
| 2016-10-17 15:50:13,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,589 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:13,592 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000099 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000098 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000093 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000099 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000099 for log-aggregation | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000098 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000098 for log-aggregation | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000093 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000093 for log-aggregation | |
| 2016-10-17 15:50:13,593 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,684 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000091 succeeded | |
| 2016-10-17 15:50:13,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000091 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:50:13,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:13,686 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000092 succeeded | |
| 2016-10-17 15:50:13,717 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:13,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000092 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:50:13,728 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:13,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000091 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:50:13,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:13,756 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,757 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:13,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000091 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000091 for log-aggregation | |
| 2016-10-17 15:50:13,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,758 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:13,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000092 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:50:13,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000092 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:13,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000092 for log-aggregation | |
| 2016-10-17 15:50:13,760 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:13,762 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:13,762 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:13,765 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:13,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:13,768 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000090 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000099 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000098 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000093 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000091 | |
| 2016-10-17 15:50:14,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000092 | |
| 2016-10-17 15:50:14,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 129.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:17,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 12383 for container-id container_1476741065528_0003_01_000001: 125.6 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:50:19,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0003_01_000001 succeeded | |
| 2016-10-17 15:50:19,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:50:19,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:20,003 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003/container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:20,003 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:20,003 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:50:20,004 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0003_01_000001 from application application_1476741065528_0003 | |
| 2016-10-17 15:50:20,004 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0003_01_000001 for log-aggregation | |
| 2016-10-17 15:50:20,004 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:20,069 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0003_000001 (auth:SIMPLE) | |
| 2016-10-17 15:50:20,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:20,073 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0003 CONTAINERID=container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:20,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0003_01_000001 | |
| 2016-10-17 15:50:21,014 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0003_01_000001] | |
| 2016-10-17 15:50:21,014 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP | |
| 2016-10-17 15:50:21,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1476741065528_0003 | |
| 2016-10-17 15:50:21,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED | |
| 2016-10-17 15:50:21,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1476741065528_0003 | |
| 2016-10-17 15:50:21,015 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0003 | |
| 2016-10-17 15:50:21,035 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000002. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,037 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000002/syslog | |
| 2016-10-17 15:50:21,037 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000002/stdout | |
| 2016-10-17 15:50:21,037 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000002/stderr | |
| 2016-10-17 15:50:21,037 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000064. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,038 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000064/stdout | |
| 2016-10-17 15:50:21,038 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000064/syslog | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000064/stderr | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000091. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000091/stderr | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000091/syslog | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000091/stdout | |
| 2016-10-17 15:50:21,039 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000093. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,040 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000093/stderr | |
| 2016-10-17 15:50:21,040 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000093/syslog | |
| 2016-10-17 15:50:21,040 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000093/stdout | |
| 2016-10-17 15:50:21,040 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000004. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,041 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000004/stdout | |
| 2016-10-17 15:50:21,041 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000004/stderr | |
| 2016-10-17 15:50:21,041 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000004/syslog | |
| 2016-10-17 15:50:21,041 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000062. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,042 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000062/syslog | |
| 2016-10-17 15:50:21,042 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000062/stderr | |
| 2016-10-17 15:50:21,042 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000062/stdout | |
| 2016-10-17 15:50:21,042 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000006. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,043 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000006/stdout | |
| 2016-10-17 15:50:21,043 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000006/syslog | |
| 2016-10-17 15:50:21,043 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000006/stderr | |
| 2016-10-17 15:50:21,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000038. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,044 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000038/stdout | |
| 2016-10-17 15:50:21,044 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000038/syslog | |
| 2016-10-17 15:50:21,044 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000038/stderr | |
| 2016-10-17 15:50:21,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000026. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000026/stderr | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000026/stdout | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000026/syslog | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000071. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000071/stderr | |
| 2016-10-17 15:50:21,045 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000071/stdout | |
| 2016-10-17 15:50:21,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000071/syslog | |
| 2016-10-17 15:50:21,046 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000028. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000028/syslog | |
| 2016-10-17 15:50:21,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000028/stderr | |
| 2016-10-17 15:50:21,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000028/stdout | |
| 2016-10-17 15:50:21,047 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000023. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000023/stdout | |
| 2016-10-17 15:50:21,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000023/stderr | |
| 2016-10-17 15:50:21,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000023/syslog | |
| 2016-10-17 15:50:21,048 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000046. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,049 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000046/stdout | |
| 2016-10-17 15:50:21,049 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000046/stderr | |
| 2016-10-17 15:50:21,049 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000046/syslog | |
| 2016-10-17 15:50:21,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000072. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000072/stdout | |
| 2016-10-17 15:50:21,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000072/stderr | |
| 2016-10-17 15:50:21,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000072/syslog | |
| 2016-10-17 15:50:21,050 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000003. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000003/syslog | |
| 2016-10-17 15:50:21,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000003/stdout | |
| 2016-10-17 15:50:21,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000003/stderr | |
| 2016-10-17 15:50:21,051 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000001. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,071 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000001/stdout | |
| 2016-10-17 15:50:21,071 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000001/stderr | |
| 2016-10-17 15:50:21,071 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000001/syslog | |
| 2016-10-17 15:50:21,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000065. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,072 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000065/syslog | |
| 2016-10-17 15:50:21,072 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000065/stderr | |
| 2016-10-17 15:50:21,072 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000065/stdout | |
| 2016-10-17 15:50:21,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000005. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000005/stdout | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000005/stderr | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000005/syslog | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000092. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000092/stderr | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000092/syslog | |
| 2016-10-17 15:50:21,073 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000092/stdout | |
| 2016-10-17 15:50:21,074 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000007. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,074 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000007/stdout | |
| 2016-10-17 15:50:21,074 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000007/syslog | |
| 2016-10-17 15:50:21,074 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000007/stderr | |
| 2016-10-17 15:50:21,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000099. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,075 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000099/stderr | |
| 2016-10-17 15:50:21,075 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000099/stdout | |
| 2016-10-17 15:50:21,075 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000099/syslog | |
| 2016-10-17 15:50:21,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000098. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,076 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000098/stdout | |
| 2016-10-17 15:50:21,076 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000098/stderr | |
| 2016-10-17 15:50:21,076 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000098/syslog | |
| 2016-10-17 15:50:21,076 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000063. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,076 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000063/stderr | |
| 2016-10-17 15:50:21,077 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000063/stdout | |
| 2016-10-17 15:50:21,077 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000063/syslog | |
| 2016-10-17 15:50:21,077 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000016. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,078 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000016/stderr | |
| 2016-10-17 15:50:21,078 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000016/stdout | |
| 2016-10-17 15:50:21,078 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000016/syslog | |
| 2016-10-17 15:50:21,078 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000029. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000029/stderr | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000029/stdout | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000029/syslog | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000090. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000090/stdout | |
| 2016-10-17 15:50:21,079 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000090/syslog | |
| 2016-10-17 15:50:21,080 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000090/stderr | |
| 2016-10-17 15:50:21,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0003_01_000027. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:50:21,080 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000027/stderr | |
| 2016-10-17 15:50:21,081 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000027/stdout | |
| 2016-10-17 15:50:21,081 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003/container_1476741065528_0003_01_000027/syslog | |
| 2016-10-17 15:50:21,101 WARN org.apache.hadoop.hdfs.DFSClient: Caught exception | |
| java.lang.InterruptedException | |
| at java.lang.Object.wait(Native Method) | |
| at java.lang.Thread.join(Thread.java:1281) | |
| at java.lang.Thread.join(Thread.java:1355) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789) | |
| 2016-10-17 15:50:21,130 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0003 | |
| 2016-10-17 15:53:16,624 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000001 by user cloudera | |
| 2016-10-17 15:53:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1476741065528_0004 | |
| 2016-10-17 15:53:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:53:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0004 transitioned from NEW to INITING | |
| 2016-10-17 15:53:16,645 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000001 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:16,650 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished. | |
| 2016-10-17 15:53:16,658 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0004 transitioned from INITING to RUNNING | |
| 2016-10-17 15:53:16,658 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000001 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:16,658 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:16,658 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:53:16,659 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0004_01_000001.tokens. Credentials list: | |
| 2016-10-17 15:53:16,659 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user cloudera | |
| 2016-10-17 15:53:16,660 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476741065528_0004_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000001.tokens | |
| 2016-10-17 15:53:16,660 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004 = file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004 | |
| 2016-10-17 15:53:16,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000001 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:16,758 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000001 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:16,761 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000001/default_container_executor.sh] | |
| 2016-10-17 15:53:17,538 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:53:17,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 68.0 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:20,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 126.3 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:23,559 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 143.4 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:23,886 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:23,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000002 by user cloudera | |
| 2016-10-17 15:53:23,889 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:23,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000002 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:23,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000002 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:23,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:23,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:23,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:23,890 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:23,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000002 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:23,915 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000002 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:23,917 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000002/default_container_executor.sh] | |
| 2016-10-17 15:53:24,740 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000003 by user cloudera | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000003 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000003 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:24,744 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000003 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:24,778 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000003 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:24,781 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000003/default_container_executor.sh] | |
| 2016-10-17 15:53:25,743 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:25,746 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000004 by user cloudera | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000004 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000004 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:25,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000004 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:25,796 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000004 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:25,799 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000004/default_container_executor.sh] | |
| 2016-10-17 15:53:26,568 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:26,569 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:26,569 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:26,582 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 63.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:26,594 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 42.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:26,656 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14408 for container-id container_1476741065528_0004_01_000002: 95.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:26,715 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:26,752 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:26,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000005 by user cloudera | |
| 2016-10-17 15:53:26,775 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:26,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000005 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:26,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000005 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:26,776 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:26,776 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:26,776 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:26,776 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:26,776 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000005 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:26,898 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000005 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:26,901 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000005/default_container_executor.sh] | |
| 2016-10-17 15:53:27,782 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000006 by user cloudera | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000006 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000006 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000006 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:27,903 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000006 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:27,906 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000006/default_container_executor.sh] | |
| 2016-10-17 15:53:28,782 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:28,811 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000007 by user cloudera | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000007 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000007 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:28,812 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000007 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:28,938 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000007 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:28,941 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000007/default_container_executor.sh] | |
| 2016-10-17 15:53:29,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:29,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:29,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:29,725 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 43.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:29,754 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 57.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:29,873 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 25.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:29,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 87.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:30,030 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 70.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:30,103 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14408 for container-id container_1476741065528_0004_01_000002: 107.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:30,193 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.5 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:33,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 68.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,288 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 72.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,304 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 60.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,450 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 98.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,531 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 87.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,537 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14408 for container-id container_1476741065528_0004_01_000002: 114.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:33,634 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 144.5 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:36,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 85.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:36,684 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 88.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:36,846 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 77.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:36,932 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 107.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:37,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 99.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:37,165 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14408 for container-id container_1476741065528_0004_01_000002: 215.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:37,261 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 144.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:40,038 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000002 succeeded | |
| 2016-10-17 15:53:40,038 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:40,038 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:40,221 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:40,222 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:40,222 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:40,224 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000002 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:40,224 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000002 for log-aggregation | |
| 2016-10-17 15:53:40,224 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:40,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000002 | |
| 2016-10-17 15:53:40,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 91.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:40,360 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 97.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:40,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 86.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:40,484 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 113.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:40,610 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 105.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:40,687 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 144.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:40,959 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:40,998 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000019 by user cloudera | |
| 2016-10-17 15:53:40,998 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000019 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000019 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:40,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000019 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:41,118 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000019 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:41,122 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000019/default_container_executor.sh] | |
| 2016-10-17 15:53:42,250 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000002] | |
| 2016-10-17 15:53:43,689 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:53:43,694 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 100.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:43,783 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 103.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:43,831 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 98.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:43,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14430 for container-id container_1476741065528_0004_01_000003: 221.3 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:43,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 53.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:43,998 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 108.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:44,063 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:46,280 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000003 succeeded | |
| 2016-10-17 15:53:46,280 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000003 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:46,280 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:46,400 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:46,401 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:46,401 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000003 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:46,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000003 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:46,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000003 for log-aggregation | |
| 2016-10-17 15:53:46,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:47,025 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000026 by user cloudera | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000026 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000026 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:47,028 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:47,029 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000026 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:47,100 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000003 | |
| 2016-10-17 15:53:47,105 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 107.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:47,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000026 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:47,114 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000026/default_container_executor.sh] | |
| 2016-10-17 15:53:47,219 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: 209.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:47,225 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 105.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:47,331 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 72.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:47,336 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14464 for container-id container_1476741065528_0004_01_000004: 213.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:47,477 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:48,480 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000003] | |
| 2016-10-17 15:53:49,319 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000004 succeeded | |
| 2016-10-17 15:53:49,320 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000004 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:49,320 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:49,456 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:49,456 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:49,457 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000004 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:49,459 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000004 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:49,459 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000004 for log-aggregation | |
| 2016-10-17 15:53:49,459 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:50,020 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:50,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000029 by user cloudera | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000029 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000029 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:50,027 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000029 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:50,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000029 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:50,115 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000029/default_container_executor.sh] | |
| 2016-10-17 15:53:50,478 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:53:50,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:53:50,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000004 | |
| 2016-10-17 15:53:50,487 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14511 for container-id container_1476741065528_0004_01_000006: 212.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000005 succeeded | |
| 2016-10-17 15:53:50,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000005 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:50,548 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:50,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14487 for container-id container_1476741065528_0004_01_000005: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,615 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 15.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,743 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14539 for container-id container_1476741065528_0004_01_000007: 209.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,748 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 90.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,803 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:50,804 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:50,804 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000005 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:50,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000005 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:50,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000005 for log-aggregation | |
| 2016-10-17 15:53:50,807 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:50,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 59.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:50,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:51,066 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:51,093 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000031 by user cloudera | |
| 2016-10-17 15:53:51,093 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000031 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:51,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:51,230 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:51,233 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000031/default_container_executor.sh] | |
| 2016-10-17 15:53:51,810 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000004] | |
| 2016-10-17 15:53:52,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000006 succeeded | |
| 2016-10-17 15:53:52,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000006 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:52,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:52,313 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:52,314 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:52,314 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000006 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:52,317 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000005] | |
| 2016-10-17 15:53:52,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000006 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:52,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000006 for log-aggregation | |
| 2016-10-17 15:53:52,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:53,060 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:53,082 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000033 by user cloudera | |
| 2016-10-17 15:53:53,082 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000033 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000033 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:53,083 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000033 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:53,210 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000033 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:53,211 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000007 succeeded | |
| 2016-10-17 15:53:53,211 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000007 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:53:53,211 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:53,214 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000033/default_container_executor.sh] | |
| 2016-10-17 15:53:53,368 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:53,369 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:53,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000007 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:53:53,373 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000007 from application application_1476741065528_0004 | |
| 2016-10-17 15:53:53,373 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000007 for log-aggregation | |
| 2016-10-17 15:53:53,373 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:53,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:53:53,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:53:53,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000005 | |
| 2016-10-17 15:53:53,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000006 | |
| 2016-10-17 15:53:53,989 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000007 | |
| 2016-10-17 15:53:53,998 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 25.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:54,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 59.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:54,074 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:53:54,078 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000035 by user cloudera | |
| 2016-10-17 15:53:54,078 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000035 to application application_1476741065528_0004 | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000035 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:53:54,079 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:53:54,080 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000035 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:53:54,228 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 100.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:54,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 57.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:54,319 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000035 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:53:54,327 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000035/default_container_executor.sh] | |
| 2016-10-17 15:53:54,339 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 78.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:54,403 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000006] | |
| 2016-10-17 15:53:54,405 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:53:55,410 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000007] | |
| 2016-10-17 15:53:57,408 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:53:57,414 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 60.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,470 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 58.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 78.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,639 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 106.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 74.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,768 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 95.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:53:57,783 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:00,794 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 74.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:00,904 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 71.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:00,943 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 90.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:01,079 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 210 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:01,085 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 89.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:01,183 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 101.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:01,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:04,394 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 84.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 88.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,580 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 97.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14649 for container-id container_1476741065528_0004_01_000019: 210.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,731 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 96.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,736 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 108.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:04,911 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:05,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000019 succeeded | |
| 2016-10-17 15:54:05,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000019 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:05,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:54:05,774 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:54:05,774 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:54:05,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000019 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:05,777 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000019 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:05,777 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000019 for log-aggregation | |
| 2016-10-17 15:54:05,777 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:06,207 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000048 by user cloudera | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000048 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000048 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:06,239 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:06,240 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000048 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:06,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000048 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:06,324 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000048/default_container_executor.sh] | |
| 2016-10-17 15:54:07,790 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000019] | |
| 2016-10-17 15:54:07,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:07,919 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000019 | |
| 2016-10-17 15:54:07,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 98.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:07,970 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 95.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:07,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 100.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:08,131 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 101.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:08,183 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 112.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:08,225 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 42.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:08,291 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:11,332 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 103.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,337 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 102.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,360 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:11,408 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 106.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,478 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 107.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,493 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14740 for container-id container_1476741065528_0004_01_000026: 214.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,569 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 69.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:11,575 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:11,712 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:11,870 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000026 succeeded | |
| 2016-10-17 15:54:11,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000026 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:11,871 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:54:11,950 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:54:11,951 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:54:11,951 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000026 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:11,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000026 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:11,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000026 for log-aggregation | |
| 2016-10-17 15:54:11,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:12,297 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:12,323 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000055 by user cloudera | |
| 2016-10-17 15:54:12,323 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:12,323 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000055 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000055 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:12,324 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000055 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:12,419 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000055 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:12,422 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000055/default_container_executor.sh] | |
| 2016-10-17 15:54:13,970 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000026] | |
| 2016-10-17 15:54:14,579 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:14,579 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000026 | |
| 2016-10-17 15:54:14,634 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14872 for container-id container_1476741065528_0004_01_000033: 213.4 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:14,680 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14902 for container-id container_1476741065528_0004_01_000035: 213.0 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:14,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14811 for container-id container_1476741065528_0004_01_000029: 207.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:14,742 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:14,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 57.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:14,826 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 107.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:14,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000029 succeeded | |
| 2016-10-17 15:54:14,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000029 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:14,834 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:54:14,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 93.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:15,001 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:15,019 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:54:15,020 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:54:15,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000029 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:15,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000029 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:15,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000029 for log-aggregation | |
| 2016-10-17 15:54:15,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:15,346 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000059 by user cloudera | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000059 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000059 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:15,375 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:15,376 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:15,376 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:15,376 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000059 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:15,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000059 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:15,489 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000059/default_container_executor.sh] | |
| 2016-10-17 15:54:16,762 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:17,041 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000029] | |
| 2016-10-17 15:54:17,299 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000033 succeeded | |
| 2016-10-17 15:54:17,300 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000033 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:17,300 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:54:17,399 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:54:17,400 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:54:17,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000033 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:17,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000033 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:17,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000033 for log-aggregation | |
| 2016-10-17 15:54:17,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:17,636 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000035 succeeded | |
| 2016-10-17 15:54:17,636 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000035 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:17,636 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:54:17,687 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:54:17,689 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:54:17,689 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000035 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:17,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000035 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:17,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000035 for log-aggregation | |
| 2016-10-17 15:54:17,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:17,772 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:18,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:18,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000029 | |
| 2016-10-17 15:54:18,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000033 | |
| 2016-10-17 15:54:18,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000035 | |
| 2016-10-17 15:54:18,014 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 57.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:18,069 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 72.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:18,086 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 108.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:18,170 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 102.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:18,175 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:18,381 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:18,384 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:18,391 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000063 by user cloudera | |
| 2016-10-17 15:54:18,391 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:18,391 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000063 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000063 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:18,392 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000063 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:18,408 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000062 by user cloudera | |
| 2016-10-17 15:54:18,408 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000062 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000062 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:18,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000062 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:18,492 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000063 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:18,495 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000063/default_container_executor.sh] | |
| 2016-10-17 15:54:18,532 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000062 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:18,534 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000062/default_container_executor.sh] | |
| 2016-10-17 15:54:19,710 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000033, container_1476741065528_0004_01_000035] | |
| 2016-10-17 15:54:21,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:21,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:21,185 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15206 for container-id container_1476741065528_0004_01_000063: 58.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,287 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 76.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,303 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 92.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,308 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 108.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,444 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15212 for container-id container_1476741065528_0004_01_000062: 58.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,539 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 111.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:21,545 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:24,587 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15206 for container-id container_1476741065528_0004_01_000063: 72.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:24,642 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 91.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:24,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 98.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:24,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 108.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:24,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15212 for container-id container_1476741065528_0004_01_000062: 77.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:24,926 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15007 for container-id container_1476741065528_0004_01_000048: 216.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:25,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:26,932 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:27,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000048 succeeded | |
| 2016-10-17 15:54:27,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000048 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:27,685 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:27,789 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:27,789 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:27,790 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000048 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000048 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000048 for log-aggregation | |
| 2016-10-17 15:54:27,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:28,078 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000048 | |
| 2016-10-17 15:54:28,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15206 for container-id container_1476741065528_0004_01_000063: 91.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:28,147 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 99.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:28,171 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 104.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:28,176 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 110.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:28,291 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15212 for container-id container_1476741065528_0004_01_000062: 93.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:28,343 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:28,475 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476741065528_0004_01_000073 by user cloudera | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476741065528_0004_01_000073 to application application_1476741065528_0004 | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000073 transitioned from NEW to LOCALIZING | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-17 15:54:28,481 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476741065528_0004 | |
| 2016-10-17 15:54:28,482 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000073 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-17 15:54:28,570 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000073 transitioned from LOCALIZED to RUNNING | |
| 2016-10-17 15:54:28,573 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000073/default_container_executor.sh] | |
| 2016-10-17 15:54:29,810 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000048] | |
| 2016-10-17 15:54:31,348 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:31,355 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15322 for container-id container_1476741065528_0004_01_000073: 53.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,440 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15206 for container-id container_1476741065528_0004_01_000063: 101.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,446 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 105.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,542 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15102 for container-id container_1476741065528_0004_01_000055: 209.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,622 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 110.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,627 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15212 for container-id container_1476741065528_0004_01_000062: 98.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:31,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:32,992 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:33,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000055 succeeded | |
| 2016-10-17 15:54:33,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000055 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:33,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:33,520 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:33,521 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:33,522 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000055 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000055 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000055 for log-aggregation | |
| 2016-10-17 15:54:33,523 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:34,699 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000055 | |
| 2016-10-17 15:54:34,704 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15322 for container-id container_1476741065528_0004_01_000073: 153.3 MB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:34,759 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15206 for container-id container_1476741065528_0004_01_000063: 107.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:34,783 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15164 for container-id container_1476741065528_0004_01_000059: 208.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:34,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 110.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:34,857 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15212 for container-id container_1476741065528_0004_01_000062: 106.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:34,932 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:35,012 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:35,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000059 succeeded | |
| 2016-10-17 15:54:35,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000059 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:35,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:35,638 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:35,639 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:35,640 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000059 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:35,641 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000055] | |
| 2016-10-17 15:54:35,642 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000059 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:35,642 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000059 for log-aggregation | |
| 2016-10-17 15:54:35,642 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:37,660 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000059] | |
| 2016-10-17 15:54:37,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000062 succeeded | |
| 2016-10-17 15:54:37,811 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000062 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:37,811 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:37,871 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:37,872 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:37,873 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000062 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:37,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000062 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:37,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000062 for log-aggregation | |
| 2016-10-17 15:54:37,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:37,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000063 succeeded | |
| 2016-10-17 15:54:37,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000063 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:37,877 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:37,915 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:37,917 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:37,918 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000063 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:37,920 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000063 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:37,920 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000063 for log-aggregation | |
| 2016-10-17 15:54:37,920 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:37,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000059 | |
| 2016-10-17 15:54:37,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000062 | |
| 2016-10-17 15:54:37,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000063 | |
| 2016-10-17 15:54:37,944 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 15322 for container-id container_1476741065528_0004_01_000073: 98.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:37,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 110.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:37,975 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:38,043 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:39,757 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000073 succeeded | |
| 2016-10-17 15:54:39,757 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000073 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:39,757 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:39,772 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:39,773 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:39,773 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000073 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:39,775 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000063, container_1476741065528_0004_01_000062] | |
| 2016-10-17 15:54:39,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000073 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:39,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000073 for log-aggregation | |
| 2016-10-17 15:54:39,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:40,054 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-17 15:54:40,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000073 | |
| 2016-10-17 15:54:40,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14838 for container-id container_1476741065528_0004_01_000031: 137.7 MB of 1 GB physical memory used; 1.5 GB of 2.1 GB virtual memory used | |
| 2016-10-17 15:54:40,998 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 145.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:41,783 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000073] | |
| 2016-10-17 15:54:41,919 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:41,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:41,921 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:41,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from RUNNING to KILLING | |
| 2016-10-17 15:54:41,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:41,948 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1476741065528_0004_01_000031 is : 143 | |
| 2016-10-17 15:54:41,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL | |
| 2016-10-17 15:54:41,954 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:41,956 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:41,956 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000031 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE | |
| 2016-10-17 15:54:41,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000031 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:41,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000031 for log-aggregation | |
| 2016-10-17 15:54:41,957 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:43,999 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000031 | |
| 2016-10-17 15:54:44,003 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 142.3 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:47,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 14301 for container-id container_1476741065528_0004_01_000001: 142.3 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-17 15:54:47,995 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476741065528_0004_01_000001 succeeded | |
| 2016-10-17 15:54:47,996 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-17 15:54:47,996 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:54:48,010 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004/container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:54:48,012 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:54:48,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476741065528_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-17 15:54:48,019 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476741065528_0004_01_000001 from application application_1476741065528_0004 | |
| 2016-10-17 15:54:48,020 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476741065528_0004_01_000001 for log-aggregation | |
| 2016-10-17 15:54:48,020 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:48,025 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476741065528_0004_000001 (auth:SIMPLE) | |
| 2016-10-17 15:54:48,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:54:48,028 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476741065528_0004 CONTAINERID=container_1476741065528_0004_01_000001 | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476741065528_0004_01_000001] | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1476741065528_0004 | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476741065528_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1476741065528_0004 | |
| 2016-10-17 15:54:49,021 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476741065528_0004 | |
| 2016-10-17 15:54:49,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000073. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000006. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000033. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000005. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000063. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000029. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000035. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000003. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,045 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000004. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000073/stdout | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000073/syslog | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000073/stderr | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000006/stdout | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000006/syslog | |
| 2016-10-17 15:54:49,046 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000006/stderr | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000033/stdout | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000033/syslog | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000033/stderr | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000005/syslog | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000005/stdout | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000005/stderr | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000063/syslog | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000063/stdout | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000063/stderr | |
| 2016-10-17 15:54:49,047 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000029/stdout | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000029/syslog | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000029/stderr | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000035/stdout | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000035/syslog | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000035/stderr | |
| 2016-10-17 15:54:49,048 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000003/syslog | |
| 2016-10-17 15:54:49,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000003/stderr | |
| 2016-10-17 15:54:49,050 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000003/stdout | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000004/stdout | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000004/syslog | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000004/stderr | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000055. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000055/stderr | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000055/stdout | |
| 2016-10-17 15:54:49,051 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000055/syslog | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000026. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000026/syslog | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000026/stderr | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000026/stdout | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000002. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,052 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000002/syslog | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000002/stdout | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000002/stderr | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000048. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000048/stderr | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000048/stdout | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000048/syslog | |
| 2016-10-17 15:54:49,053 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000001. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000001/stderr | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000001/stdout | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000001/syslog | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000007. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000007/syslog | |
| 2016-10-17 15:54:49,054 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000007/stderr | |
| 2016-10-17 15:54:49,055 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000007/stdout | |
| 2016-10-17 15:54:49,055 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000019. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,057 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000019/stdout | |
| 2016-10-17 15:54:49,057 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000019/syslog | |
| 2016-10-17 15:54:49,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000019/stderr | |
| 2016-10-17 15:54:49,058 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000059. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000059/stderr | |
| 2016-10-17 15:54:49,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000059/stdout | |
| 2016-10-17 15:54:49,058 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000059/syslog | |
| 2016-10-17 15:54:49,060 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000031. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,060 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000031/syslog | |
| 2016-10-17 15:54:49,060 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000031/stdout | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000031/syslog.shuffle | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000031/stderr | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1476741065528_0004_01_000062. Current good log dirs are /var/log/hadoop-yarn/containers | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000062/stdout | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000062/syslog | |
| 2016-10-17 15:54:49,061 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004/container_1476741065528_0004_01_000062/stderr | |
| 2016-10-17 15:54:49,073 WARN org.apache.hadoop.hdfs.DFSClient: Caught exception | |
| java.lang.InterruptedException | |
| at java.lang.Object.wait(Native Method) | |
| at java.lang.Thread.join(Thread.java:1281) | |
| at java.lang.Thread.join(Thread.java:1355) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600) | |
| at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789) | |
| 2016-10-17 15:54:49,075 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /var/log/hadoop-yarn/containers/application_1476741065528_0004 | |
| 2016-10-17 15:54:50,009 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476741065528_0004_01_000001 | |
| 2016-10-17 16:07:13,118 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeManager: RECEIVED SIGNAL 15: SIGTERM | |
| 2016-10-17 16:07:13,134 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042 | |
| 2016-10-17 16:07:13,135 INFO org.apache.hadoop.ipc.Server: Stopping server on 59044 | |
| 2016-10-17 16:07:13,136 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 59044 | |
| 2016-10-17 16:07:13,136 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2016-10-17 16:07:13,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService: org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService waiting for pending aggregation during exit | |
| 2016-10-17 16:07:13,136 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. | |
| 2016-10-17 16:07:13,366 INFO org.apache.hadoop.ipc.Server: Stopping server on 8040 | |
| 2016-10-17 16:07:13,366 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8040 | |
| 2016-10-17 16:07:13,366 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2016-10-17 16:07:13,367 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... | |
| 2016-10-17 16:07:13,368 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. | |
| 2016-10-17 16:07:13,368 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. | |
| 2016-10-17 16:07:13,368 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: | |
| /************************************************************ | |
| SHUTDOWN_MSG: Shutting down NodeManager at quickstart.cloudera/127.0.0.1 | |
| ************************************************************/ | |
| 2016-10-17 16:09:50,554 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting NodeManager | |
| STARTUP_MSG: user = yarn | |
| STARTUP_MSG: host = quickstart.cloudera/10.0.2.15 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 2.6.0-cdh5.8.0 | |
| STARTUP_MSG: classpath = /etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/curator-framework-2.7.1.jar:/usr/lib/hadoop/lib/jersey-server-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/avro.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/jersey-core-1.9.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/junit-4.11.jar:/usr/lib/hadoop/lib/jersey-json-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jsr305-3.0.0.jar:/usr/lib/hadoop/lib/api-util-1.0.0-M20.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/lib/hadoop/lib/logredactor-1.0.3.jar:/usr/lib/hadoop/lib/curator-recipes-2.7.1.jar:/usr/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/lib/hadoop/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/httpcore-4.2.5.jar:/usr/lib/hadoop/lib/httpclient-4.2.5.jar:/usr/lib/hadoop/lib/curator-client-2.7.1.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/jets3t-0.9.0.jar:/usr/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.8.0.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/stax-api-1.0-2.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/commons-io-2.4.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.5.jar:/usr/lib/hadoop/lib/gson-2.2.4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/slf4j-log4j12.jar:/usr/lib/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/zookeeper.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/.//parquet-tools.jar:/usr/lib/hadoop/.//parquet-hadoop-bundle.jar:/usr/lib/hadoop/.//parquet-format-javadoc.jar:/usr/lib/hadoop/.//parquet-avro.jar:/usr/lib/hadoop/.//parquet-pig.jar:/usr/lib/hadoop/.//hadoop-nfs.jar:/usr/lib/hadoop/.//parquet-pig-bundle.jar:/usr/lib/hadoop/.//parquet-column.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-format-sources.jar:/usr/lib/hadoop/.//hadoop-aws-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-protobuf.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop/.//hadoop-annotations-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-scrooge_2.10.jar:/usr/lib/hadoop/.//parquet-generator.jar:/usr/lib/hadoop/.//hadoop-common-tests.jar:/usr/lib/hadoop/.//parquet-common.jar:/usr/lib/hadoop/.//hadoop-aws.jar:/usr/lib/hadoop/.//parquet-test-hadoop2.jar:/usr/lib/hadoop/.//parquet-scala_2.10.jar:/usr/lib/hadoop/.//hadoop-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-jackson.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//parquet-encoding.jar:/usr/lib/hadoop/.//parquet-format.jar:/usr/lib/hadoop/.//parquet-cascading.jar:/usr/lib/hadoop/.//parquet-hadoop.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//parquet-thrift.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/lib/avro.jar:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-mapreduce/lib/junit-4.11.jar:/usr/lib/hadoop-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/lib/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/lib/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-annotations-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/lib/hadoop-mapreduce/.//activation-1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-mapreduce/.//htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/lib/hadoop-mapreduce/.//avro.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/lib/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//commons-el-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//junit-4.11.jar:/usr/lib/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/lib/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/lib/hadoop-mapreduce/.//metrics-core-3.0.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/.//jettison-1.1.jar:/usr/lib/hadoop-mapreduce/.//xz-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/lib/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives.jar:/usr/lib/hadoop-mapreduce/.//jackson-databind-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/lib/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/.//asm-3.2.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-mapreduce/.//jasper-compiler-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/lib/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/lib/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/.//jackson-xc-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/lib/hadoop-mapreduce/.//jasper-runtime-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/lib/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant.jar:/usr/lib/hadoop-mapreduce/.//zookeeper.jar:/usr/lib/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs.jar::/usr/lib/llama/llama.jar:/usr/lib/llama/llama-1.0.0-cdh5.8.0.jar:/usr/lib/llama/lib/guava-11.0.2.jar:/usr/lib/llama/lib/slf4j-log4j12-1.7.5.jar:/usr/lib/llama/lib/curator-framework-2.5.0.jar:/usr/lib/llama/lib/jsr305-1.3.9.jar:/usr/lib/llama/lib/libthrift-0.9.0.jar:/usr/lib/llama/lib/metrics-core-3.0.1.jar:/usr/lib/llama/lib/netty-3.2.2.Final.jar:/usr/lib/llama/lib/jline-2.11.jar:/usr/lib/llama/lib/curator-client-2.5.0.jar:/usr/lib/llama/lib/log4j-1.2.17.jar:/usr/lib/llama/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/etc/hadoop/conf/nm-config/log4j.properties | |
| STARTUP_MSG: build = http://github.com/cloudera/hadoop -r 57e7b8556919574d517e874abfb7ebe31a366c2b; compiled by 'jenkins' on 2016-06-16T19:38Z | |
| STARTUP_MSG: java = 1.7.0_67 | |
| ************************************************************/ | |
| 2016-10-17 16:09:50,584 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT] | |
| 2016-10-17 16:09:52,114 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher | |
| 2016-10-17 16:09:52,114 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher | |
| 2016-10-17 16:09:52,115 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService | |
| 2016-10-17 16:09:52,115 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices | |
| 2016-10-17 16:09:52,115 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl | |
| 2016-10-17 16:09:52,116 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher | |
| 2016-10-17 16:09:52,133 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl | |
| 2016-10-17 16:09:52,133 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager | |
| 2016-10-17 16:09:52,148 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-nodemanager.properties,hadoop-metrics2.properties | |
| 2016-10-17 16:09:52,184 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). | |
| 2016-10-17 16:09:52,184 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started | |
| 2016-10-17 16:09:52,213 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService | |
| 2016-10-17 16:09:52,213 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192 | |
| 2016-10-17 16:09:52,238 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache_DEL_1476745792215 | |
| 2016-10-17 16:09:52,242 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache_DEL_1476745792215/cloudera | |
| 2016-10-17 16:09:52,291 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker | |
| 2016-10-17 16:09:52,347 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config. | |
| 2016-10-17 16:09:52,347 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle" | |
| 2016-10-17 16:09:52,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@632f739c | |
| 2016-10-17 16:09:52,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null | |
| 2016-10-17 16:09:52,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true | |
| 2016-10-17 16:09:52,397 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: false | |
| 2016-10-17 16:09:52,409 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (3.7 G). Thrashing might happen. | |
| 2016-10-17 16:09:52,415 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 | |
| 2016-10-17 16:09:52,503 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 16:09:52,515 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 53165 | |
| 2016-10-17 16:09:52,531 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server | |
| 2016-10-17 16:09:52,531 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting. | |
| 2016-10-17 16:09:52,531 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 16:09:52,532 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 53165: starting | |
| 2016-10-17 16:09:52,536 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : quickstart.cloudera:53165 | |
| 2016-10-17 16:09:52,570 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 16:09:52,570 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040 | |
| 2016-10-17 16:09:52,572 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server | |
| 2016-10-17 16:09:52,573 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 16:09:52,573 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting | |
| 2016-10-17 16:09:52,574 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040 | |
| 2016-10-17 16:09:52,593 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760 | |
| 2016-10-17 16:09:52,606 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562 | |
| 2016-10-17 16:09:52,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at quickstart.cloudera/10.0.2.15:53165 | |
| 2016-10-17 16:09:52,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0 | |
| 2016-10-17 16:09:52,609 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042 | |
| 2016-10-17 16:09:52,653 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2016-10-17 16:09:52,657 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. | |
| 2016-10-17 16:09:52,671 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined | |
| 2016-10-17 16:09:52,683 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) | |
| 2016-10-17 16:09:52,684 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node | |
| 2016-10-17 16:09:52,684 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs | |
| 2016-10-17 16:09:52,684 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static | |
| 2016-10-17 16:09:52,686 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/* | |
| 2016-10-17 16:09:52,686 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* | |
| 2016-10-17 16:09:52,702 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042 | |
| 2016-10-17 16:09:52,702 INFO org.mortbay.log: jetty-6.1.26.cloudera.4 | |
| 2016-10-17 16:09:52,733 INFO org.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.8.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp | |
| 2016-10-17 16:09:53,160 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042 | |
| 2016-10-17 16:09:53,160 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042 | |
| 2016-10-17 16:09:53,516 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules | |
| 2016-10-17 16:09:53,522 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031 | |
| 2016-10-17 16:09:53,525 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor | |
| 2016-10-17 16:09:53,542 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: [] | |
| 2016-10-17 16:09:53,573 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[] | |
| 2016-10-17 16:09:54,621 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:09:55,622 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:09:56,624 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:09:57,625 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:09:58,626 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:09:59,640 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:10:00,641 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:10:01,642 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:10:02,649 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:10:03,659 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:10:34,613 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 1414425831 | |
| 2016-10-17 16:10:34,615 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id -1357352185 | |
| 2016-10-17 16:10:34,616 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as quickstart.cloudera:53165 with total resource of <memory:8192, vCores:8> | |
| 2016-10-17 16:10:34,616 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests | |
| 2016-10-17 16:33:32,877 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeManager: RECEIVED SIGNAL 15: SIGTERM | |
| 2016-10-17 16:33:32,894 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042 | |
| 2016-10-17 16:33:32,894 INFO org.apache.hadoop.ipc.Server: Stopping server on 53165 | |
| 2016-10-17 16:33:32,895 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 53165 | |
| 2016-10-17 16:33:32,897 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2016-10-17 16:33:32,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService: org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService waiting for pending aggregation during exit | |
| 2016-10-17 16:33:32,897 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. | |
| 2016-10-17 16:33:32,946 INFO org.apache.hadoop.ipc.Server: Stopping server on 8040 | |
| 2016-10-17 16:33:32,946 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8040 | |
| 2016-10-17 16:33:32,947 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2016-10-17 16:33:32,947 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Public cache exiting | |
| 2016-10-17 16:33:32,947 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... | |
| 2016-10-17 16:33:32,948 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. | |
| 2016-10-17 16:33:32,948 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. | |
| 2016-10-17 16:33:32,948 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: | |
| /************************************************************ | |
| SHUTDOWN_MSG: Shutting down NodeManager at quickstart.cloudera/10.0.2.15 | |
| ************************************************************/ | |
| 2016-10-17 16:37:25,864 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting NodeManager | |
| STARTUP_MSG: user = yarn | |
| STARTUP_MSG: host = quickstart.cloudera/10.0.2.15 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 2.6.0-cdh5.8.0 | |
| STARTUP_MSG: classpath = /etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/curator-framework-2.7.1.jar:/usr/lib/hadoop/lib/jersey-server-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/avro.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/jersey-core-1.9.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/junit-4.11.jar:/usr/lib/hadoop/lib/jersey-json-1.9.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jsr305-3.0.0.jar:/usr/lib/hadoop/lib/api-util-1.0.0-M20.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/lib/hadoop/lib/logredactor-1.0.3.jar:/usr/lib/hadoop/lib/curator-recipes-2.7.1.jar:/usr/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/lib/hadoop/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop/lib/httpcore-4.2.5.jar:/usr/lib/hadoop/lib/httpclient-4.2.5.jar:/usr/lib/hadoop/lib/curator-client-2.7.1.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/jets3t-0.9.0.jar:/usr/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.8.0.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/stax-api-1.0-2.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/commons-io-2.4.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.5.jar:/usr/lib/hadoop/lib/gson-2.2.4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/slf4j-log4j12.jar:/usr/lib/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/zookeeper.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/.//parquet-tools.jar:/usr/lib/hadoop/.//parquet-hadoop-bundle.jar:/usr/lib/hadoop/.//parquet-format-javadoc.jar:/usr/lib/hadoop/.//parquet-avro.jar:/usr/lib/hadoop/.//parquet-pig.jar:/usr/lib/hadoop/.//hadoop-nfs.jar:/usr/lib/hadoop/.//parquet-pig-bundle.jar:/usr/lib/hadoop/.//parquet-column.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-format-sources.jar:/usr/lib/hadoop/.//hadoop-aws-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-protobuf.jar:/usr/lib/hadoop/.//hadoop-common-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop/.//hadoop-annotations-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-scrooge_2.10.jar:/usr/lib/hadoop/.//parquet-generator.jar:/usr/lib/hadoop/.//hadoop-common-tests.jar:/usr/lib/hadoop/.//parquet-common.jar:/usr/lib/hadoop/.//hadoop-aws.jar:/usr/lib/hadoop/.//parquet-test-hadoop2.jar:/usr/lib/hadoop/.//parquet-scala_2.10.jar:/usr/lib/hadoop/.//hadoop-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop/.//parquet-jackson.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//parquet-encoding.jar:/usr/lib/hadoop/.//parquet-format.jar:/usr/lib/hadoop/.//parquet-cascading.jar:/usr/lib/hadoop/.//parquet-hadoop.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//parquet-thrift.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/lib/avro.jar:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-mapreduce/lib/junit-4.11.jar:/usr/lib/hadoop-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/lib/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/lib/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-annotations-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/lib/hadoop-mapreduce/.//activation-1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-mapreduce/.//htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/lib/hadoop-mapreduce/.//avro.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/lib/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/.//commons-el-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//junit-4.11.jar:/usr/lib/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/lib/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/lib/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/lib/hadoop-mapreduce/.//metrics-core-3.0.2.jar:/usr/lib/hadoop-mapreduce/.//jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/.//jettison-1.1.jar:/usr/lib/hadoop-mapreduce/.//xz-1.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/lib/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives.jar:/usr/lib/hadoop-mapreduce/.//jackson-databind-2.2.3.jar:/usr/lib/hadoop-mapreduce/.//jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/lib/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/.//asm-3.2.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/lib/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.6.0-cdh5.8.0-tests.jar:/usr/lib/hadoop-mapreduce/.//jasper-compiler-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/lib/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/.//jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/lib/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/lib/hadoop-mapreduce/.//hadoop-auth.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/.//jackson-xc-1.8.8.jar:/usr/lib/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/lib/hadoop-mapreduce/.//jasper-runtime-5.5.23.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/lib/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/.//hadoop-ant.jar:/usr/lib/hadoop-mapreduce/.//zookeeper.jar:/usr/lib/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs.jar::/usr/lib/llama/llama.jar:/usr/lib/llama/llama-1.0.0-cdh5.8.0.jar:/usr/lib/llama/lib/guava-11.0.2.jar:/usr/lib/llama/lib/slf4j-log4j12-1.7.5.jar:/usr/lib/llama/lib/curator-framework-2.5.0.jar:/usr/lib/llama/lib/jsr305-1.3.9.jar:/usr/lib/llama/lib/libthrift-0.9.0.jar:/usr/lib/llama/lib/metrics-core-3.0.1.jar:/usr/lib/llama/lib/netty-3.2.2.Final.jar:/usr/lib/llama/lib/jline-2.11.jar:/usr/lib/llama/lib/curator-client-2.5.0.jar:/usr/lib/llama/lib/log4j-1.2.17.jar:/usr/lib/llama/lib/zookeeper.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.8.0.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jline-2.11.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/spark-1.6.0-cdh5.8.0-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/zookeeper.jar:/etc/hadoop/conf/nm-config/log4j.properties | |
| STARTUP_MSG: build = http://github.com/cloudera/hadoop -r 57e7b8556919574d517e874abfb7ebe31a366c2b; compiled by 'jenkins' on 2016-06-16T19:38Z | |
| STARTUP_MSG: java = 1.7.0_67 | |
| ************************************************************/ | |
| 2016-10-17 16:37:25,883 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT] | |
| 2016-10-17 16:37:27,430 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher | |
| 2016-10-17 16:37:27,430 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher | |
| 2016-10-17 16:37:27,431 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService | |
| 2016-10-17 16:37:27,431 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices | |
| 2016-10-17 16:37:27,431 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl | |
| 2016-10-17 16:37:27,432 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher | |
| 2016-10-17 16:37:27,457 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl | |
| 2016-10-17 16:37:27,457 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager | |
| 2016-10-17 16:37:27,471 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-nodemanager.properties,hadoop-metrics2.properties | |
| 2016-10-17 16:37:27,506 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). | |
| 2016-10-17 16:37:27,506 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started | |
| 2016-10-17 16:37:27,534 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService | |
| 2016-10-17 16:37:27,534 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192 | |
| 2016-10-17 16:37:27,560 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache_DEL_1476747447536 | |
| 2016-10-17 16:37:27,603 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker | |
| 2016-10-17 16:37:27,676 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config. | |
| 2016-10-17 16:37:27,676 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle" | |
| 2016-10-17 16:37:27,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@5cf75b53 | |
| 2016-10-17 16:37:27,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null | |
| 2016-10-17 16:37:27,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true | |
| 2016-10-17 16:37:27,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: false | |
| 2016-10-17 16:37:27,730 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (3.7 G). Thrashing might happen. | |
| 2016-10-17 16:37:27,747 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 | |
| 2016-10-17 16:37:27,821 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 16:37:27,833 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 43588 | |
| 2016-10-17 16:37:27,849 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server | |
| 2016-10-17 16:37:27,849 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting. | |
| 2016-10-17 16:37:27,849 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 16:37:27,850 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 43588: starting | |
| 2016-10-17 16:37:27,854 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : quickstart.cloudera:43588 | |
| 2016-10-17 16:37:27,888 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2016-10-17 16:37:27,888 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040 | |
| 2016-10-17 16:37:27,890 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server | |
| 2016-10-17 16:37:27,891 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2016-10-17 16:37:27,891 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting | |
| 2016-10-17 16:37:27,892 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040 | |
| 2016-10-17 16:37:27,908 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760 | |
| 2016-10-17 16:37:27,923 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562 | |
| 2016-10-17 16:37:27,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at quickstart.cloudera/10.0.2.15:43588 | |
| 2016-10-17 16:37:27,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0 | |
| 2016-10-17 16:37:27,925 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042 | |
| 2016-10-17 16:37:27,968 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2016-10-17 16:37:27,980 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. | |
| 2016-10-17 16:37:27,983 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined | |
| 2016-10-17 16:37:28,002 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) | |
| 2016-10-17 16:37:28,003 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node | |
| 2016-10-17 16:37:28,003 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs | |
| 2016-10-17 16:37:28,003 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static | |
| 2016-10-17 16:37:28,005 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/* | |
| 2016-10-17 16:37:28,005 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* | |
| 2016-10-17 16:37:28,021 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042 | |
| 2016-10-17 16:37:28,021 INFO org.mortbay.log: jetty-6.1.26.cloudera.4 | |
| 2016-10-17 16:37:28,047 INFO org.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.8.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp | |
| 2016-10-17 16:37:28,451 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042 | |
| 2016-10-17 16:37:28,451 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042 | |
| 2016-10-17 16:37:28,771 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules | |
| 2016-10-17 16:37:28,782 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031 | |
| 2016-10-17 16:37:28,789 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor | |
| 2016-10-17 16:37:28,806 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: [] | |
| 2016-10-17 16:37:28,809 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[] | |
| 2016-10-17 16:37:29,858 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:30,858 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:31,859 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:32,860 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:33,861 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:34,861 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:35,867 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:36,868 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:37,870 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:37:38,871 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) | |
| 2016-10-17 16:38:09,906 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id -143955309 | |
| 2016-10-17 16:38:09,908 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id -329891401 | |
| 2016-10-17 16:38:09,970 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as quickstart.cloudera:43588 with total resource of <memory:8192, vCores:8> | |
| 2016-10-17 16:38:09,970 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests | |
| 2016-10-18 18:37:53,131 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:37:53,355 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000001 by user cloudera | |
| 2016-10-18 18:37:53,378 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1476747459443_0001 | |
| 2016-10-18 18:37:53,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476747459443_0001 transitioned from NEW to INITING | |
| 2016-10-18 18:37:53,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000001 to application application_1476747459443_0001 | |
| 2016-10-18 18:37:53,415 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000001 | |
| 2016-10-18 18:37:53,931 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished. | |
| 2016-10-18 18:37:53,963 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1476747459443_0001 transitioned from INITING to RUNNING | |
| 2016-10-18 18:37:53,966 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000001 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:37:53,966 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:37:53,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1476747459443_0001_01_000001 | |
| 2016-10-18 18:37:54,153 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476747459443_0001_01_000001.tokens. Credentials list: | |
| 2016-10-18 18:37:54,163 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user cloudera | |
| 2016-10-18 18:37:54,212 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/nmPrivate/container_1476747459443_0001_01_000001.tokens to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000001.tokens | |
| 2016-10-18 18:37:54,214 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001 = file:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001 | |
| 2016-10-18 18:37:54,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000001 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:37:54,832 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000001 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:37:54,833 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000001/default_container_executor.sh] | |
| 2016-10-18 18:37:54,915 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000001 | |
| 2016-10-18 18:37:55,004 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 12.5 MB of 2 GB physical memory used; 1.4 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:37:58,065 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 109.4 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:01,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 140.1 MB of 2 GB physical memory used; 1.6 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:02,263 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:02,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000002 by user cloudera | |
| 2016-10-18 18:38:02,267 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:02,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000002 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:02,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000002 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:02,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:02,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:02,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:02,270 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:02,270 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000002 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:02,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000002 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:02,298 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000002/default_container_executor.sh] | |
| 2016-10-18 18:38:03,079 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:03,087 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000003 by user cloudera | |
| 2016-10-18 18:38:03,087 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000003 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:03,087 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000003 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000003 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:03,088 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:03,133 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000003 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:03,142 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000003/default_container_executor.sh] | |
| 2016-10-18 18:38:04,093 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:04,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:04,103 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:04,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000004 by user cloudera | |
| 2016-10-18 18:38:04,124 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:04,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000004 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000004 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:04,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000004 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:04,138 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 142.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:04,191 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31384 for container-id container_1476747459443_0001_01_000002: 87.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:04,221 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000004 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:04,225 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000004/default_container_executor.sh] | |
| 2016-10-18 18:38:04,281 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 57.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:05,145 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:05,156 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000005 by user cloudera | |
| 2016-10-18 18:38:05,156 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000005 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000005 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:05,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000005 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:05,304 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000005 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:05,307 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000005/default_container_executor.sh] | |
| 2016-10-18 18:38:06,169 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:06,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000006 by user cloudera | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000006 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000006 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:06,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000006 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:06,344 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000006 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:06,370 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000006/default_container_executor.sh] | |
| 2016-10-18 18:38:07,283 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:07,283 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:07,283 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:07,298 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:07,378 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000007 by user cloudera | |
| 2016-10-18 18:38:07,378 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000007 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000007 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:07,379 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000007 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:07,395 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 141.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:07,522 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31384 for container-id container_1476747459443_0001_01_000002: 96.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:07,680 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 83.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:07,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000007 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:07,737 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000007/default_container_executor.sh] | |
| 2016-10-18 18:38:07,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 29.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:08,121 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 57.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:08,161 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 42.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,163 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:11,429 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 128.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:11,510 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31384 for container-id container_1476747459443_0001_01_000002: 89.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,647 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 73.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,718 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 20.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,866 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 50.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,905 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 73.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:11,924 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 57.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.6 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:15,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31384 for container-id container_1476747459443_0001_01_000002: 92.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,183 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 89.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,250 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 31.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,270 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 69.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,336 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 72.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:15,416 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 69.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:18,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:18,636 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31384 for container-id container_1476747459443_0001_01_000002: 193.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:18,702 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 88.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:18,740 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 48.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:18,821 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 64.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:18,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 82.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:19,050 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 69.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:21,090 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000002 succeeded | |
| 2016-10-18 18:38:21,182 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:21,182 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:21,790 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:21,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:21,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000002 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:21,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000002 for log-aggregation | |
| 2016-10-18 18:38:21,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:21,825 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:22,053 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000002 | |
| 2016-10-18 18:38:22,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:22,212 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 92.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:22,289 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 66.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:22,325 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 70.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:22,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 90.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:22,477 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 77.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:22,717 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:22,748 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000022 by user cloudera | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000022 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000022 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:22,749 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000022 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:22,856 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000022 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:22,866 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000022/default_container_executor.sh] | |
| 2016-10-18 18:38:23,970 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000002] | |
| 2016-10-18 18:38:25,478 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:25,526 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.7 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:25,601 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 18.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:25,742 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 196.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:25,787 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 72.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:25,802 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 83.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:25,881 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 194.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:25,913 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 85.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.4 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:29,460 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 42.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,482 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31403 for container-id container_1476747459443_0001_01_000003: 197.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,575 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 80.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,656 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 80.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,702 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31432 for container-id container_1476747459443_0001_01_000004: 194.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:29,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 86.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:31,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000004 succeeded | |
| 2016-10-18 18:38:31,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000004 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:31,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:31,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000003 succeeded | |
| 2016-10-18 18:38:31,523 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:31,524 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000003 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:31,544 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:31,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000004 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:31,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:31,694 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:31,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000004 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:31,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000004 for log-aggregation | |
| 2016-10-18 18:38:31,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:31,696 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:31,696 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000003 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:31,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000003 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:31,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000003 for log-aggregation | |
| 2016-10-18 18:38:31,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:32,111 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:32,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000033 by user cloudera | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000033 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000033 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:32,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000033 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:32,146 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:32,214 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000033 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:32,226 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000033/default_container_executor.sh] | |
| 2016-10-18 18:38:32,235 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000032 by user cloudera | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000032 | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000032 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000032 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:32,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000032 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:32,323 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000032 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:32,326 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000032/default_container_executor.sh] | |
| 2016-10-18 18:38:32,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000032 | |
| 2016-10-18 18:38:32,809 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:38:32,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000004 | |
| 2016-10-18 18:38:32,810 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000003 | |
| 2016-10-18 18:38:32,846 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:32,901 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 70.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,006 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 90.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,011 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 87.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,104 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 14.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,133 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 16.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,139 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 93.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:33,748 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000003, container_1476747459443_0001_01_000004] | |
| 2016-10-18 18:38:36,159 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.8 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:36,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 77.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:36,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: 192.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:36,550 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: 190.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:36,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 42.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:36,689 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 44.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:36,817 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: 195.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:39,911 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 90.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31502 for container-id container_1476747459443_0001_01_000007: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,927 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31476 for container-id container_1476747459443_0001_01_000006: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,932 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 57.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,950 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 59.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:39,982 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31454 for container-id container_1476747459443_0001_01_000005: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:40,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000006 succeeded | |
| 2016-10-18 18:38:40,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000006 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:40,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:40,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000007 succeeded | |
| 2016-10-18 18:38:40,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000005 succeeded | |
| 2016-10-18 18:38:40,406 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:40,424 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000007 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:40,425 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000005 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:40,425 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:40,425 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000006 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:40,425 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:40,555 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:40,556 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:40,617 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:40,628 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000042 by user cloudera | |
| 2016-10-18 18:38:40,628 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:38:40,717 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:40,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000006 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:40,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000006 for log-aggregation | |
| 2016-10-18 18:38:40,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:40,722 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:40,722 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000007 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:40,725 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000042 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:40,725 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:40,725 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000005 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:40,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000007 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000007 for log-aggregation | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000042 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000005 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000005 for log-aggregation | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:40,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000042 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:40,797 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000042 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:40,807 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000042/default_container_executor.sh] | |
| 2016-10-18 18:38:41,625 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:41,634 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:41,663 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000044 by user cloudera | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000044 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000044 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:41,664 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000044 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000043 by user cloudera | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000043 | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000043 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000043 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:41,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:41,706 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:41,706 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000043 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:41,728 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000006] | |
| 2016-10-18 18:38:41,780 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000043/default_container_executor.sh] | |
| 2016-10-18 18:38:41,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000044 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:41,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000043 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:41,785 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000044/default_container_executor.sh] | |
| 2016-10-18 18:38:42,730 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000007, container_1476747459443_0001_01_000005] | |
| 2016-10-18 18:38:42,983 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:38:42,983 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:38:42,983 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000043 | |
| 2016-10-18 18:38:42,983 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000006 | |
| 2016-10-18 18:38:42,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000007 | |
| 2016-10-18 18:38:42,984 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000005 | |
| 2016-10-18 18:38:43,010 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:43,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 44.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:43,084 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 195.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:43,089 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 42.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:43,161 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 43.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:43,227 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 73.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:43,232 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 75.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,241 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:46,373 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 65.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,378 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31611 for container-id container_1476747459443_0001_01_000022: 456 KB of 1 GB physical memory used; 103.6 MB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,450 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 63.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000022 succeeded | |
| 2016-10-18 18:38:46,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000022 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:46,544 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:46,633 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 64.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,727 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 86.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 84.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:46,788 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:46,789 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000022 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:46,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000022 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:46,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000022 for log-aggregation | |
| 2016-10-18 18:38:46,792 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:47,790 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000051 by user cloudera | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000051 to application application_1476747459443_0001 | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000051 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:38:47,799 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:38:47,800 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000051 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:38:47,965 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000051 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:38:47,968 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000051/default_container_executor.sh] | |
| 2016-10-18 18:38:49,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:38:49,733 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000022 | |
| 2016-10-18 18:38:49,748 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 36.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:49,845 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:49,850 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 79.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:49,864 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000022] | |
| 2016-10-18 18:38:50,006 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 80.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:50,042 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 78.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:50,118 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 93.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:50,233 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 95.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,251 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 64.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,298 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:53,444 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 91.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,509 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 92.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,644 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 96.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,649 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 91.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:53,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 95.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:55,297 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:38:56,892 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 81.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:56,910 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 126.9 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:38:57,150 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 98.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:57,219 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 99.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:57,335 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 101.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:57,378 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31686 for container-id container_1476747459443_0001_01_000033: 194.9 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:57,454 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:38:59,351 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:38:59,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000033 succeeded | |
| 2016-10-18 18:38:59,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000033 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:38:59,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:38:59,536 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:38:59,537 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:38:59,537 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000033 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:38:59,538 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000033 from application application_1476747459443_0001 | |
| 2016-10-18 18:38:59,538 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000033 for log-aggregation | |
| 2016-10-18 18:38:59,538 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:38:59,990 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:39:00,007 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000064 by user cloudera | |
| 2016-10-18 18:39:00,007 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000064 to application application_1476747459443_0001 | |
| 2016-10-18 18:39:00,007 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000064 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000064 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:39:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000064 | |
| 2016-10-18 18:39:00,140 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000064 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:39:00,155 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000064/default_container_executor.sh] | |
| 2016-10-18 18:39:00,463 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000064 | |
| 2016-10-18 18:39:00,464 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000033 | |
| 2016-10-18 18:39:00,469 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 100.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:00,480 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32011 for container-id container_1476747459443_0001_01_000064: 20.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:00,579 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.0 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:39:00,597 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:00,625 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 108.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:00,630 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 107.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:00,746 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 110.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:00,751 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:01,584 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000033] | |
| 2016-10-18 18:39:03,759 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 99.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:03,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32011 for container-id container_1476747459443_0001_01_000064: 61.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:03,835 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.1 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:39:03,859 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31780 for container-id container_1476747459443_0001_01_000042: 201.1 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:03,897 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31816 for container-id container_1476747459443_0001_01_000044: 201.8 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:03,929 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 98.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:03,986 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:04,091 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000042 succeeded | |
| 2016-10-18 18:39:04,091 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000042 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:39:04,091 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:39:04,165 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000044 succeeded | |
| 2016-10-18 18:39:04,207 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:04,296 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:39:04,297 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000044 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:39:04,297 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:39:04,297 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000042 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:39:04,299 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:39:04,356 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:39:04,360 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000042 from application application_1476747459443_0001 | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000042 for log-aggregation | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000044 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000044 from application application_1476747459443_0001 | |
| 2016-10-18 18:39:04,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000044 for log-aggregation | |
| 2016-10-18 18:39:04,362 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:04,381 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:05,033 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:39:05,048 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000069 by user cloudera | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000069 to application application_1476747459443_0001 | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000069 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:39:05,049 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:39:05,050 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000069 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:39:05,053 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000069 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000070 by user cloudera | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000070 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000070 to application application_1476747459443_0001 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000070 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:39:05,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000070 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:39:05,104 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000069 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:39:05,107 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000069/default_container_executor.sh] | |
| 2016-10-18 18:39:05,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000070 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:39:05,136 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000070/default_container_executor.sh] | |
| 2016-10-18 18:39:06,384 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000042, container_1476747459443_0001_01_000044] | |
| 2016-10-18 18:39:06,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000069 | |
| 2016-10-18 18:39:06,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000070 | |
| 2016-10-18 18:39:06,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000042 | |
| 2016-10-18 18:39:06,994 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000044 | |
| 2016-10-18 18:39:07,017 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31871 for container-id container_1476747459443_0001_01_000051: 205.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,039 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32077 for container-id container_1476747459443_0001_01_000069: 49.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32011 for container-id container_1476747459443_0001_01_000064: 87.5 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:39:07,141 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 98.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,167 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:07,196 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,227 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32084 for container-id container_1476747459443_0001_01_000070: 52.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:07,386 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000051 succeeded | |
| 2016-10-18 18:39:07,386 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000051 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:39:07,386 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:39:07,404 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:07,483 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:39:07,484 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:39:07,484 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000051 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:39:07,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000051 from application application_1476747459443_0001 | |
| 2016-10-18 18:39:07,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000051 for log-aggregation | |
| 2016-10-18 18:39:07,485 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:08,077 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:39:08,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000074 by user cloudera | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera IP=10.0.2.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000074 | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000074 to application application_1476747459443_0001 | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000074 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1476747459443_0001 | |
| 2016-10-18 18:39:08,097 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000074 transitioned from LOCALIZING to LOCALIZED | |
| 2016-10-18 18:39:08,153 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000074 transitioned from LOCALIZED to RUNNING | |
| 2016-10-18 18:39:08,157 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000074/default_container_executor.sh] | |
| 2016-10-18 18:39:09,544 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1476747459443_0001_01_000051] | |
| 2016-10-18 18:39:10,234 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1476747459443_0001_01_000074 | |
| 2016-10-18 18:39:10,234 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1476747459443_0001_01_000051 | |
| 2016-10-18 18:39:10,254 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32077 for container-id container_1476747459443_0001_01_000069: 78.0 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:10,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32011 for container-id container_1476747459443_0001_01_000064: 97.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:10,365 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:39:10,406 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 98.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:10,419 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32122 for container-id container_1476747459443_0001_01_000074: 58.4 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:10,494 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:10,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32084 for container-id container_1476747459443_0001_01_000070: 79.3 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,511 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32077 for container-id container_1476747459443_0001_01_000069: 95.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,606 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32011 for container-id container_1476747459443_0001_01_000064: 203.2 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,611 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31276 for container-id container_1476747459443_0001_01_000001: 127.3 MB of 2 GB physical memory used; 1.7 GB of 4.2 GB virtual memory used | |
| 2016-10-18 18:39:13,739 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31818 for container-id container_1476747459443_0001_01_000043: 98.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,824 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32122 for container-id container_1476747459443_0001_01_000074: 78.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,830 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 31699 for container-id container_1476747459443_0001_01_000032: 96.6 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:13,947 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 32084 for container-id container_1476747459443_0001_01_000070: 100.7 MB of 1 GB physical memory used; 1.4 GB of 2.1 GB virtual memory used | |
| 2016-10-18 18:39:15,487 INFO org.apache.hadoop.mapred.ShuffleHandler: Setting connection close header... | |
| 2016-10-18 18:39:16,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1476747459443_0001_01_000064 succeeded | |
| 2016-10-18 18:39:16,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000064 transitioned from RUNNING to EXITED_WITH_SUCCESS | |
| 2016-10-18 18:39:16,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1476747459443_0001_01_000064 | |
| 2016-10-18 18:39:16,093 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1476747459443_0001/container_1476747459443_0001_01_000064 | |
| 2016-10-18 18:39:16,094 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=cloudera OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1476747459443_0001 CONTAINERID=container_1476747459443_0001_01_000064 | |
| 2016-10-18 18:39:16,094 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000064 transitioned from EXITED_WITH_SUCCESS to DONE | |
| 2016-10-18 18:39:16,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1476747459443_0001_01_000064 from application application_1476747459443_0001 | |
| 2016-10-18 18:39:16,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1476747459443_0001_01_000064 for log-aggregation | |
| 2016-10-18 18:39:16,096 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:16,171 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1476747459443_0001_000001 (auth:SIMPLE) | |
| 2016-10-18 18:39:16,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1476747459443_0001_01_000083 by user cloudera | |
| 2016-10-18 18:39:16,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1476747459443_0001_01_000083 to application application_1476747459443_0001 | |
| 2016-10-18 18:39:16,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1476747459443_0001_01_000083 transitioned from NEW to LOCALIZING | |
| 2016-10-18 18:39:16,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1476747459443_0001 | |
| 2016-10-18 18:39:16,187 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1476747459443_0001 | |
| 2016-10-1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment