Created
March 24, 2015 04:08
-
-
Save ryan-williams/ff74066c127546910cac to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Container: container_1426705269584_0055_01_000001 on demeter-csmau08-13.demeter.hpc.mssm.edu_8041 | |
| =================================================================================================== | |
| LogType: stderr | |
| LogLength: 8225259 | |
| Log Contents: | |
| SLF4J: Class path contains multiple SLF4J bindings. | |
| SLF4J: Found binding in [jar:file:/data/11/mapred/local/yarn/nm/usercache/willir31/filecache/192/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] | |
| SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.3.2-1.cdh5.3.2.test/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] | |
| SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. | |
| SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] | |
| 15/03/20 14:12:39 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT] | |
| 15/03/20 14:12:40 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1426705269584_0055_000001 | |
| 15/03/20 14:12:40 INFO spark.SecurityManager: Changing view acls to: willir31 | |
| 15/03/20 14:12:40 INFO spark.SecurityManager: Changing modify acls to: willir31 | |
| 15/03/20 14:12:40 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(willir31); users with modify permissions: Set(willir31) | |
| 15/03/20 14:12:40 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread | |
| 15/03/20 14:12:40 INFO yarn.ApplicationMaster: Waiting for spark context initialization | |
| 15/03/20 14:12:40 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... | |
| 15/03/20 14:12:40 INFO spark.SparkContext: Running Spark version 1.3.0-SNAPSHOT | |
| 15/03/20 14:12:41 INFO spark.SecurityManager: Changing view acls to: willir31 | |
| 15/03/20 14:12:41 INFO spark.SecurityManager: Changing modify acls to: willir31 | |
| 15/03/20 14:12:41 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(willir31); users with modify permissions: Set(willir31) | |
| 15/03/20 14:12:41 INFO slf4j.Slf4jLogger: Slf4jLogger started | |
| 15/03/20 14:12:41 INFO Remoting: Starting remoting | |
| 15/03/20 14:12:42 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078] | |
| 15/03/20 14:12:42 INFO util.Utils: Successfully started service 'sparkDriver' on port 50078. | |
| 15/03/20 14:12:42 INFO spark.SparkEnv: Registering MapOutputTracker | |
| 15/03/20 14:12:42 INFO spark.SparkEnv: Registering BlockManagerMaster | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/01/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-88f62797-283a-46c2-bd86-d05308b0beea | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/01/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-8a372fd1-fe69-40c2-ab20-736534272748 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/02/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-153a1935-c0d9-4eef-8a31-35c565e691f8 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/02/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-fa8ea5ef-cd96-4b3d-a69f-4bcdf758d2bc | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/03/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-1d59f962-4533-407a-b650-36b02f424939 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/03/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-a0965410-bd04-4c1b-9002-03515cf401ed | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/04/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-f64de27d-4e7e-4cd9-804c-46d6eb0fa4f8 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/04/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-44aa8f2f-9556-4eba-925d-6f53157ca460 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/05/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-cab110a4-54f9-4a19-a997-ab2e344d2331 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/05/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-62e43005-0c23-45d9-85f6-3229994d4d3a | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/06/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-1f5c55fa-fefe-491d-bd98-a95441330e60 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/06/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-d71eaa36-7a30-4f28-8798-dbbf705de3ff | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/07/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-6cce7f99-a8c0-42e3-9a19-430c07f78bc9 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/07/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-d01c7f08-18e1-4de5-a46f-2aadea99a02f | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/08/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-938271b6-bf0f-45df-8222-02e118616f1d | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/08/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-4092786e-048a-41db-8005-864b07fb6031 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/09/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-9b941665-65f1-4a1b-8513-2b47925ddef4 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/09/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-79726c89-668f-48fa-906f-6f19d3431e7b | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/10/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-dcbaa478-f319-4c26-b5d6-4571c52f7881 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/10/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-a7c7e5b5-a422-4ec5-bf4d-736593fb9438 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/11/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-87409016-171c-4828-a1ca-5684d765f65c | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/11/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-a96c6f08-ca37-42be-9a35-c4767731cec3 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/12/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-59a74c5c-c458-4b4d-96df-47241176ab34 | |
| 15/03/20 14:12:42 INFO storage.DiskBlockManager: Created local directory at /data/12/mapred/local/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/blockmgr-ddd2ff54-6e20-472a-a54d-3212af5fb5d8 | |
| 15/03/20 14:12:42 INFO storage.MemoryStore: MemoryStore started with capacity 819.2 MB | |
| 15/03/20 14:12:42 INFO spark.HttpFileServer: HTTP File server directory is /data/01/dfs/dn/yarn/nm/usercache/willir31/appcache/application_1426705269584_0055/httpd-2df51a33-f58c-4a56-8d53-0267642645d9 | |
| 15/03/20 14:12:42 INFO spark.HttpServer: Starting HTTP Server | |
| 15/03/20 14:12:42 INFO server.Server: jetty-8.y.z-SNAPSHOT | |
| 15/03/20 14:12:42 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:56242 | |
| 15/03/20 14:12:42 INFO util.Utils: Successfully started service 'HTTP file server' on port 56242. | |
| 15/03/20 14:12:42 INFO spark.SparkEnv: Registering OutputCommitCoordinator | |
| 15/03/20 14:12:42 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter | |
| 15/03/20 14:12:42 INFO server.Server: jetty-8.y.z-SNAPSHOT | |
| 15/03/20 14:12:42 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:44571 | |
| 15/03/20 14:12:42 INFO util.Utils: Successfully started service 'SparkUI' on port 44571. | |
| 15/03/20 14:12:42 INFO ui.SparkUI: Started SparkUI at http://demeter-csmau08-13.demeter.hpc.mssm.edu:44571 | |
| 15/03/20 14:12:42 INFO cluster.YarnClusterScheduler: Created YarnClusterScheduler | |
| 15/03/20 14:12:43 INFO netty.NettyBlockTransferService: Server created on 39092 | |
| 15/03/20 14:12:43 INFO storage.BlockManagerMaster: Trying to register BlockManager | |
| 15/03/20 14:12:43 INFO storage.BlockManagerMasterActor: Registering block manager demeter-csmau08-13.demeter.hpc.mssm.edu:39092 with 819.2 MB RAM, BlockManagerId(<driver>, demeter-csmau08-13.demeter.hpc.mssm.edu, 39092) | |
| 15/03/20 14:12:43 INFO storage.BlockManagerMaster: Registered BlockManager | |
| 15/03/20 14:12:43 INFO scheduler.EventLoggingListener: Logging events to hdfs://demeter-nn1.demeter.hpc.mssm.edu:/spark/tmp/logs/willir31/application_1426705269584_0055 | |
| 15/03/20 14:12:43 INFO yarn.ApplicationMaster: Listen to driver: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/YarnScheduler | |
| 15/03/20 14:12:43 INFO cluster.YarnClusterSchedulerBackend: ApplicationMaster registered as Actor[akka://sparkDriver/user/YarnAM#1313950091] | |
| 15/03/20 14:12:43 INFO client.RMProxy: Connecting to ResourceManager at demeter-mgmt1.demeter.hpc.mssm.edu/172.29.46.10:8030 | |
| 15/03/20 14:12:43 INFO yarn.YarnRMClient: Registering the ApplicationMaster | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Will request 1000 executor containers, each with 6 cores and 20480 MB memory including 3072 MB overhead | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:43 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.YarnAllocator: Container request (host: Any, capability: <memory:20480, vCores:6>) | |
| 15/03/20 14:12:44 INFO yarn.ApplicationMaster: Started progress reporter thread - sleep time : 5000 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000002 for on host demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000003 for on host demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000004 for on host demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000005 for on host demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000006 for on host demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000007 for on host demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000008 for on host demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000009 for on host demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000010 for on host demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000011 for on host demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000012 for on host demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000013 for on host demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000014 for on host demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000015 for on host demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000016 for on host demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000017 for on host demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000018 for on host demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000019 for on host demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000020 for on host demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000021 for on host demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000022 for on host demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000023 for on host demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000024 for on host demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000025 for on host demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000026 for on host demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000027 for on host demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000028 for on host demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000029 for on host demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000030 for on host demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000031 for on host demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000032 for on host demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000033 for on host demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000034 for on host demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000035 for on host demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000036 for on host demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000037 for on host demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000038 for on host demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000039 for on host demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000040 for on host demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000041 for on host demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000042 for on host demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000043 for on host demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000044 for on host demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000045 for on host demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000046 for on host demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000047 for on host demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000048 for on host demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000049 for on host demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000050 for on host demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000051 for on host demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000052 for on host demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000053 for on host demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000054 for on host demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000055 for on host demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000056 for on host demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000057 for on host demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000058 for on host demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000059 for on host demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000060 for on host demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000061 for on host demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000062 for on host demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000063 for on host demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000064 for on host demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000065 for on host demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000066 for on host demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000067 for on host demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000068 for on host demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000069 for on host demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000070 for on host demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000071 for on host demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000072 for on host demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000073 for on host demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000074 for on host demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000075 for on host demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000076 for on host demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000077 for on host demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000078 for on host demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000079 for on host demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000080 for on host demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000081 for on host demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000082 for on host demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000083 for on host demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000084 for on host demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000085 for on host demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000086 for on host demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000087 for on host demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000088 for on host demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000089 for on host demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000090 for on host demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000091 for on host demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000092 for on host demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000093 for on host demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000094 for on host demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000095 for on host demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000096 for on host demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000097 for on host demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000098 for on host demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000099 for on host demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000100 for on host demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000101 for on host demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000102 for on host demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000103 for on host demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000104 for on host demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000105 for on host demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000106 for on host demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000107 for on host demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000108 for on host demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000109 for on host demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000110 for on host demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000111 for on host demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000112 for on host demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000113 for on host demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000114 for on host demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000115 for on host demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000116 for on host demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000117 for on host demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000118 for on host demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000119 for on host demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000120 for on host demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000121 for on host demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000122 for on host demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000123 for on host demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000124 for on host demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000125 for on host demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000126 for on host demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000127 for on host demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000128 for on host demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000129 for on host demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000130 for on host demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000131 for on host demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000132 for on host demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000133 for on host demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000134 for on host demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000135 for on host demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000136 for on host demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000137 for on host demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000138 for on host demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000139 for on host demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000140 for on host demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000141 for on host demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000142 for on host demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000143 for on host demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000144 for on host demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000145 for on host demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000146 for on host demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000147 for on host demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000148 for on host demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000149 for on host demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000150 for on host demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000151 for on host demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000152 for on host demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000153 for on host demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000154 for on host demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000155 for on host demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000156 for on host demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000157 for on host demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000158 for on host demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000159 for on host demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000160 for on host demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000161 for on host demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000162 for on host demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000163 for on host demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000164 for on host demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000165 for on host demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000166 for on host demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000167 for on host demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000168 for on host demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000169 for on host demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000170 for on host demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000171 for on host demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000172 for on host demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000173 for on host demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000174 for on host demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000175 for on host demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000176 for on host demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000177 for on host demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000178 for on host demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000179 for on host demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000180 for on host demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000181 for on host demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000182 for on host demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000183 for on host demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000184 for on host demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000185 for on host demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000186 for on host demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000187 for on host demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000188 for on host demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000189 for on host demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000190 for on host demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000191 for on host demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000192 for on host demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000193 for on host demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000194 for on host demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000195 for on host demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000196 for on host demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000197 for on host demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000198 for on host demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000199 for on host demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000200 for on host demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000201 for on host demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000202 for on host demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000203 for on host demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000204 for on host demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000205 for on host demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000206 for on host demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000207 for on host demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000208 for on host demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000209 for on host demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000210 for on host demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000211 for on host demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000212 for on host demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000213 for on host demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000214 for on host demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000215 for on host demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000216 for on host demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000217 for on host demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000218 for on host demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000219 for on host demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000220 for on host demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000221 for on host demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000222 for on host demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000223 for on host demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000224 for on host demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000225 for on host demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000226 for on host demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000227 for on host demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000228 for on host demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000229 for on host demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000230 for on host demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000231 for on host demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000232 for on host demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000233 for on host demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000234 for on host demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000235 for on host demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000236 for on host demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000237 for on host demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000238 for on host demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000239 for on host demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000240 for on host demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000241 for on host demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000242 for on host demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000243 for on host demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000244 for on host demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000245 for on host demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000246 for on host demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000247 for on host demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000248 for on host demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000249 for on host demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000250 for on host demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000251 for on host demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000252 for on host demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000253 for on host demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000254 for on host demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000255 for on host demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000256 for on host demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000257 for on host demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000258 for on host demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000259 for on host demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000260 for on host demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000261 for on host demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000262 for on host demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000263 for on host demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000264 for on host demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000265 for on host demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000266 for on host demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000267 for on host demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000268 for on host demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000269 for on host demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000270 for on host demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000271 for on host demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000272 for on host demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000273 for on host demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000274 for on host demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000275 for on host demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000276 for on host demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000277 for on host demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000278 for on host demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000279 for on host demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000280 for on host demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000281 for on host demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000282 for on host demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000283 for on host demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000284 for on host demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000285 for on host demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000286 for on host demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000287 for on host demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000288 for on host demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000289 for on host demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000290 for on host demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000291 for on host demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000292 for on host demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000293 for on host demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000294 for on host demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000295 for on host demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000296 for on host demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000297 for on host demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000298 for on host demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000299 for on host demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000300 for on host demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000301 for on host demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000302 for on host demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000303 for on host demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000304 for on host demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000305 for on host demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000306 for on host demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000307 for on host demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000308 for on host demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000309 for on host demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000310 for on host demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000311 for on host demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000312 for on host demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-9.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000313 for on host demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000314 for on host demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000315 for on host demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000316 for on host demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000317 for on host demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000318 for on host demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000319 for on host demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000320 for on host demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000321 for on host demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000322 for on host demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000323 for on host demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000324 for on host demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000325 for on host demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000326 for on host demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-14.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000327 for on host demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000328 for on host demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000329 for on host demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000330 for on host demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000331 for on host demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000332 for on host demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000333 for on host demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000334 for on host demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000335 for on host demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000336 for on host demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000337 for on host demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000338 for on host demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000339 for on host demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000340 for on host demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000341 for on host demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-17.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000342 for on host demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000343 for on host demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000344 for on host demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000345 for on host demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000346 for on host demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000347 for on host demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-8.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000348 for on host demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000349 for on host demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000350 for on host demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000351 for on host demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000352 for on host demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-18.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000353 for on host demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000354 for on host demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000355 for on host demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-7.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000356 for on host demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-19.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000357 for on host demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-20.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000358 for on host demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000359 for on host demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-2.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000360 for on host demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000361 for on host demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-11.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000362 for on host demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau08-15.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000363 for on host demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-3.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000364 for on host demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-1.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000365 for on host demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-12.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000366 for on host demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-4.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000367 for on host demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz08-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000368 for on host demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-13.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000369 for on host demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz10-5.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000370 for on host demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmaz11-10.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000371 for on host demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-6.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching container container_1426705269584_0055_01_000372 for on host demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, executorHostname: demeter-csmau10-16.demeter.hpc.mssm.edu | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000010/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000010/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000006/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000006/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000005/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000005/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000014/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000014/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000024/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000024/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000025/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000025/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000023/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000023/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000002/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000002/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000017/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000017/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000013/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000013/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000003/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000003/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000021/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000021/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000015/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000015/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 23, --hostname, demeter-csmaz11-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 20, --hostname, demeter-csmaz11-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000004/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000004/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000018/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000018/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 3, --hostname, demeter-csmaz08-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000007/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000007/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000022/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000022/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000026/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000026/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000016/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000016/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000008/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000008/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000011/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000011/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 15, --hostname, demeter-csmaz11-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 10, --hostname, demeter-csmaz08-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 25, --hostname, demeter-csmaz11-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 21, --hostname, demeter-csmaz10-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 6, --hostname, demeter-csmaz10-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 17, --hostname, demeter-csmau10-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 14, --hostname, demeter-csmau08-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 13, --hostname, demeter-csmaz10-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 16, --hostname, demeter-csmaz08-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 2, --hostname, demeter-csmau10-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 12, --hostname, demeter-csmau08-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 9, --hostname, demeter-csmau08-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 24, --hostname, demeter-csmaz08-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 4, --hostname, demeter-csmaz08-9.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 22, --hostname, demeter-csmaz10-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 1, --hostname, demeter-csmaz10-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 5, --hostname, demeter-csmaz10-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.YarnAllocator: Received 371 containers from YARN, launching executors on 371 of them. | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000020/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000020/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000019/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000019/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 19, --hostname, demeter-csmaz08-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000009/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000009/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000012/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000012/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 8, --hostname, demeter-csmaz08-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 18, --hostname, demeter-csmau08-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 7, --hostname, demeter-csmau10-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 11, --hostname, demeter-csmau08-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-9.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000031/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000031/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 30, --hostname, demeter-csmau08-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000029/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000029/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 28, --hostname, demeter-csmau10-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000034/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000034/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 33, --hostname, demeter-csmaz10-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000038/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000038/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 37, --hostname, demeter-csmau10-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000027/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000027/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 26, --hostname, demeter-csmau10-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000041/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000041/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 40, --hostname, demeter-csmaz08-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000036/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000036/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 35, --hostname, demeter-csmaz10-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000045/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000045/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 44, --hostname, demeter-csmau08-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000028/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000028/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 27, --hostname, demeter-csmaz11-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000030/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000030/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 29, --hostname, demeter-csmau10-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000051/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000051/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 50, --hostname, demeter-csmaz08-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000043/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000043/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 42, --hostname, demeter-csmaz11-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000047/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000047/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 46, --hostname, demeter-csmaz08-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000050/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000050/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000039/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000039/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 49, --hostname, demeter-csmau10-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 38, --hostname, demeter-csmaz08-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000048/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000048/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000037/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000037/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 47, --hostname, demeter-csmau10-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 36, --hostname, demeter-csmau10-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000035/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000035/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000042/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000042/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000049/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000049/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 41, --hostname, demeter-csmaz11-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 34, --hostname, demeter-csmaz10-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 48, --hostname, demeter-csmaz11-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000040/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000040/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 39, --hostname, demeter-csmaz11-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000032/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000032/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000044/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000044/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 31, --hostname, demeter-csmau10-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 43, --hostname, demeter-csmau08-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000046/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000046/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 45, --hostname, demeter-csmau10-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000033/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000033/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 32, --hostname, demeter-csmau08-9.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-9.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000054/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000054/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 53, --hostname, demeter-csmau08-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000053/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000053/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 52, --hostname, demeter-csmau10-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000052/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000052/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 51, --hostname, demeter-csmaz08-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000055/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000055/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 54, --hostname, demeter-csmau08-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000057/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000057/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 56, --hostname, demeter-csmau08-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000058/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000058/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 57, --hostname, demeter-csmau08-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000059/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000059/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000056/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000056/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 55, --hostname, demeter-csmaz11-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 58, --hostname, demeter-csmaz11-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000060/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000060/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 59, --hostname, demeter-csmau10-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000062/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000062/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 61, --hostname, demeter-csmaz11-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000063/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000063/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 62, --hostname, demeter-csmaz11-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000061/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000061/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 60, --hostname, demeter-csmaz10-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000065/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000065/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000066/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000066/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 64, --hostname, demeter-csmaz10-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 65, --hostname, demeter-csmau08-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000064/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000064/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 63, --hostname, demeter-csmau08-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000067/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000067/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 66, --hostname, demeter-csmaz08-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000071/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000071/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 70, --hostname, demeter-csmaz11-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000069/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000069/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 68, --hostname, demeter-csmaz10-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000070/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000070/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 69, --hostname, demeter-csmaz08-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000068/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000068/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 67, --hostname, demeter-csmaz08-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000072/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000072/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 71, --hostname, demeter-csmaz08-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000075/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000075/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 74, --hostname, demeter-csmaz10-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000076/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000076/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 75, --hostname, demeter-csmau10-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000074/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000074/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 73, --hostname, demeter-csmau08-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000073/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000073/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 72, --hostname, demeter-csmaz10-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000077/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000077/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 76, --hostname, demeter-csmaz08-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000078/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000078/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 77, --hostname, demeter-csmaz11-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000079/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000079/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 78, --hostname, demeter-csmaz11-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000081/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000081/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000080/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000080/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 80, --hostname, demeter-csmaz10-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 79, --hostname, demeter-csmau08-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000082/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000082/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 81, --hostname, demeter-csmaz11-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000083/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000083/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 82, --hostname, demeter-csmau08-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000085/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000085/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000084/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000084/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 83, --hostname, demeter-csmaz10-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 84, --hostname, demeter-csmaz08-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000086/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000086/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 85, --hostname, demeter-csmau10-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000088/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000088/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000090/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000090/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 89, --hostname, demeter-csmaz10-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000087/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000087/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 86, --hostname, demeter-csmaz08-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 87, --hostname, demeter-csmaz08-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000091/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000091/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 90, --hostname, demeter-csmaz11-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000096/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000096/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 95, --hostname, demeter-csmau10-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000094/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000094/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000093/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000093/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000089/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000089/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 92, --hostname, demeter-csmau10-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 88, --hostname, demeter-csmau10-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 93, --hostname, demeter-csmau08-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000099/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000099/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 98, --hostname, demeter-csmaz10-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000092/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000092/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 91, --hostname, demeter-csmau10-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000095/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000095/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 94, --hostname, demeter-csmaz10-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000097/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000097/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 96, --hostname, demeter-csmaz08-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000098/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000098/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000102/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000102/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 101, --hostname, demeter-csmaz08-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 97, --hostname, demeter-csmaz08-9.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000101/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000101/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 100, --hostname, demeter-csmau10-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000104/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000104/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-9.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 103, --hostname, demeter-csmaz08-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000100/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000100/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 99, --hostname, demeter-csmaz10-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000103/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000103/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 102, --hostname, demeter-csmau08-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000107/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000107/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 106, --hostname, demeter-csmaz10-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000105/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000105/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 104, --hostname, demeter-csmau08-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000106/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000106/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 105, --hostname, demeter-csmau08-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000108/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000108/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 107, --hostname, demeter-csmau08-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000109/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000109/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 108, --hostname, demeter-csmaz11-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000110/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000110/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 109, --hostname, demeter-csmaz08-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000112/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000112/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 111, --hostname, demeter-csmau08-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000111/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000111/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 110, --hostname, demeter-csmau10-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000113/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000113/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 112, --hostname, demeter-csmaz08-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000114/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000114/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 113, --hostname, demeter-csmaz11-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000115/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000115/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 114, --hostname, demeter-csmaz10-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000118/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000118/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 117, --hostname, demeter-csmaz08-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000116/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000116/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000117/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000117/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 115, --hostname, demeter-csmaz10-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000119/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000119/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 118, --hostname, demeter-csmaz11-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 116, --hostname, demeter-csmaz11-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000120/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000120/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000121/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000121/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 120, --hostname, demeter-csmaz11-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000123/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000123/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 122, --hostname, demeter-csmau10-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000124/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000124/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 123, --hostname, demeter-csmau08-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000125/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000125/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 124, --hostname, demeter-csmau10-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000122/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000122/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 121, --hostname, demeter-csmau10-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000128/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000128/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000127/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000127/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 127, --hostname, demeter-csmaz10-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 126, --hostname, demeter-csmaz10-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 119, --hostname, demeter-csmau10-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-16.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000131/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000131/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 130, --hostname, demeter-csmau10-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000132/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000132/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 131, --hostname, demeter-csmaz08-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000126/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-9.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000126/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:54 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 125, --hostname, demeter-csmau08-9.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000130/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000130/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-9.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000134/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000134/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 129, --hostname, demeter-csmau10-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 133, --hostname, demeter-csmaz08-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000129/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000129/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 128, --hostname, demeter-csmaz10-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000138/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000138/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 137, --hostname, demeter-csmau08-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000133/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000133/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000139/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000139/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 132, --hostname, demeter-csmaz11-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 138, --hostname, demeter-csmau10-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000137/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000137/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 136, --hostname, demeter-csmau08-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000136/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000136/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 135, --hostname, demeter-csmaz11-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000140/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000140/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 139, --hostname, demeter-csmaz08-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000135/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-14.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000135/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 134, --hostname, demeter-csmaz11-14.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-14.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000141/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000141/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 140, --hostname, demeter-csmau10-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000143/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000143/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 142, --hostname, demeter-csmau10-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000142/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000142/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 141, --hostname, demeter-csmaz11-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000144/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000144/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 143, --hostname, demeter-csmaz08-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000145/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-10.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000145/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000147/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000147/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 146, --hostname, demeter-csmau08-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000146/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000146/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 145, --hostname, demeter-csmau10-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 144, --hostname, demeter-csmaz08-10.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000150/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000150/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000148/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000148/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 147, --hostname, demeter-csmau08-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000149/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000149/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 149, --hostname, demeter-csmau08-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-10.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000152/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000152/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 151, --hostname, demeter-csmaz11-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000151/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000151/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 148, --hostname, demeter-csmaz11-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000154/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-1.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000154/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000153/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000153/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 152, --hostname, demeter-csmau10-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 150, --hostname, demeter-csmau08-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000156/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000156/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000158/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000158/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 157, --hostname, demeter-csmaz10-12.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000159/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000159/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000162/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000162/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 153, --hostname, demeter-csmaz10-1.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 158, --hostname, demeter-csmau08-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-12.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000155/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-17.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000155/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000157/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000157/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 154, --hostname, demeter-csmaz11-17.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 155, --hostname, demeter-csmaz11-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 156, --hostname, demeter-csmau08-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-1.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 161, --hostname, demeter-csmaz10-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-17.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000164/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000164/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 163, --hostname, demeter-csmaz11-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000160/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-5.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000160/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000163/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000163/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000166/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-18.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000166/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 159, --hostname, demeter-csmaz08-5.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 162, --hostname, demeter-csmaz08-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 165, --hostname, demeter-csmaz10-18.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-5.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000161/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-8.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000161/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-18.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 160, --hostname, demeter-csmaz08-8.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-8.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000167/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000167/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 166, --hostname, demeter-csmau08-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000165/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000165/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 164, --hostname, demeter-csmaz08-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000168/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000168/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 167, --hostname, demeter-csmaz10-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000169/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-7.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000169/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 168, --hostname, demeter-csmau10-7.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-7.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000170/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-19.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000170/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 169, --hostname, demeter-csmaz08-19.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000171/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-20.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000171/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000172/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000172/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 170, --hostname, demeter-csmaz11-20.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 171, --hostname, demeter-csmaz11-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-19.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-20.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000173/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-2.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000173/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 172, --hostname, demeter-csmau08-2.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-2.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000174/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-6.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000174/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 173, --hostname, demeter-csmaz10-6.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000177/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz10-3.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000177/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz11-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000175/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz11-11.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000175/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 174, --hostname, demeter-csmaz11-11.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 176, --hostname, demeter-csmaz10-3.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz11-11.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000176/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau08-15.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000176/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-6.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Starting Executor Container | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz10-3.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 175, --hostname, demeter-csmau08-15.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Preparing Local resources | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000180/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-4.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000180/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau08-15.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 179, --hostname, demeter-csmaz08-4.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmaz08-4.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000182/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-13.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000182/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 181, --hostname, demeter-csmau10-13.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr) | |
| 15/03/20 14:12:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy : demeter-csmau10-13.demeter.hpc.mssm.edu:8041 | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar" } size: 119955085 timestamp: 1426875145873 type: FILE visibility: PRIVATE, __spark__.jar -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar" } size: 169458424 timestamp: 1426875144861 type: FILE visibility: PRIVATE, metrics.properties -> resource { scheme: "hdfs" host: "demeter-nn1.demeter.hpc.mssm.edu" port: 8020 file: "/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties" } size: 5609 timestamp: 1426875145937 type: FILE visibility: PRIVATE) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmaz08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000181/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmaz08-16.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000181/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CLIENT_CONF_DIR:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_YARN_HOME/*:$HADOOP_YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$MR2_CLASSPATH, SPARK_LOG_URL_STDERR -> http://demeter-csmau10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000179/willir31/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1426705269584_0055, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 169458424,119955085,5609, SPARK_USER -> willir31, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE,PRIVATE,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1426875144861,1426875145873,1426875145937, SPARK_LOG_URL_STDOUT -> http://demeter-csmau10-12.demeter.hpc.mssm.edu:8042/node/containerlogs/container_1426705269584_0055_01_000179/willir31/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/spark-assembly-1.3.0-SNAPSHOT-hadoop2.3.0.jar#__spark__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/guacamole-with-dependencies-0.0.1-SNAPSHOT.jar#__app__.jar,hdfs://demeter-nn1.demeter.hpc.mssm.edu:8020/user/willir31/.sparkStaging/application_1426705269584_0055/metrics.properties#metrics.properties) | |
| 15/03/20 14:12:55 INFO yarn.ExecutorRunnable: Setting up executor with commands: List($JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms17408m, -Xmx17408m, -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.timeout=1000', '-Dspark.ui.port=0', '-Dspark.driver.port=50078', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@demeter-csmau08-13.demeter.hpc.mssm.edu:50078/user/CoarseGrainedScheduler, --executor-id, 180, --hostname, demeter-csmaz08-16.demeter.hpc.mssm.edu, --cores, 6, --app-id, application_1426705269584_0055, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdou |
View raw
(Sorry about that, but we can’t show files that are this big right now.)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment