Gromacs /Lsdmap on Stampede fails - Linux/Stampede platform

grlsdmapFails

[ExTASY-toolsOct2] ardita@poirot 187% extasy --RPconfig stampede.rcfg --Kconfig gromacslsdmap.wcfg
Session UID: 542e7955f8cdba2fce5f0321 
Pilot UID       : 542e7958f8cdba2fce5f0323 
[Callback]: ComputePilot '542e7958f8cdba2fce5f0323' state changed to Launching.
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/gromacs.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/amber.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/mmpbsa.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/test.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/coco.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/lsdmap.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/sleep.json
Loading kernel configurations from /users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/mdkernels/configs/namd.json
Prepare grofiles..
Preprocessing time :  0.873557806015
Cycle 0
Starting Simulation
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0331' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034b' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0332' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035a' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035b' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0338' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032d' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0347' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0361' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035e' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0348' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0333' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0353' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0334' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034a' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0337' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034d' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0343' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0325' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034e' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0362' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033b' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035f' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033d' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0344' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033c' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0330' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0349' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033e' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0329' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032c' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033f' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0350' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0340' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0363' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0354' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032e' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035c' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032f' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0341' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0335' state changed to PendingInputStaging.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0331' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0331' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to StagingInput.
[Callback]: ComputePilot '542e7958f8cdba2fce5f0323' state changed to PendingActive.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0334' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034a' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0334' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0337' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034d' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0343' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034a' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0325' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034e' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0362' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033b' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035f' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033d' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0344' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033c' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0330' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034d' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0337' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0349' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033e' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0343' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0329' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034b' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034b' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0332' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035a' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035b' state changed to StagingInput.
[Callback]: ComputePilot '542e7958f8cdba2fce5f0323' state changed to Active.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0331' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034b' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0334' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034a' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0338' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034d' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0337' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0343' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0331' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034b' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0357' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0332' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032d' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0334' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0364' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034a' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0327' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0336' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034f' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034c' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034d' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0337' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0343' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035d' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0332' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0339' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0332' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035a' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0347' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035a' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0361' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035a' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035e' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032b' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0348' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035b' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0333' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035b' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0353' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032c' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035b' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033f' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0338' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0345' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0338' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0350' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0338' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032d' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0340' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032d' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032d' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0363' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0346' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0354' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032e' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0358' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0347' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035c' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to StagingOutput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0347' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to StagingOutput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0361' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032f' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0361' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0341' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0342' state changed to Done.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0361' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0359' state changed to Done.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035e' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035e' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0335' state changed to StagingInput.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035e' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0348' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0348' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0333' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0353' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0333' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0353' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032c' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033f' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032c' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033f' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0350' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0348' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0333' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0350' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0340' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0353' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0363' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0363' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0354' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032c' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0354' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032e' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033f' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0326' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0350' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0340' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035c' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032f' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035c' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0341' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0352' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0363' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032f' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0341' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0360' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0354' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032e' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0335' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0325' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0325' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034e' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0355' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035c' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034e' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0362' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032f' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0341' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0335' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033b' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035f' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0325' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0362' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033b' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035f' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033d' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0344' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0356' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0351' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f034e' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0344' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033c' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0335' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0330' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0362' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033c' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033b' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f035f' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0330' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033e' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033d' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0344' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033e' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0349' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0329' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to PendingExecution.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033c' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033a' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0349' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0329' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to Scheduling.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0330' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0328' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to Executing.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f033e' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0329' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f0349' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
[Callback]: ComputeUnit '542e7961f8cdba2fce5f032a' state changed to Failed.
            Log: All FTW Input Staging Directives done - 1.
Traceback (most recent call last):
  File "/users/ardita/ExTASY-toolsOct2/bin/extasy", line 9, in <module>
    load_entry_point('radical.ensemblemd.extasy==0.1', 'console_scripts', 'extasy')()
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/extasy/bin/runme.py", line 130, in main
    Simulator(umgr,RPconfig,Kconfig,i)
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/ensemblemd/extasy/bin/Simulator/Gromacs/simulator.py", line 64, in Simulator
    with open('out%s.gro' % i, 'r') as output_file:
IOError: [Errno 2] No such file or directory: 'out0.gro'
Exception in thread Thread-3 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
  File "/usr/lib64/python2.6/threading.py", line 532, in __bootstrap_inner
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/pilot/controller/unit_manager_controller.py", line 296, in run
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/pilot/controller/unit_manager_controller.py", line 205, in call_unit_state_callbacks
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/radical/pilot/db/database.py", line 753, in publish_compute_unit_callback_history
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/pymongo/collection.py", line 572, in update
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/pymongo/mongo_client.py", line 1136, in _send_message
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/pymongo/pool.py", line 395, in maybe_return_socket
  File "/users/ardita/ExTASY-toolsOct2/lib/python2.6/site-packages/pymongo/pool.py", line 81, in __eq__
<type 'exceptions.TypeError'>: 'NoneType' object is not callable