Skip to content

Instantly share code, notes, and snippets.

@emcbot

emcbot/gfspostsnd.log

Created June 4, 2024 08:36
Show Gist options
  • Save emcbot/bc3b7d2ab936d5fe29b3a67142907f20 to your computer and use it in GitHub Desktop.
Save emcbot/bc3b7d2ab936d5fe29b3a67142907f20 to your computer and use it in GitHub Desktop.
Download ZIP
error log file from CI run PR_2644
Raw
gfspostsnd.log
PBS: Running prologue on parent mom node: nid003585...
nid002811: Warning: Permanently added the ECDSA host key for IP address '10.253.135.27' to the list of known hosts.
nid002891: Warning: Permanently added the ECDSA host key for IP address '10.253.135.107' to the list of known hosts.
nid003910: Warning: Permanently added the ECDSA host key for IP address '10.253.139.83' to the list of known hosts.
Job 134208616.cbqs01 nodelist: nid[002811,002891,003585,003910]
+ /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/jobs/rocoto/postsnd.sh
Begin postsnd.sh at Tue Jun 4 08:32:52 UTC 2024
+ postsnd.sh[8]: . /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/load_fv3gfs_modules.sh
++ load_fv3gfs_modules.sh[4]: [[ NO == \N\O ]]
++ load_fv3gfs_modules.sh[5]: echo 'Loading modules quietly...'
Loading modules quietly...
++ load_fv3gfs_modules.sh[6]: set +x
Resetting modules to system default. Reseting $MODULEPATH back to system default. All extra directories will be removed from $MODULEPATH.
Currently Loaded Modules:
1) craype-x86-rome (H) 13) perl/5.32.0 25) met/9.1.3
2) libfabric/1.11.0.0. (H) 14) libjpeg/9c 26) metplus/3.1.1
3) craype-network-ofi (H) 15) udunits/2.2.28 27) prepobs/1.0.1
4) envvar/1.0 16) gsl/2.7 28) fit2obs/1.0.0
5) PrgEnv-intel/8.1.0 17) cdo/1.9.8 29) mos_shared/2.7.2
6) craype/2.7.13 18) hdf5/1.10.6 30) module_base.wcoss2
7) intel/19.1.3.304 19) netcdf/4.7.4 31) grib_util/1.2.3
8) cray-mpich/8.1.9 20) nco/4.7.9 32) g2tmpl/1.10.2
9) cray-pals/1.0.17 21) prod_util/2.0.9 33) crtm/2.4.0.1
10) cfp/2.0.4 22) bufr_dump/1.0.0 34) wgrib2/2.0.8
11) python/3.8.6 23) util_shared/1.4.0
12) gempak/7.14.1 24) ncdiag/1.0.0
Where:
H: Hidden Module
+ postsnd.sh[9]: status=0
+ postsnd.sh[10]: [[ 0 -ne 0 ]]
+ postsnd.sh[12]: export job=postsnd
+ postsnd.sh[12]: job=postsnd
+ postsnd.sh[13]: export jobid=postsnd.251098
+ postsnd.sh[13]: jobid=postsnd.251098
+ postsnd.sh[17]: /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/jobs/JGFS_ATMOS_POSTSND
Begin JGFS_ATMOS_POSTSND at Tue Jun 4 08:32:53 UTC 2024
+ JGFS_ATMOS_POSTSND[4]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/jjob_header.sh -e postsnd -c 'base postsnd'
++ jjob_header.sh[44]: OPTIND=1
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[48]: env_job=postsnd
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[47]: read -ra configs
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[59]: shift 4
++ jjob_header.sh[61]: [[ -z postsnd ]]
++ jjob_header.sh[69]: export DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
++ jjob_header.sh[69]: DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
++ jjob_header.sh[70]: [[ YES == \Y\E\S ]]
++ jjob_header.sh[71]: rm -rf /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
++ jjob_header.sh[73]: mkdir -p /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
++ jjob_header.sh[74]: cd /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
++ jjob_header.sh[80]: export cycle=t18z
++ jjob_header.sh[80]: cycle=t18z
++ jjob_header.sh[81]: setpdy.sh
completed cleanly
completed cleanly
Source PDY script to export PDYm7, ..., PDY, ..., PDYp7 variables.
++ jjob_header.sh[82]: source ./PDY
+++ PDY[1]: export PDYm7=20211214
+++ PDY[1]: PDYm7=20211214
+++ PDY[2]: export PDYm6=20211215
+++ PDY[2]: PDYm6=20211215
+++ PDY[3]: export PDYm5=20211216
+++ PDY[3]: PDYm5=20211216
+++ PDY[4]: export PDYm4=20211217
+++ PDY[4]: PDYm4=20211217
+++ PDY[5]: export PDYm3=20211218
+++ PDY[5]: PDYm3=20211218
+++ PDY[6]: export PDYm2=20211219
+++ PDY[6]: PDYm2=20211219
+++ PDY[7]: export PDYm1=20211220
+++ PDY[7]: PDYm1=20211220
+++ PDY[8]: export PDY=20211221
+++ PDY[8]: PDY=20211221
+++ PDY[9]: export PDYp1=20211222
+++ PDY[9]: PDYp1=20211222
+++ PDY[10]: export PDYp2=20211223
+++ PDY[10]: PDYp2=20211223
+++ PDY[11]: export PDYp3=20211224
+++ PDY[11]: PDYp3=20211224
+++ PDY[12]: export PDYp4=20211225
+++ PDY[12]: PDYp4=20211225
+++ PDY[13]: export PDYp5=20211226
+++ PDY[13]: PDYp5=20211226
+++ PDY[14]: export PDYp6=20211227
+++ PDY[14]: PDYp6=20211227
+++ PDY[15]: export PDYp7=20211228
+++ PDY[15]: PDYp7=20211228
++ jjob_header.sh[88]: export pid=251536
++ jjob_header.sh[88]: pid=251536
++ jjob_header.sh[89]: export pgmout=OUTPUT.251536
++ jjob_header.sh[89]: pgmout=OUTPUT.251536
++ jjob_header.sh[90]: export pgmerr=errfile
++ jjob_header.sh[90]: pgmerr=errfile
++ jjob_header.sh[96]: export EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0
++ jjob_header.sh[96]: EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0/config.base
+++ config.base[6]: echo 'BEGIN: config.base'
BEGIN: config.base
+++ config.base[9]: export machine=WCOSS2
+++ config.base[9]: machine=WCOSS2
+++ config.base[12]: export RUN_ENVIR=emc
+++ config.base[12]: RUN_ENVIR=emc
+++ config.base[15]: export ACCOUNT=GFS-DEV
+++ config.base[15]: ACCOUNT=GFS-DEV
+++ config.base[16]: export ACCOUNT_SERVICE=GFS-DEV
+++ config.base[16]: ACCOUNT_SERVICE=GFS-DEV
+++ config.base[17]: export QUEUE=dev
+++ config.base[17]: QUEUE=dev
+++ config.base[18]: export QUEUE_SERVICE=dev_transfer
+++ config.base[18]: QUEUE_SERVICE=dev_transfer
+++ config.base[19]: export PARTITION_BATCH=
+++ config.base[19]: PARTITION_BATCH=
+++ config.base[20]: export PARTITION_SERVICE=
+++ config.base[20]: PARTITION_SERVICE=
+++ config.base[21]: export RESERVATION=
+++ config.base[21]: RESERVATION=
+++ config.base[24]: export HPSS_PROJECT=emc-global
+++ config.base[24]: HPSS_PROJECT=emc-global
+++ config.base[27]: export HOMEgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow
+++ config.base[27]: HOMEgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow
+++ config.base[28]: export EXECgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/exec
+++ config.base[28]: EXECgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/exec
+++ config.base[29]: export FIXgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix
+++ config.base[29]: FIXgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix
+++ config.base[30]: export PARMgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/parm
+++ config.base[30]: PARMgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/parm
+++ config.base[31]: export SCRgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/scripts
+++ config.base[31]: SCRgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/scripts
+++ config.base[32]: export USHgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush
+++ config.base[32]: USHgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush
+++ config.base[34]: export FIXam=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/am
+++ config.base[34]: FIXam=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/am
+++ config.base[35]: export FIXaer=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/aer
+++ config.base[35]: FIXaer=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/aer
+++ config.base[36]: export FIXcpl=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/cpl
+++ config.base[36]: FIXcpl=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/cpl
+++ config.base[37]: export FIXlut=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/lut
+++ config.base[37]: FIXlut=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/lut
+++ config.base[38]: export FIXorog=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/orog
+++ config.base[38]: FIXorog=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/orog
+++ config.base[39]: export FIXcice=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/cice
+++ config.base[39]: FIXcice=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/cice
+++ config.base[40]: export FIXmom=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/mom6
+++ config.base[40]: FIXmom=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/mom6
+++ config.base[41]: export FIXreg2grb2=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/reg2grb2
+++ config.base[41]: FIXreg2grb2=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/reg2grb2
+++ config.base[42]: export FIXugwd=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/ugwd
+++ config.base[42]: FIXugwd=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/ugwd
+++ config.base[43]: export FIXgdas=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/gdas
+++ config.base[43]: FIXgdas=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/gdas
+++ config.base[48]: export PACKAGEROOT=/lfs/h1/ops/prod/packages
+++ config.base[48]: PACKAGEROOT=/lfs/h1/ops/prod/packages
+++ config.base[49]: export COMROOT=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT
+++ config.base[49]: COMROOT=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT
+++ config.base[50]: export COMINsyn=/lfs/h1/ops/prod/com/gfs/v16.3/syndat
+++ config.base[50]: COMINsyn=/lfs/h1/ops/prod/com/gfs/v16.3/syndat
+++ config.base[51]: export DMPDIR=/lfs/h2/emc/dump/noscrub/dump
+++ config.base[51]: DMPDIR=/lfs/h2/emc/dump/noscrub/dump
+++ config.base[52]: export BASE_CPLIC=/lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/prototype_ICs
+++ config.base[52]: BASE_CPLIC=/lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/prototype_ICs
+++ config.base[56]: export COMINecmwf=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ecmwf
+++ config.base[56]: COMINecmwf=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ecmwf
+++ config.base[57]: export COMINnam=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/nam
+++ config.base[57]: COMINnam=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/nam
+++ config.base[58]: export COMINukmet=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ukmet
+++ config.base[58]: COMINukmet=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ukmet
+++ config.base[61]: export HOMEDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[61]: HOMEDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[62]: export STMP=/lfs/h2/emc/stmp/terry.mcguinness
+++ config.base[62]: STMP=/lfs/h2/emc/stmp/terry.mcguinness
+++ config.base[63]: export PTMP=/lfs/h2/emc/ptmp/terry.mcguinness
+++ config.base[63]: PTMP=/lfs/h2/emc/ptmp/terry.mcguinness
+++ config.base[64]: export NOSCRUB=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[64]: NOSCRUB=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[67]: export BASE_GIT=/lfs/h2/emc/global/save/emc.global/git
+++ config.base[67]: BASE_GIT=/lfs/h2/emc/global/save/emc.global/git
+++ config.base[70]: export DO_GOES=YES
+++ config.base[70]: DO_GOES=YES
+++ config.base[71]: export DO_BUFRSND=YES
+++ config.base[71]: DO_BUFRSND=YES
+++ config.base[72]: export DO_GEMPAK=YES
+++ config.base[72]: DO_GEMPAK=YES
+++ config.base[73]: export DO_AWIPS=NO
+++ config.base[73]: DO_AWIPS=NO
+++ config.base[74]: export DO_NPOESS=YES
+++ config.base[74]: DO_NPOESS=YES
+++ config.base[75]: export DO_TRACKER=YES
+++ config.base[75]: DO_TRACKER=YES
+++ config.base[76]: export DO_GENESIS=YES
+++ config.base[76]: DO_GENESIS=YES
+++ config.base[77]: export DO_GENESIS_FSU=NO
+++ config.base[77]: DO_GENESIS_FSU=NO
+++ config.base[78]: export DO_VERFOZN=YES
+++ config.base[78]: DO_VERFOZN=YES
+++ config.base[79]: export DO_VERFRAD=YES
+++ config.base[79]: DO_VERFRAD=YES
+++ config.base[80]: export DO_VMINMON=YES
+++ config.base[80]: DO_VMINMON=YES
+++ config.base[81]: export DO_MOS=NO
+++ config.base[81]: DO_MOS=NO
+++ config.base[87]: export REALTIME=YES
+++ config.base[87]: REALTIME=YES
+++ config.base[90]: export MODE=cycled
+++ config.base[90]: MODE=cycled
+++ config.base[99]: export FIXgsi=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/gsi
+++ config.base[99]: FIXgsi=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/fix/gsi
+++ config.base[100]: export HOMEpost=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow
+++ config.base[100]: HOMEpost=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow
+++ config.base[101]: export HOMEobsproc=/lfs/h2/emc/global/save/emc.global/git/obsproc/v1.1.2
+++ config.base[101]: HOMEobsproc=/lfs/h2/emc/global/save/emc.global/git/obsproc/v1.1.2
+++ config.base[104]: export 'NCP=/bin/cp -p'
+++ config.base[104]: NCP='/bin/cp -p'
+++ config.base[105]: export NMV=/bin/mv
+++ config.base[105]: NMV=/bin/mv
+++ config.base[106]: export 'NLN=/bin/ln -sf'
+++ config.base[106]: NLN='/bin/ln -sf'
+++ config.base[107]: export VERBOSE=YES
+++ config.base[107]: VERBOSE=YES
+++ config.base[108]: export KEEPDATA=NO
+++ config.base[108]: KEEPDATA=NO
+++ config.base[109]: export DEBUG_POSTSCRIPT=NO
+++ config.base[109]: DEBUG_POSTSCRIPT=NO
+++ config.base[110]: export CHGRP_RSTPROD=YES
+++ config.base[110]: CHGRP_RSTPROD=YES
+++ config.base[111]: export 'CHGRP_CMD=chgrp rstprod'
+++ config.base[111]: CHGRP_CMD='chgrp rstprod'
+++ config.base[112]: export NCDUMP=/apps/prod/hpc-stack/intel-19.1.3.304/cray-mpich-8.1.4/netcdf/4.7.4/bin/ncdump
+++ config.base[112]: NCDUMP=/apps/prod/hpc-stack/intel-19.1.3.304/cray-mpich-8.1.4/netcdf/4.7.4/bin/ncdump
+++ config.base[113]: export NCLEN=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/getncdimlen
+++ config.base[113]: NCLEN=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/getncdimlen
+++ config.base[116]: export BASE_ENV=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/env
+++ config.base[116]: BASE_ENV=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/env
+++ config.base[117]: export BASE_JOB=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/jobs/rocoto
+++ config.base[117]: BASE_JOB=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/jobs/rocoto
+++ config.base[120]: export SDATE=2021122018
+++ config.base[120]: SDATE=2021122018
+++ config.base[121]: export EDATE=2021122118
+++ config.base[121]: EDATE=2021122118
+++ config.base[122]: export EXP_WARM_START=.false.
+++ config.base[122]: EXP_WARM_START=.false.
+++ config.base[123]: export assim_freq=6
+++ config.base[123]: assim_freq=6
+++ config.base[124]: export PSLOT=C96_atm3DVar_extended_547c5de0
+++ config.base[124]: PSLOT=C96_atm3DVar_extended_547c5de0
+++ config.base[125]: export EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0
+++ config.base[125]: EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0
+++ config.base[126]: export ROTDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0
+++ config.base[126]: ROTDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0
+++ config.base[127]: export ROTDIR_DUMP=YES
+++ config.base[127]: ROTDIR_DUMP=YES
+++ config.base[128]: export DUMP_SUFFIX=
+++ config.base[128]: DUMP_SUFFIX=
+++ config.base[129]: [[ 2021122118 -ge 2019092100 ]]
+++ config.base[129]: [[ 2021122118 -le 2019110700 ]]
+++ config.base[132]: export DATAROOT=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0
+++ config.base[132]: DATAROOT=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0
+++ config.base[133]: export RUNDIR=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0
+++ config.base[133]: RUNDIR=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0
+++ config.base[134]: export ARCDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness/archive/C96_atm3DVar_extended_547c5de0
+++ config.base[134]: ARCDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness/archive/C96_atm3DVar_extended_547c5de0
+++ config.base[135]: export ATARDIR=/NCEPDEV/emc-global/1year/terry.mcguinness/WCOSS2/scratch/C96_atm3DVar_extended_547c5de0
+++ config.base[135]: ATARDIR=/NCEPDEV/emc-global/1year/terry.mcguinness/WCOSS2/scratch/C96_atm3DVar_extended_547c5de0
+++ config.base[138]: export envir=prod
+++ config.base[138]: envir=prod
+++ config.base[139]: export NET=gfs
+++ config.base[139]: NET=gfs
+++ config.base[140]: export RUN=gfs
+++ config.base[140]: RUN=gfs
+++ config.base[146]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0/config.com
++++ config.com[4]: echo 'BEGIN: config.com'
BEGIN: config.com
++++ config.com[37]: [[ emc == \n\c\o ]]
++++ config.com[41]: COM_OBS_TMPL='${ROTDIR}/${RUN}.${YMD}/${HH}/obs'
++++ config.com[42]: COM_RTOFS_TMPL='${DMPDIR}'
++++ config.com[44]: declare -rx COM_OBS_TMPL COM_RTOFS_TMPL
++++ config.com[45]: declare -rx 'COM_OBSDMP_TMPL=${DMPDIR}/${DUMP}${DUMP_SUFFIX}.${YMD}/${HH}/atmos'
++++ config.com[47]: COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}'
++++ config.com[49]: declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}'
++++ config.com[51]: declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf'
++++ config.com[52]: declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/input'
++++ config.com[53]: declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/restart'
++++ config.com[54]: declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos'
++++ config.com[55]: declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow'
++++ config.com[56]: declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/history'
++++ config.com[57]: declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/master'
++++ config.com[58]: declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2'
++++ config.com[59]: declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}'
++++ config.com[60]: declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr'
++++ config.com[61]: declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}'
++++ config.com[62]: declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital'
++++ config.com[63]: declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks'
++++ config.com[64]: declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim'
++++ config.com[65]: declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery'
++++ config.com[66]: declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon'
++++ config.com[67]: declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon'
++++ config.com[68]: declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon'
++++ config.com[69]: declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo'
++++ config.com[71]: declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/restart'
++++ config.com[72]: declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/prep'
++++ config.com[73]: declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/history'
++++ config.com[74]: declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded'
++++ config.com[75]: declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station'
++++ config.com[76]: declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak'
++++ config.com[77]: declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo'
++++ config.com[79]: declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/history'
++++ config.com[80]: declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/restart'
++++ config.com[81]: declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/input'
++++ config.com[82]: declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean'
++++ config.com[83]: declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf'
++++ config.com[84]: declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2'
++++ config.com[85]: declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}'
++++ config.com[87]: declare -rx 'COM_ICE_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice'
++++ config.com[88]: declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/input'
++++ config.com[89]: declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/history'
++++ config.com[90]: declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/restart'
++++ config.com[91]: declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf'
++++ config.com[92]: declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2'
++++ config.com[93]: declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}'
++++ config.com[95]: declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/chem/history'
++++ config.com[96]: declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem'
++++ config.com[98]: declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/med/restart'
+++ config.base[149]: export 'ERRSCRIPT=eval [[ $err = 0 ]]'
+++ config.base[149]: ERRSCRIPT='eval [[ $err = 0 ]]'
+++ config.base[150]: export LOGSCRIPT=
+++ config.base[150]: LOGSCRIPT=
+++ config.base[153]: export 'REDOUT=1>'
+++ config.base[153]: REDOUT='1>'
+++ config.base[154]: export 'REDERR=2>'
+++ config.base[154]: REDERR='2>'
+++ config.base[156]: export SENDECF=NO
+++ config.base[156]: SENDECF=NO
+++ config.base[157]: export SENDSDM=NO
+++ config.base[157]: SENDSDM=NO
+++ config.base[158]: export SENDDBN_NTC=NO
+++ config.base[158]: SENDDBN_NTC=NO
+++ config.base[159]: export SENDDBN=NO
+++ config.base[159]: SENDDBN=NO
+++ config.base[160]: export DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+++ config.base[160]: DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+++ config.base[163]: export APP=ATM
+++ config.base[163]: APP=ATM
+++ config.base[165]: shopt -s extglob
+++ config.base[167]: case "${RUN}" in
+++ config.base[174]: shopt -u extglob
+++ config.base[177]: export DO_ATM=YES
+++ config.base[177]: DO_ATM=YES
+++ config.base[178]: export DO_COUPLED=NO
+++ config.base[178]: DO_COUPLED=NO
+++ config.base[179]: export DO_WAVE=NO
+++ config.base[179]: DO_WAVE=NO
+++ config.base[180]: export DO_OCN=NO
+++ config.base[180]: DO_OCN=NO
+++ config.base[181]: export DO_ICE=NO
+++ config.base[181]: DO_ICE=NO
+++ config.base[182]: export DO_AERO=NO
+++ config.base[182]: DO_AERO=NO
+++ config.base[183]: export AERO_FCST_CDUMP=
+++ config.base[183]: AERO_FCST_CDUMP=
+++ config.base[184]: export AERO_ANL_CDUMP=
+++ config.base[184]: AERO_ANL_CDUMP=
+++ config.base[185]: export WAVE_CDUMP=
+++ config.base[185]: WAVE_CDUMP=
+++ config.base[186]: export DOBNDPNT_WAVE=NO
+++ config.base[186]: DOBNDPNT_WAVE=NO
+++ config.base[187]: export DOIBP_WAV=NO
+++ config.base[187]: DOIBP_WAV=NO
+++ config.base[188]: export FRAC_GRID=.true.
+++ config.base[188]: FRAC_GRID=.true.
+++ config.base[189]: export DO_NEST=NO
+++ config.base[189]: DO_NEST=NO
+++ config.base[190]: [[ NO == \Y\E\S ]]
+++ config.base[194]: export ntiles=6
+++ config.base[194]: ntiles=6
+++ config.base[198]: export OPS_RES=C768
+++ config.base[198]: OPS_RES=C768
+++ config.base[201]: export LEVS=128
+++ config.base[201]: LEVS=128
+++ config.base[202]: export CASE=C96
+++ config.base[202]: CASE=C96
+++ config.base[203]: export CASE_ENS=@CASEENS@
+++ config.base[203]: CASE_ENS=@CASEENS@
+++ config.base[204]: export OCNRES=500
+++ config.base[204]: OCNRES=500
+++ config.base[205]: export ICERES=500
+++ config.base[205]: ICERES=500
+++ config.base[208]: case "${CASE}" in
+++ config.base[213]: export waveGRD=uglo_100km
+++ config.base[213]: waveGRD=uglo_100km
+++ config.base[227]: case "${APP}" in
+++ config.base[268]: [[ gfs =~ gdas ]]
+++ config.base[271]: [[ gfs =~ gfs ]]
+++ config.base[272]: export FHCYC=24
+++ config.base[272]: FHCYC=24
+++ config.base[276]: export FHMIN=0
+++ config.base[276]: FHMIN=0
+++ config.base[277]: export FHMAX=9
+++ config.base[277]: FHMAX=9
+++ config.base[278]: export FHOUT=3
+++ config.base[278]: FHOUT=3
+++ config.base[279]: export FHOUT_OCNICE=3
+++ config.base[279]: FHOUT_OCNICE=3
+++ config.base[282]: export EUPD_CYC=gdas
+++ config.base[282]: EUPD_CYC=gdas
+++ config.base[285]: export gfs_cyc=4
+++ config.base[285]: gfs_cyc=4
+++ config.base[288]: export FHMIN_GFS=0
+++ config.base[288]: FHMIN_GFS=0
+++ config.base[289]: export FHMAX_GFS=384
+++ config.base[289]: FHMAX_GFS=384
+++ config.base[290]: export FHOUT_GFS=3
+++ config.base[290]: FHOUT_GFS=3
+++ config.base[291]: export FHMAX_HF_GFS=0
+++ config.base[291]: FHMAX_HF_GFS=0
+++ config.base[292]: export FHOUT_HF_GFS=1
+++ config.base[292]: FHOUT_HF_GFS=1
+++ config.base[293]: export FHOUT_OCNICE_GFS=6
+++ config.base[293]: FHOUT_OCNICE_GFS=6
+++ config.base[294]: export FHMIN_WAV=0
+++ config.base[294]: FHMIN_WAV=0
+++ config.base[295]: export FHOUT_WAV=3
+++ config.base[295]: FHOUT_WAV=3
+++ config.base[296]: export FHMAX_HF_WAV=120
+++ config.base[296]: FHMAX_HF_WAV=120
+++ config.base[297]: export FHOUT_HF_WAV=1
+++ config.base[297]: FHOUT_HF_WAV=1
+++ config.base[298]: export FHMAX_WAV=9
+++ config.base[298]: FHMAX_WAV=9
+++ config.base[299]: export FHMAX_WAV_GFS=384
+++ config.base[299]: FHMAX_WAV_GFS=384
+++ config.base[300]: (( gfs_cyc != 0 ))
+++ config.base[301]: export STEP_GFS=6
+++ config.base[301]: STEP_GFS=6
+++ config.base[306]: export ILPOST=1
+++ config.base[306]: ILPOST=1
+++ config.base[307]: (( FHMAX_HF_GFS < 120 ))
+++ config.base[308]: export ILPOST=3
+++ config.base[308]: ILPOST=3
+++ config.base[312]: export restart_interval_gfs=12
+++ config.base[312]: restart_interval_gfs=12
+++ config.base[317]: export QUILTING=.true.
+++ config.base[317]: QUILTING=.true.
+++ config.base[318]: export OUTPUT_GRID=gaussian_grid
+++ config.base[318]: OUTPUT_GRID=gaussian_grid
+++ config.base[319]: export WRITE_DOPOST=.true.
+++ config.base[319]: WRITE_DOPOST=.true.
+++ config.base[320]: export WRITE_NSFLIP=.true.
+++ config.base[320]: WRITE_NSFLIP=.true.
+++ config.base[323]: export DOIAU=YES
+++ config.base[323]: DOIAU=YES
+++ config.base[324]: export IAUFHRS=3,6,9
+++ config.base[324]: IAUFHRS=3,6,9
+++ config.base[325]: export IAU_FHROT=3
+++ config.base[325]: IAU_FHROT=3
+++ config.base[326]: export IAU_DELTHRS=6
+++ config.base[326]: IAU_DELTHRS=6
+++ config.base[327]: export IAU_OFFSET=6
+++ config.base[327]: IAU_OFFSET=6
+++ config.base[328]: export DOIAU_ENKF=YES
+++ config.base[328]: DOIAU_ENKF=YES
+++ config.base[329]: export IAUFHRS_ENKF=3,6,9
+++ config.base[329]: IAUFHRS_ENKF=3,6,9
+++ config.base[330]: export IAU_DELTHRS_ENKF=6
+++ config.base[330]: IAU_DELTHRS_ENKF=6
+++ config.base[333]: export lobsdiag_forenkf=.true.
+++ config.base[333]: lobsdiag_forenkf=.true.
+++ config.base[341]: export imp_physics=8
+++ config.base[341]: imp_physics=8
+++ config.base[345]: export DO_JEDIATMVAR=NO
+++ config.base[345]: DO_JEDIATMVAR=NO
+++ config.base[346]: export DO_JEDIATMENS=NO
+++ config.base[346]: DO_JEDIATMENS=NO
+++ config.base[347]: export DO_JEDIOCNVAR=NO
+++ config.base[347]: DO_JEDIOCNVAR=NO
+++ config.base[348]: export DO_JEDISNOWDA=NO
+++ config.base[348]: DO_JEDISNOWDA=NO
+++ config.base[349]: export DO_MERGENSST=NO
+++ config.base[349]: DO_MERGENSST=NO
+++ config.base[352]: export DOHYBVAR=NO
+++ config.base[352]: DOHYBVAR=NO
+++ config.base[353]: export NMEM_ENS=0
+++ config.base[353]: NMEM_ENS=0
+++ config.base[354]: export SMOOTH_ENKF=NO
+++ config.base[354]: SMOOTH_ENKF=NO
+++ config.base[355]: export l4densvar=.true.
+++ config.base[355]: l4densvar=.true.
+++ config.base[356]: export lwrite4danl=.true.
+++ config.base[356]: lwrite4danl=.true.
+++ config.base[357]: export DO_CALC_INCREMENT=NO
+++ config.base[357]: DO_CALC_INCREMENT=NO
+++ config.base[360]: export NMEM_ENS_GFS=30
+++ config.base[360]: NMEM_ENS_GFS=30
+++ config.base[361]: export NMEM_ENS_GFS_OFFSET=20
+++ config.base[361]: NMEM_ENS_GFS_OFFSET=20
+++ config.base[362]: export DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[362]: DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[365]: [[ NO = \Y\E\S ]]
+++ config.base[379]: [[ NO == \N\O ]]
+++ config.base[379]: [[ YES == \Y\E\S ]]
+++ config.base[380]: export IAUFHRS=6
+++ config.base[380]: IAUFHRS=6
+++ config.base[381]: export IAU_FHROT=3
+++ config.base[381]: IAU_FHROT=3
+++ config.base[382]: export IAU_FILTER_INCREMENTS=.true.
+++ config.base[382]: IAU_FILTER_INCREMENTS=.true.
+++ config.base[383]: export IAUFHRS_ENKF=6
+++ config.base[383]: IAUFHRS_ENKF=6
+++ config.base[387]: export ENKF_SPREAD=YES
+++ config.base[387]: ENKF_SPREAD=YES
+++ config.base[390]: [[ cycled = \c\y\c\l\e\d ]]
+++ config.base[390]: [[ 2021122018 = \2\0\2\1\1\2\2\1\1\8 ]]
+++ config.base[390]: [[ YES = \N\O ]]
+++ config.base[390]: [[ cycled = \f\o\r\e\c\a\s\t\-\o\n\l\y ]]
+++ config.base[396]: [[ YES = \N\O ]]
+++ config.base[400]: [[ YES == \Y\E\S ]]
+++ config.base[401]: export restart_interval_enkfgdas=3
+++ config.base[401]: restart_interval_enkfgdas=3
+++ config.base[406]: export restart_interval_enkfgfs=3
+++ config.base[406]: restart_interval_enkfgfs=3
+++ config.base[408]: [[ YES == \Y\E\S ]]
+++ config.base[409]: export restart_interval_gdas=3
+++ config.base[409]: restart_interval_gdas=3
+++ config.base[414]: export GSI_SOILANAL=NO
+++ config.base[414]: GSI_SOILANAL=NO
+++ config.base[417]: export DONST=YES
+++ config.base[417]: DONST=YES
+++ config.base[418]: [[ YES = \Y\E\S ]]
+++ config.base[418]: export 'FNTSFA= '
+++ config.base[418]: FNTSFA=' '
+++ config.base[421]: export nst_anl=.true.
+++ config.base[421]: nst_anl=.true.
+++ config.base[424]: export MAKE_NSSTBUFR=NO
+++ config.base[424]: MAKE_NSSTBUFR=NO
+++ config.base[427]: export MAKE_ACFTBUFR=NO
+++ config.base[427]: MAKE_ACFTBUFR=NO
+++ config.base[430]: export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[430]: INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[433]: export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[433]: INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[434]: export INCVARS_EFOLD=5
+++ config.base[434]: INCVARS_EFOLD=5
+++ config.base[439]: export netcdf_diag=.true.
+++ config.base[439]: netcdf_diag=.true.
+++ config.base[440]: export binary_diag=.false.
+++ config.base[440]: binary_diag=.false.
+++ config.base[443]: export DO_METP=NO
+++ config.base[443]: DO_METP=NO
+++ config.base[444]: export DO_FIT2OBS=YES
+++ config.base[444]: DO_FIT2OBS=YES
+++ config.base[445]: export DO_VRFY_OCEANDA=NO
+++ config.base[445]: DO_VRFY_OCEANDA=NO
+++ config.base[448]: export HPSSARCH=NO
+++ config.base[448]: HPSSARCH=NO
+++ config.base[449]: export LOCALARCH=NO
+++ config.base[449]: LOCALARCH=NO
+++ config.base[450]: [[ NO = \Y\E\S ]]
+++ config.base[454]: export ARCH_CYC=00
+++ config.base[454]: ARCH_CYC=00
+++ config.base[455]: export ARCH_WARMICFREQ=4
+++ config.base[455]: ARCH_WARMICFREQ=4
+++ config.base[456]: export ARCH_FCSTICFREQ=1
+++ config.base[456]: ARCH_FCSTICFREQ=1
+++ config.base[459]: export FITSARC=YES
+++ config.base[459]: FITSARC=YES
+++ config.base[460]: export FHMAX_FITS=132
+++ config.base[460]: FHMAX_FITS=132
+++ config.base[461]: [[ 132 -gt 384 ]]
+++ config.base[464]: [[ NO = \Y\E\S ]]
+++ config.base[471]: export NUM_SND_COLLECTIVES=9
+++ config.base[471]: NUM_SND_COLLECTIVES=9
+++ config.base[473]: echo 'END: config.base'
END: config.base
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0/config.postsnd
+++ config.postsnd[6]: echo 'BEGIN: config.postsnd'
BEGIN: config.postsnd
+++ config.postsnd[9]: . /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0/config.resources postsnd
++++ config.resources[7]: (( 1 != 1 ))
++++ config.resources[31]: step=postsnd
++++ config.resources[33]: echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[35]: case ${machine} in
++++ config.resources[36]: npe_node_max=128
++++ config.resources[72]: export npe_node_max
++++ config.resources[74]: case ${step} in
++++ config.resources[1106]: export wtime_postsnd=02:00:00
++++ config.resources[1106]: wtime_postsnd=02:00:00
++++ config.resources[1107]: export npe_postsnd=40
++++ config.resources[1107]: npe_postsnd=40
++++ config.resources[1108]: export nth_postsnd=8
++++ config.resources[1108]: nth_postsnd=8
++++ config.resources[1109]: export npe_node_postsnd=10
++++ config.resources[1109]: npe_node_postsnd=10
++++ config.resources[1110]: export npe_postsndcfp=9
++++ config.resources[1110]: npe_postsndcfp=9
++++ config.resources[1111]: export npe_node_postsndcfp=1
++++ config.resources[1111]: npe_node_postsndcfp=1
++++ config.resources[1112]: postsnd_req_cores=80
++++ config.resources[1113]: (( postsnd_req_cores > npe_node_max ))
++++ config.resources[1116]: export is_exclusive=True
++++ config.resources[1116]: is_exclusive=True
++++ config.resources[1300]: echo 'END: config.resources'
END: config.resources
+++ config.postsnd[11]: export ENDHOUR=180
+++ config.postsnd[11]: ENDHOUR=180
+++ config.postsnd[12]: [[ 384 -lt 180 ]]
+++ config.postsnd[14]: echo 'END: config.postsnd'
END: config.postsnd
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[110]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/env/WCOSS2.env postsnd
+++ WCOSS2.env[3]: [[ 1 -ne 1 ]]
+++ WCOSS2.env[15]: step=postsnd
+++ WCOSS2.env[18]: export 'launcher=mpiexec -l'
+++ WCOSS2.env[18]: launcher='mpiexec -l'
+++ WCOSS2.env[19]: export 'mpmd_opt=--cpu-bind verbose,core cfp'
+++ WCOSS2.env[19]: mpmd_opt='--cpu-bind verbose,core cfp'
+++ WCOSS2.env[21]: [[ postsnd = \p\r\e\p ]]
+++ WCOSS2.env[21]: [[ postsnd = \p\r\e\p\b\u\f\r ]]
+++ WCOSS2.env[30]: [[ postsnd = \p\r\e\p\s\n\o\w\o\b\s ]]
+++ WCOSS2.env[34]: [[ postsnd = \p\r\e\p\_\e\m\i\s\s\i\o\n\s ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\i\n\i\t ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\p\r\e\p ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\p\o\s\t\s\b\s ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\p\o\s\t\b\n\d\p\n\t ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\p\o\s\t\b\n\d\p\n\t\b\l\l ]]
+++ WCOSS2.env[38]: [[ postsnd = \w\a\v\e\p\o\s\t\p\n\t ]]
+++ WCOSS2.env[45]: [[ postsnd = \a\t\m\a\n\l\v\a\r ]]
+++ WCOSS2.env[53]: [[ postsnd = \a\t\m\e\n\s\a\n\l\l\e\t\k\f ]]
+++ WCOSS2.env[61]: [[ postsnd = \a\t\m\e\n\s\a\n\l\f\v\3\i\n\c ]]
+++ WCOSS2.env[69]: [[ postsnd = \a\e\r\o\a\n\l\r\u\n ]]
+++ WCOSS2.env[79]: [[ postsnd = \s\n\o\w\a\n\l ]]
+++ WCOSS2.env[89]: [[ postsnd = \a\t\m\a\n\l\f\v\3\i\n\c ]]
+++ WCOSS2.env[97]: [[ postsnd = \a\n\a\l ]]
+++ WCOSS2.env[97]: [[ postsnd = \a\n\a\l\c\a\l\c ]]
+++ WCOSS2.env[134]: [[ postsnd = \s\f\c\a\n\l ]]
+++ WCOSS2.env[143]: [[ postsnd = \e\o\b\s ]]
+++ WCOSS2.env[159]: [[ postsnd = \e\u\p\d ]]
+++ WCOSS2.env[176]: [[ postsnd = \f\c\s\t ]]
+++ WCOSS2.env[176]: [[ postsnd = \e\f\c\s ]]
+++ WCOSS2.env[203]: [[ postsnd = \u\p\p ]]
+++ WCOSS2.env[211]: [[ postsnd = \a\t\m\o\s\_\p\r\o\d\u\c\t\s ]]
+++ WCOSS2.env[215]: [[ postsnd = \o\c\e\a\n\i\c\e\_\p\r\o\d\u\c\t\s ]]
+++ WCOSS2.env[222]: [[ postsnd = \e\c\e\n ]]
+++ WCOSS2.env[242]: [[ postsnd = \e\s\f\c ]]
+++ WCOSS2.env[254]: [[ postsnd = \e\p\o\s ]]
+++ WCOSS2.env[262]: [[ postsnd = \p\o\s\t\s\n\d ]]
+++ WCOSS2.env[264]: export MPICH_MPIIO_HINTS_DISPLAY=1
+++ WCOSS2.env[264]: MPICH_MPIIO_HINTS_DISPLAY=1
+++ WCOSS2.env[265]: export OMP_NUM_THREADS=1
+++ WCOSS2.env[265]: OMP_NUM_THREADS=1
+++ WCOSS2.env[267]: nth_max=12
+++ WCOSS2.env[269]: export NTHREADS_POSTSND=8
+++ WCOSS2.env[269]: NTHREADS_POSTSND=8
+++ WCOSS2.env[270]: [[ 8 -gt 12 ]]
+++ WCOSS2.env[271]: export 'APRUN_POSTSND=mpiexec -l -n 40 --depth=8 --cpu-bind depth'
+++ WCOSS2.env[271]: APRUN_POSTSND='mpiexec -l -n 40 --depth=8 --cpu-bind depth'
+++ WCOSS2.env[273]: export NTHREADS_POSTSNDCFP=1
+++ WCOSS2.env[273]: NTHREADS_POSTSNDCFP=1
+++ WCOSS2.env[274]: [[ 1 -gt 12 ]]
+++ WCOSS2.env[275]: export 'APRUN_POSTSNDCFP=mpiexec -l -np 9 --cpu-bind verbose,core cfp'
+++ WCOSS2.env[275]: APRUN_POSTSNDCFP='mpiexec -l -np 9 --cpu-bind verbose,core cfp'
++ jjob_header.sh[111]: status=0
++ jjob_header.sh[112]: (( status != 0 ))
+ JGFS_ATMOS_POSTSND[10]: export CDUMP=gfs
+ JGFS_ATMOS_POSTSND[10]: CDUMP=gfs
+ JGFS_ATMOS_POSTSND[16]: export model=gfs
+ JGFS_ATMOS_POSTSND[16]: model=gfs
+ JGFS_ATMOS_POSTSND[17]: export SENDDBN=NO
+ JGFS_ATMOS_POSTSND[17]: SENDDBN=NO
+ JGFS_ATMOS_POSTSND[18]: export DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+ JGFS_ATMOS_POSTSND[18]: DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+ JGFS_ATMOS_POSTSND[23]: export DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+ JGFS_ATMOS_POSTSND[23]: DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.9/fakedbn
+ JGFS_ATMOS_POSTSND[25]: YMD=20211221
+ JGFS_ATMOS_POSTSND[25]: HH=18
+ JGFS_ATMOS_POSTSND[25]: declare_from_tmpl -rx COM_ATMOS_HISTORY COM_ATMOS_BUFR COM_ATMOS_WMO COM_ATMOS_GEMPAK
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COM_ATMOS_HISTORY=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//model_data/atmos/history
declare_from_tmpl :: COM_ATMOS_BUFR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/bufr
declare_from_tmpl :: COM_ATMOS_WMO=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/wmo
declare_from_tmpl :: COM_ATMOS_GEMPAK=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/gempak/
+ JGFS_ATMOS_POSTSND[28]: [[ ! -d /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/bufr ]]
+ JGFS_ATMOS_POSTSND[29]: [[ ! -d /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/gempak/ ]]
+ JGFS_ATMOS_POSTSND[30]: [[ ! -d /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/wmo ]]
+ JGFS_ATMOS_POSTSND[35]: /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/scripts/exgfs_atmos_postsnd.sh
Begin exgfs_atmos_postsnd.sh at Tue Jun 4 08:32:56 UTC 2024
+ exgfs_atmos_postsnd.sh[25]: cd /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0/postsnd.251098
+ exgfs_atmos_postsnd.sh[32]: export LEVS=128
+ exgfs_atmos_postsnd.sh[32]: LEVS=128
+ exgfs_atmos_postsnd.sh[33]: export STARTHOUR=00
+ exgfs_atmos_postsnd.sh[33]: STARTHOUR=00
+ exgfs_atmos_postsnd.sh[34]: export ENDHOUR=180
+ exgfs_atmos_postsnd.sh[34]: ENDHOUR=180
+ exgfs_atmos_postsnd.sh[35]: export INCREMENT=12
+ exgfs_atmos_postsnd.sh[35]: INCREMENT=12
+ exgfs_atmos_postsnd.sh[36]: export MAKEBUFR=NO
+ exgfs_atmos_postsnd.sh[36]: MAKEBUFR=NO
+ exgfs_atmos_postsnd.sh[37]: export F00FLAG=YES
+ exgfs_atmos_postsnd.sh[37]: F00FLAG=YES
+ exgfs_atmos_postsnd.sh[38]: export fformat=netcdf
+ exgfs_atmos_postsnd.sh[38]: fformat=netcdf
+ exgfs_atmos_postsnd.sh[39]: export atmfm=nc
+ exgfs_atmos_postsnd.sh[39]: atmfm=nc
+ exgfs_atmos_postsnd.sh[40]: export logfm=txt
+ exgfs_atmos_postsnd.sh[40]: logfm=txt
+ exgfs_atmos_postsnd.sh[41]: export NINT1=1
+ exgfs_atmos_postsnd.sh[41]: NINT1=1
+ exgfs_atmos_postsnd.sh[42]: export NEND1=0
+ exgfs_atmos_postsnd.sh[42]: NEND1=0
+ exgfs_atmos_postsnd.sh[43]: export NINT3=3
+ exgfs_atmos_postsnd.sh[43]: NINT3=3
+ exgfs_atmos_postsnd.sh[45]: rm -f -r /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/bufr
+ exgfs_atmos_postsnd.sh[46]: mkdir -p /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//products/atmos/bufr
+ exgfs_atmos_postsnd.sh[47]: GETDIM=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/getncdimlen
++ exgfs_atmos_postsnd.sh[48]: /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/getncdimlen /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//model_data/atmos/history/gfs.t18z.atmf000.nc pfull
Traceback (most recent call last):
File "/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/getncdimlen", line 16, in <module>
FileDims = gsi_utils.get_ncdims(args.ncfile)
File "/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/ush/gsi_utils.py", line 82, in get_ncdims
ncf = nc.Dataset(ncfile)
File "src/netCDF4/_netCDF4.pyx", line 2330, in netCDF4._netCDF4.Dataset.__init__
File "src/netCDF4/_netCDF4.pyx", line 1948, in netCDF4._netCDF4._ensure_nc_success
FileNotFoundError: [Errno 2] No such file or directory: b'/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/gfs.20211221/18//model_data/atmos/history/gfs.t18z.atmf000.nc'
+ exgfs_atmos_postsnd.sh[48]: LEVS=
+ exgfs_atmos_postsnd.sh[1]: postamble exgfs_atmos_postsnd.sh 1717489976 1
+ preamble.sh[70]: set +x
End exgfs_atmos_postsnd.sh at 08:32:57 with error code 1 (time elapsed: 00:00:01)
+ JGFS_ATMOS_POSTSND[1]: postamble JGFS_ATMOS_POSTSND 1717489973 1
+ preamble.sh[70]: set +x
End JGFS_ATMOS_POSTSND at 08:32:57 with error code 1 (time elapsed: 00:00:04)
+ postsnd.sh[1]: postamble postsnd.sh 1717489972 1
+ preamble.sh[70]: set +x
End postsnd.sh at 08:32:57 with error code 1 (time elapsed: 00:00:05)
PBS: Running epilogue on parent mom node: nid003585...
##### Job 134208616.cbqs01 - PBS Job Script:
(Note: Duplicate #PBS entries are a function how PBS interprets and caches the original job script.)
#! /bin/sh
#PBS -N C96_atm3DVar_extended_547c5de0_gfspostsnd_18
#PBS -A GFS-DEV
#PBS -q dev
#PBS -l walltime=02:00:00
#PBS -l select=4:mpiprocs=10:ompthreads=8:ncpus=80
#PBS -j oe -o /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT/C96_atm3DVar_extended_547c5de0/logs/2021122118/gfspostsnd.log
#PBS -l place=vscatter:exclhost
export RUN_ENVIR='emc'
export HOMEgfs='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow'
export EXPDIR='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/EXPDIR/C96_atm3DVar_extended_547c5de0'
export NET='gfs'
export CDUMP='gfs'
export RUN='gfs'
export CDATE='2021122118'
export PDY='20211221'
export cyc='18'
export COMROOT='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/RUNTESTS/COMROOT'
export DATAROOT='/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96_atm3DVar_extended_547c5de0'
set -x
/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2644/global-workflow/jobs/rocoto/postsnd.sh
##### End of job script
------------------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment