Skip to content

Instantly share code, notes, and snippets.

@emcbot

emcbot/enkfgdasatmensanlfv3inc.log

Created June 23, 2024 08:12
Show Gist options
  • Save emcbot/5f0653f03d3685c50a0cb461b0b335cb to your computer and use it in GitHub Desktop.
Save emcbot/5f0653f03d3685c50a0cb461b0b335cb to your computer and use it in GitHub Desktop.
Download ZIP
error log file from CI run PR_2672
Raw
enkfgdasatmensanlfv3inc.log
PBS: Running prologue on parent mom node: nid001295...
Job 153612767.dbqs01 nodelist: nid001295
+ /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/jobs/rocoto/atmensanlfv3inc.sh
Begin atmensanlfv3inc.sh at Sun Jun 23 08:05:32 UTC 2024
+ atmensanlfv3inc.sh[7]: . /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/load_ufsda_modules.sh
++ load_ufsda_modules.sh[4]: [[ NO == \N\O ]]
++ load_ufsda_modules.sh[5]: echo 'Loading modules quietly...'
Loading modules quietly...
++ load_ufsda_modules.sh[6]: set +x
Resetting modules to system default. Reseting $MODULEPATH back to system default. All extra directories will be removed from $MODULEPATH.
Currently Loaded Modules:
1) craype-x86-rome (H) 11) cray-mpich/8.1.12 21) qhull/2020.2
2) libfabric/1.11.0.0. (H) 12) hdf5/1.10.6 22) eckit/1.24.4
3) craype-network-ofi (H) 13) netcdf/4.7.4 23) fckit/0.11.0
4) envvar/1.0 14) udunits/2.2.28 24) atlas/0.35.0
5) PrgEnv-intel/8.2.0 15) eigen/3.4.0 25) nccmp/1.8.9.0
6) cmake/3.20.2 16) boost/1.79.0 26) nco/5.0.6
7) craype/2.7.17 17) gsl-lite/v0.40.0 27) gsl/2.7
8) cray-pals/1.2.2 18) sp/2.4.0 28) prod_util/2.0.14
9) git/2.29.0 19) python/3.8.6 29) bufr/12.0.1
10) intel/19.1.3.304 20) ecbuild/3.7.0 30) GDAS/wcoss2.intel
Where:
H: Hidden Module
Package Version
------------------- ---------
appdirs 1.4.4
astropy 4.2
atomicwrites 1.4.0
attrs 20.3.0
boto3 1.24.22
botocore 1.27.53
Cartopy 0.18.0
certifi 2020.12.5
cftime 1.4.1
charset-normalizer 2.1.1
cycler 0.10.0
Cython 0.29.22
dicttoxml 1.7.4
ESMPy 8.0.0
f90nml 1.4.3
flake8 3.9.1
geographiclib 1.50
geopy 2.1.0
gsw 3.4.0
h5py 3.7.0
idna 3.4
importlib-resources 5.10.0
iniconfig 1.1.1
iso8601 0.1.14
Jinja2 3.1.2
jmespath 1.0.1
joblib 1.0.1
kiwisolver 1.3.1
MarkupSafe 2.1.1
matplotlib 3.3.4
mccabe 0.6.1
MetPy 1.3.1
more-itertools 8.7.0
mpi4py 3.1.0
netCDF4 1.5.6
numpy 1.20.1
packaging 20.9
pandas 1.2.3
Pillow 8.1.2
Pint 0.20.1
pip 22.2.2
pipenv 2022.10.4
pluggy 0.13.1
pooch 1.6.0
py 1.10.0
pybind11 2.9.2
pycodestyle 2.7.0
pyerfa 1.7.2
pyflakes 2.3.1
pygrib 2.0.4
pyparsing 2.4.7
pyproj 3.0.1
pyshp 2.1.3
pytest 6.2.2
python-dateutil 2.8.2
pytz 2021.1
PyYAML 5.4.1
requests 2.28.1
s3transfer 0.6.0
scikit-learn 0.24.1
scipy 1.6.2
setuptools 54.2.0
Shapely 1.7.1
six 1.16.0
termcolor 1.1.0
threadpoolctl 2.1.0
toml 0.10.2
toolz 0.11.2
traitlets 5.5.0
urllib3 1.26.11
virtualenv 16.1.0
virtualenv-clone 0.5.7
wheel 0.36.2
xarray 0.17.0
xmltodict 0.12.0
zipp 3.10.0
WARNING: There was an error checking the latest version of pip.
+ atmensanlfv3inc.sh[8]: status=0
+ atmensanlfv3inc.sh[9]: [[ 0 -ne 0 ]]
+ atmensanlfv3inc.sh[11]: export job=atmensanlfv3inc
+ atmensanlfv3inc.sh[11]: job=atmensanlfv3inc
+ atmensanlfv3inc.sh[12]: export jobid=atmensanlfv3inc.89204
+ atmensanlfv3inc.sh[12]: jobid=atmensanlfv3inc.89204
+ atmensanlfv3inc.sh[16]: wxflowPATH=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/python:/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/python/wxflow/src
+ atmensanlfv3inc.sh[17]: PYTHONPATH=/apps/ops/prod/nco/core/prod_util.v2.0.14/ush:/apps/prod/python-modules/3.8.6/intel/19.1.3.304/lib/python3.8/site-packages:/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/python:/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/python/wxflow/src
+ atmensanlfv3inc.sh[18]: export PYTHONPATH
+ atmensanlfv3inc.sh[22]: /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/jobs/JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT
Begin JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT at Sun Jun 23 08:05:56 UTC 2024
+ JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT[4]: export WIPE_DATA=NO
+ JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT[4]: WIPE_DATA=NO
+ JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT[5]: export DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
+ JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT[5]: DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
+ JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT[6]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/jjob_header.sh -e atmensanlfv3inc -c 'base atmensanl atmensanlfv3inc'
++ jjob_header.sh[44]: OPTIND=1
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[48]: env_job=atmensanlfv3inc
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[47]: read -ra configs
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[59]: shift 4
++ jjob_header.sh[61]: [[ -z atmensanlfv3inc ]]
++ jjob_header.sh[69]: export DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
++ jjob_header.sh[69]: DATA=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
++ jjob_header.sh[70]: [[ NO == \Y\E\S ]]
++ jjob_header.sh[73]: mkdir -p /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
++ jjob_header.sh[74]: cd /lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525/enkfgdasatmensanl_00
++ jjob_header.sh[80]: export cycle=t00z
++ jjob_header.sh[80]: cycle=t00z
++ jjob_header.sh[81]: setpdy.sh
completed cleanly
completed cleanly
Source PDY script to export PDYm7, ..., PDY, ..., PDYp7 variables.
++ jjob_header.sh[82]: source ./PDY
+++ PDY[1]: export PDYm7=20240217
+++ PDY[1]: PDYm7=20240217
+++ PDY[2]: export PDYm6=20240218
+++ PDY[2]: PDYm6=20240218
+++ PDY[3]: export PDYm5=20240219
+++ PDY[3]: PDYm5=20240219
+++ PDY[4]: export PDYm4=20240220
+++ PDY[4]: PDYm4=20240220
+++ PDY[5]: export PDYm3=20240221
+++ PDY[5]: PDYm3=20240221
+++ PDY[6]: export PDYm2=20240222
+++ PDY[6]: PDYm2=20240222
+++ PDY[7]: export PDYm1=20240223
+++ PDY[7]: PDYm1=20240223
+++ PDY[8]: export PDY=20240224
+++ PDY[8]: PDY=20240224
+++ PDY[9]: export PDYp1=20240225
+++ PDY[9]: PDYp1=20240225
+++ PDY[10]: export PDYp2=20240226
+++ PDY[10]: PDYp2=20240226
+++ PDY[11]: export PDYp3=20240227
+++ PDY[11]: PDYp3=20240227
+++ PDY[12]: export PDYp4=20240228
+++ PDY[12]: PDYp4=20240228
+++ PDY[13]: export PDYp5=20240229
+++ PDY[13]: PDYp5=20240229
+++ PDY[14]: export PDYp6=20240301
+++ PDY[14]: PDYp6=20240301
+++ PDY[15]: export PDYp7=20240302
+++ PDY[15]: PDYp7=20240302
++ jjob_header.sh[88]: export pid=89601
++ jjob_header.sh[88]: pid=89601
++ jjob_header.sh[89]: export pgmout=OUTPUT.89601
++ jjob_header.sh[89]: pgmout=OUTPUT.89601
++ jjob_header.sh[90]: export pgmerr=errfile
++ jjob_header.sh[90]: pgmerr=errfile
++ jjob_header.sh[96]: export EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525
++ jjob_header.sh[96]: EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.base
+++ config.base[6]: echo 'BEGIN: config.base'
BEGIN: config.base
+++ config.base[9]: export machine=WCOSS2
+++ config.base[9]: machine=WCOSS2
+++ config.base[12]: export RUN_ENVIR=emc
+++ config.base[12]: RUN_ENVIR=emc
+++ config.base[15]: export ACCOUNT=GFS-DEV
+++ config.base[15]: ACCOUNT=GFS-DEV
+++ config.base[16]: export ACCOUNT_SERVICE=GFS-DEV
+++ config.base[16]: ACCOUNT_SERVICE=GFS-DEV
+++ config.base[17]: export QUEUE=dev
+++ config.base[17]: QUEUE=dev
+++ config.base[18]: export QUEUE_SERVICE=dev_transfer
+++ config.base[18]: QUEUE_SERVICE=dev_transfer
+++ config.base[19]: export PARTITION_BATCH=
+++ config.base[19]: PARTITION_BATCH=
+++ config.base[20]: export PARTITION_SERVICE=
+++ config.base[20]: PARTITION_SERVICE=
+++ config.base[21]: export RESERVATION=
+++ config.base[21]: RESERVATION=
+++ config.base[24]: export HPSS_PROJECT=emc-global
+++ config.base[24]: HPSS_PROJECT=emc-global
+++ config.base[27]: export HOMEgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow
+++ config.base[27]: HOMEgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow
+++ config.base[28]: export EXECgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec
+++ config.base[28]: EXECgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec
+++ config.base[29]: export FIXgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix
+++ config.base[29]: FIXgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix
+++ config.base[30]: export PARMgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm
+++ config.base[30]: PARMgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm
+++ config.base[31]: export SCRgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/scripts
+++ config.base[31]: SCRgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/scripts
+++ config.base[32]: export USHgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush
+++ config.base[32]: USHgfs=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush
+++ config.base[34]: export FIXam=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/am
+++ config.base[34]: FIXam=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/am
+++ config.base[35]: export FIXaer=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/aer
+++ config.base[35]: FIXaer=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/aer
+++ config.base[36]: export FIXcpl=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/cpl
+++ config.base[36]: FIXcpl=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/cpl
+++ config.base[37]: export FIXlut=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/lut
+++ config.base[37]: FIXlut=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/lut
+++ config.base[38]: export FIXcice=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/cice
+++ config.base[38]: FIXcice=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/cice
+++ config.base[39]: export FIXmom=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/mom6
+++ config.base[39]: FIXmom=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/mom6
+++ config.base[40]: export FIXreg2grb2=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/reg2grb2
+++ config.base[40]: FIXreg2grb2=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/reg2grb2
+++ config.base[41]: export FIXgdas=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/gdas
+++ config.base[41]: FIXgdas=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/gdas
+++ config.base[46]: export PACKAGEROOT=/lfs/h1/ops/prod/packages
+++ config.base[46]: PACKAGEROOT=/lfs/h1/ops/prod/packages
+++ config.base[47]: export COMROOT=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT
+++ config.base[47]: COMROOT=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT
+++ config.base[48]: export COMINsyn=/lfs/h1/ops/prod/com/gfs/v16.3/syndat
+++ config.base[48]: COMINsyn=/lfs/h1/ops/prod/com/gfs/v16.3/syndat
+++ config.base[49]: export DMPDIR=/lfs/h2/emc/dump/noscrub/dump
+++ config.base[49]: DMPDIR=/lfs/h2/emc/dump/noscrub/dump
+++ config.base[50]: export BASE_CPLIC=/lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/prototype_ICs
+++ config.base[50]: BASE_CPLIC=/lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/prototype_ICs
+++ config.base[54]: export COMINecmwf=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ecmwf
+++ config.base[54]: COMINecmwf=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ecmwf
+++ config.base[55]: export COMINnam=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/nam
+++ config.base[55]: COMINnam=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/nam
+++ config.base[56]: export COMINukmet=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ukmet
+++ config.base[56]: COMINukmet=/lfs/h2/emc/global/noscrub/emc.global/data/external_gempak/ukmet
+++ config.base[59]: export HOMEDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[59]: HOMEDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[60]: export STMP=/lfs/h2/emc/stmp/terry.mcguinness
+++ config.base[60]: STMP=/lfs/h2/emc/stmp/terry.mcguinness
+++ config.base[61]: export PTMP=/lfs/h2/emc/ptmp/terry.mcguinness
+++ config.base[61]: PTMP=/lfs/h2/emc/ptmp/terry.mcguinness
+++ config.base[62]: export NOSCRUB=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[62]: NOSCRUB=/lfs/h2/emc/global/noscrub/terry.mcguinness
+++ config.base[65]: export BASE_GIT=/lfs/h2/emc/global/save/emc.global/git
+++ config.base[65]: BASE_GIT=/lfs/h2/emc/global/save/emc.global/git
+++ config.base[68]: export DO_GOES=NO
+++ config.base[68]: DO_GOES=NO
+++ config.base[69]: export DO_BUFRSND=NO
+++ config.base[69]: DO_BUFRSND=NO
+++ config.base[70]: export DO_GEMPAK=NO
+++ config.base[70]: DO_GEMPAK=NO
+++ config.base[71]: export DO_AWIPS=NO
+++ config.base[71]: DO_AWIPS=NO
+++ config.base[72]: export DO_NPOESS=NO
+++ config.base[72]: DO_NPOESS=NO
+++ config.base[73]: export DO_TRACKER=YES
+++ config.base[73]: DO_TRACKER=YES
+++ config.base[74]: export DO_GENESIS=YES
+++ config.base[74]: DO_GENESIS=YES
+++ config.base[75]: export DO_GENESIS_FSU=NO
+++ config.base[75]: DO_GENESIS_FSU=NO
+++ config.base[76]: export DO_VERFOZN=YES
+++ config.base[76]: DO_VERFOZN=YES
+++ config.base[77]: export DO_VERFRAD=YES
+++ config.base[77]: DO_VERFRAD=YES
+++ config.base[78]: export DO_VMINMON=YES
+++ config.base[78]: DO_VMINMON=YES
+++ config.base[79]: export DO_MOS=NO
+++ config.base[79]: DO_MOS=NO
+++ config.base[85]: export REALTIME=YES
+++ config.base[85]: REALTIME=YES
+++ config.base[88]: export MODE=cycled
+++ config.base[88]: MODE=cycled
+++ config.base[97]: export FIXgsi=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/gsi
+++ config.base[97]: FIXgsi=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/gsi
+++ config.base[98]: export HOMEpost=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow
+++ config.base[98]: HOMEpost=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow
+++ config.base[99]: export HOMEobsproc=/lfs/h2/emc/global/save/emc.global/git/obsproc/v1.1.2
+++ config.base[99]: HOMEobsproc=/lfs/h2/emc/global/save/emc.global/git/obsproc/v1.1.2
+++ config.base[102]: export 'NCP=/bin/cp -p'
+++ config.base[102]: NCP='/bin/cp -p'
+++ config.base[103]: export NMV=/bin/mv
+++ config.base[103]: NMV=/bin/mv
+++ config.base[104]: export 'NLN=/bin/ln -sf'
+++ config.base[104]: NLN='/bin/ln -sf'
+++ config.base[105]: export VERBOSE=YES
+++ config.base[105]: VERBOSE=YES
+++ config.base[106]: export KEEPDATA=NO
+++ config.base[106]: KEEPDATA=NO
+++ config.base[107]: export DEBUG_POSTSCRIPT=NO
+++ config.base[107]: DEBUG_POSTSCRIPT=NO
+++ config.base[108]: export CHGRP_RSTPROD=YES
+++ config.base[108]: CHGRP_RSTPROD=YES
+++ config.base[109]: export 'CHGRP_CMD=chgrp rstprod'
+++ config.base[109]: CHGRP_CMD='chgrp rstprod'
+++ config.base[110]: export NCDUMP=/apps/prod/hpc-stack/intel-19.1.3.304/cray-mpich-8.1.4/netcdf/4.7.4/bin/ncdump/bin/ncdump
+++ config.base[110]: NCDUMP=/apps/prod/hpc-stack/intel-19.1.3.304/cray-mpich-8.1.4/netcdf/4.7.4/bin/ncdump/bin/ncdump
+++ config.base[111]: export NCLEN=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/getncdimlen
+++ config.base[111]: NCLEN=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/ush/getncdimlen
+++ config.base[114]: export BASE_ENV=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/env
+++ config.base[114]: BASE_ENV=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/env
+++ config.base[115]: export BASE_JOB=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/jobs/rocoto
+++ config.base[115]: BASE_JOB=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/jobs/rocoto
+++ config.base[118]: export SDATE=2024022318
+++ config.base[118]: SDATE=2024022318
+++ config.base[119]: export EDATE=2024022400
+++ config.base[119]: EDATE=2024022400
+++ config.base[120]: export EXP_WARM_START=.true.
+++ config.base[120]: EXP_WARM_START=.true.
+++ config.base[121]: export assim_freq=6
+++ config.base[121]: assim_freq=6
+++ config.base[122]: export PSLOT=C96C48_ufs_hybatmDA_cb03a525
+++ config.base[122]: PSLOT=C96C48_ufs_hybatmDA_cb03a525
+++ config.base[123]: export EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[123]: EXPDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[124]: export ROTDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[124]: ROTDIR=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[125]: export ROTDIR_DUMP=YES
+++ config.base[125]: ROTDIR_DUMP=YES
+++ config.base[126]: export DUMP_SUFFIX=
+++ config.base[126]: DUMP_SUFFIX=
+++ config.base[127]: [[ 2024022400 -ge 2019092100 ]]
+++ config.base[127]: [[ 2024022400 -le 2019110700 ]]
+++ config.base[130]: export DATAROOT=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[130]: DATAROOT=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[131]: export RUNDIR=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[131]: RUNDIR=/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[132]: export ARCDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness/archive/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[132]: ARCDIR=/lfs/h2/emc/global/noscrub/terry.mcguinness/archive/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[133]: export ATARDIR=/NCEPDEV/emc-global/1year/terry.mcguinness/WCOSS2/scratch/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[133]: ATARDIR=/NCEPDEV/emc-global/1year/terry.mcguinness/WCOSS2/scratch/C96C48_ufs_hybatmDA_cb03a525
+++ config.base[136]: export envir=prod
+++ config.base[136]: envir=prod
+++ config.base[137]: export NET=gfs
+++ config.base[137]: NET=gfs
+++ config.base[138]: export RUN=enkfgdas
+++ config.base[138]: RUN=enkfgdas
+++ config.base[144]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.com
++++ config.com[4]: echo 'BEGIN: config.com'
BEGIN: config.com
++++ config.com[37]: [[ emc == \n\c\o ]]
++++ config.com[41]: COM_OBS_TMPL='${ROTDIR}/${RUN}.${YMD}/${HH}/obs'
++++ config.com[42]: COM_RTOFS_TMPL='${DMPDIR}'
++++ config.com[44]: declare -rx COM_OBS_TMPL COM_RTOFS_TMPL
++++ config.com[45]: declare -rx 'COM_OBSDMP_TMPL=${DMPDIR}/${DUMP}${DUMP_SUFFIX}.${YMD}/${HH}/atmos'
++++ config.com[47]: COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}'
++++ config.com[49]: declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}'
++++ config.com[51]: declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf'
++++ config.com[52]: declare -rx 'COM_OBS_JEDI=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/obs_jedi'
++++ config.com[54]: declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/input'
++++ config.com[55]: declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/restart'
++++ config.com[56]: declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos'
++++ config.com[57]: declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow'
++++ config.com[58]: declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/history'
++++ config.com[59]: declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/master'
++++ config.com[60]: declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2'
++++ config.com[61]: declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}'
++++ config.com[62]: declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr'
++++ config.com[63]: declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}'
++++ config.com[64]: declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital'
++++ config.com[65]: declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks'
++++ config.com[66]: declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim'
++++ config.com[67]: declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery'
++++ config.com[68]: declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon'
++++ config.com[69]: declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon'
++++ config.com[70]: declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon'
++++ config.com[71]: declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo'
++++ config.com[73]: declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/restart'
++++ config.com[74]: declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/prep'
++++ config.com[75]: declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/history'
++++ config.com[76]: declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded'
++++ config.com[77]: declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station'
++++ config.com[78]: declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak'
++++ config.com[79]: declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo'
++++ config.com[81]: declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/history'
++++ config.com[82]: declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/restart'
++++ config.com[83]: declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/input'
++++ config.com[84]: declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean'
++++ config.com[85]: declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf'
++++ config.com[86]: declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2'
++++ config.com[87]: declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}'
++++ config.com[89]: declare -rx 'COM_ICE_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice'
++++ config.com[90]: declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/input'
++++ config.com[91]: declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/history'
++++ config.com[92]: declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/restart'
++++ config.com[93]: declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf'
++++ config.com[94]: declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2'
++++ config.com[95]: declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}'
++++ config.com[97]: declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/chem/history'
++++ config.com[98]: declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem'
++++ config.com[100]: declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/med/restart'
+++ config.base[147]: export 'ERRSCRIPT=eval [[ $err = 0 ]]'
+++ config.base[147]: ERRSCRIPT='eval [[ $err = 0 ]]'
+++ config.base[148]: export LOGSCRIPT=
+++ config.base[148]: LOGSCRIPT=
+++ config.base[151]: export 'REDOUT=1>'
+++ config.base[151]: REDOUT='1>'
+++ config.base[152]: export 'REDERR=2>'
+++ config.base[152]: REDERR='2>'
+++ config.base[154]: export SENDECF=NO
+++ config.base[154]: SENDECF=NO
+++ config.base[155]: export SENDSDM=NO
+++ config.base[155]: SENDSDM=NO
+++ config.base[156]: export SENDDBN_NTC=NO
+++ config.base[156]: SENDDBN_NTC=NO
+++ config.base[157]: export SENDDBN=NO
+++ config.base[157]: SENDDBN=NO
+++ config.base[158]: export DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.14/fakedbn
+++ config.base[158]: DBNROOT=/apps/ops/prod/nco/core/prod_util.v2.0.14/fakedbn
+++ config.base[161]: export APP=ATM
+++ config.base[161]: APP=ATM
+++ config.base[163]: shopt -s extglob
+++ config.base[165]: case "${RUN}" in
+++ config.base[167]: APP=ATM
+++ config.base[172]: shopt -u extglob
+++ config.base[175]: export DO_ATM=YES
+++ config.base[175]: DO_ATM=YES
+++ config.base[176]: export DO_COUPLED=NO
+++ config.base[176]: DO_COUPLED=NO
+++ config.base[177]: export DO_WAVE=NO
+++ config.base[177]: DO_WAVE=NO
+++ config.base[178]: export DO_OCN=NO
+++ config.base[178]: DO_OCN=NO
+++ config.base[179]: export DO_ICE=NO
+++ config.base[179]: DO_ICE=NO
+++ config.base[180]: export DO_AERO=NO
+++ config.base[180]: DO_AERO=NO
+++ config.base[181]: export DO_PREP_OBS_AERO=NO
+++ config.base[181]: DO_PREP_OBS_AERO=NO
+++ config.base[182]: export AERO_FCST_CDUMP=
+++ config.base[182]: AERO_FCST_CDUMP=
+++ config.base[183]: export AERO_ANL_CDUMP=
+++ config.base[183]: AERO_ANL_CDUMP=
+++ config.base[184]: export WAVE_CDUMP=
+++ config.base[184]: WAVE_CDUMP=
+++ config.base[185]: export DOBNDPNT_WAVE=NO
+++ config.base[185]: DOBNDPNT_WAVE=NO
+++ config.base[186]: export DOIBP_WAV=NO
+++ config.base[186]: DOIBP_WAV=NO
+++ config.base[187]: export FRAC_GRID=.true.
+++ config.base[187]: FRAC_GRID=.true.
+++ config.base[188]: export DO_NEST=NO
+++ config.base[188]: DO_NEST=NO
+++ config.base[189]: [[ NO == \Y\E\S ]]
+++ config.base[195]: export ntiles=6
+++ config.base[195]: ntiles=6
+++ config.base[196]: export FIXugwd=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/ugwd
+++ config.base[196]: FIXugwd=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/ugwd
+++ config.base[197]: export FIXorog=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/orog
+++ config.base[197]: FIXorog=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/fix/orog
+++ config.base[201]: export OPS_RES=C768
+++ config.base[201]: OPS_RES=C768
+++ config.base[204]: export LEVS=128
+++ config.base[204]: LEVS=128
+++ config.base[205]: export CASE=C96
+++ config.base[205]: CASE=C96
+++ config.base[206]: export CASE_ENS=C48
+++ config.base[206]: CASE_ENS=C48
+++ config.base[207]: export OCNRES=500
+++ config.base[207]: OCNRES=500
+++ config.base[208]: export ICERES=500
+++ config.base[208]: ICERES=500
+++ config.base[211]: case "${CASE}" in
+++ config.base[216]: export waveGRD=uglo_100km
+++ config.base[216]: waveGRD=uglo_100km
+++ config.base[230]: case "${APP}" in
+++ config.base[271]: [[ enkfgdas =~ gdas ]]
+++ config.base[272]: export FHCYC=1
+++ config.base[272]: FHCYC=1
+++ config.base[273]: export FTSFS=10
+++ config.base[273]: FTSFS=10
+++ config.base[279]: export FHMIN=0
+++ config.base[279]: FHMIN=0
+++ config.base[280]: export FHMAX=9
+++ config.base[280]: FHMAX=9
+++ config.base[281]: export FHOUT=3
+++ config.base[281]: FHOUT=3
+++ config.base[282]: export FHOUT_OCN=3
+++ config.base[282]: FHOUT_OCN=3
+++ config.base[283]: export FHOUT_ICE=3
+++ config.base[283]: FHOUT_ICE=3
+++ config.base[286]: export EUPD_CYC=gdas
+++ config.base[286]: EUPD_CYC=gdas
+++ config.base[289]: export gfs_cyc=1
+++ config.base[289]: gfs_cyc=1
+++ config.base[292]: export FHMIN_GFS=0
+++ config.base[292]: FHMIN_GFS=0
+++ config.base[293]: export FHMAX_GFS=120
+++ config.base[293]: FHMAX_GFS=120
+++ config.base[294]: export FHOUT_GFS=3
+++ config.base[294]: FHOUT_GFS=3
+++ config.base[295]: export FHMAX_HF_GFS=0
+++ config.base[295]: FHMAX_HF_GFS=0
+++ config.base[296]: export FHOUT_HF_GFS=1
+++ config.base[296]: FHOUT_HF_GFS=1
+++ config.base[297]: export FHOUT_OCN_GFS=6
+++ config.base[297]: FHOUT_OCN_GFS=6
+++ config.base[298]: export FHOUT_ICE_GFS=6
+++ config.base[298]: FHOUT_ICE_GFS=6
+++ config.base[299]: export FHMIN_WAV=0
+++ config.base[299]: FHMIN_WAV=0
+++ config.base[300]: export FHOUT_WAV=3
+++ config.base[300]: FHOUT_WAV=3
+++ config.base[301]: export FHMAX_HF_WAV=120
+++ config.base[301]: FHMAX_HF_WAV=120
+++ config.base[302]: export FHOUT_HF_WAV=1
+++ config.base[302]: FHOUT_HF_WAV=1
+++ config.base[303]: export FHMAX_WAV=9
+++ config.base[303]: FHMAX_WAV=9
+++ config.base[304]: export FHMAX_WAV_GFS=120
+++ config.base[304]: FHMAX_WAV_GFS=120
+++ config.base[305]: (( gfs_cyc != 0 ))
+++ config.base[306]: export STEP_GFS=24
+++ config.base[306]: STEP_GFS=24
+++ config.base[311]: export ILPOST=1
+++ config.base[311]: ILPOST=1
+++ config.base[312]: (( FHMAX_HF_GFS < 120 ))
+++ config.base[313]: export ILPOST=3
+++ config.base[313]: ILPOST=3
+++ config.base[317]: export restart_interval_gfs=12
+++ config.base[317]: restart_interval_gfs=12
+++ config.base[322]: export QUILTING=.true.
+++ config.base[322]: QUILTING=.true.
+++ config.base[323]: export OUTPUT_GRID=gaussian_grid
+++ config.base[323]: OUTPUT_GRID=gaussian_grid
+++ config.base[324]: export WRITE_DOPOST=.true.
+++ config.base[324]: WRITE_DOPOST=.true.
+++ config.base[325]: export WRITE_NSFLIP=.true.
+++ config.base[325]: WRITE_NSFLIP=.true.
+++ config.base[328]: export DOIAU=NO
+++ config.base[328]: DOIAU=NO
+++ config.base[329]: export IAUFHRS=3,6,9
+++ config.base[329]: IAUFHRS=3,6,9
+++ config.base[330]: export IAU_FHROT=3
+++ config.base[330]: IAU_FHROT=3
+++ config.base[331]: export IAU_DELTHRS=6
+++ config.base[331]: IAU_DELTHRS=6
+++ config.base[332]: export IAU_OFFSET=6
+++ config.base[332]: IAU_OFFSET=6
+++ config.base[333]: export DOIAU_ENKF=NO
+++ config.base[333]: DOIAU_ENKF=NO
+++ config.base[334]: export IAUFHRS_ENKF=3,6,9
+++ config.base[334]: IAUFHRS_ENKF=3,6,9
+++ config.base[335]: export IAU_DELTHRS_ENKF=6
+++ config.base[335]: IAU_DELTHRS_ENKF=6
+++ config.base[338]: export lobsdiag_forenkf=.true.
+++ config.base[338]: lobsdiag_forenkf=.true.
+++ config.base[346]: export imp_physics=8
+++ config.base[346]: imp_physics=8
+++ config.base[350]: export DO_JEDIATMVAR=YES
+++ config.base[350]: DO_JEDIATMVAR=YES
+++ config.base[351]: export DO_JEDIATMENS=YES
+++ config.base[351]: DO_JEDIATMENS=YES
+++ config.base[352]: export DO_JEDIOCNVAR=NO
+++ config.base[352]: DO_JEDIOCNVAR=NO
+++ config.base[353]: export DO_JEDISNOWDA=NO
+++ config.base[353]: DO_JEDISNOWDA=NO
+++ config.base[354]: export DO_MERGENSST=NO
+++ config.base[354]: DO_MERGENSST=NO
+++ config.base[357]: export DOHYBVAR=YES
+++ config.base[357]: DOHYBVAR=YES
+++ config.base[358]: export NMEM_ENS=2
+++ config.base[358]: NMEM_ENS=2
+++ config.base[359]: export SMOOTH_ENKF=NO
+++ config.base[359]: SMOOTH_ENKF=NO
+++ config.base[360]: export l4densvar=.true.
+++ config.base[360]: l4densvar=.true.
+++ config.base[361]: export lwrite4danl=.true.
+++ config.base[361]: lwrite4danl=.true.
+++ config.base[362]: export DO_CALC_INCREMENT=NO
+++ config.base[362]: DO_CALC_INCREMENT=NO
+++ config.base[365]: export NMEM_ENS_GFS=30
+++ config.base[365]: NMEM_ENS_GFS=30
+++ config.base[366]: export NMEM_ENS_GFS_OFFSET=20
+++ config.base[366]: NMEM_ENS_GFS_OFFSET=20
+++ config.base[367]: export DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[367]: DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[370]: [[ YES = \Y\E\S ]]
+++ config.base[371]: export FHMIN_ENKF=3
+++ config.base[371]: FHMIN_ENKF=3
+++ config.base[372]: export FHMAX_ENKF=9
+++ config.base[372]: FHMAX_ENKF=9
+++ config.base[373]: export FHMAX_ENKF_GFS=12
+++ config.base[373]: FHMAX_ENKF_GFS=12
+++ config.base[374]: export FHOUT_ENKF_GFS=3
+++ config.base[374]: FHOUT_ENKF_GFS=3
+++ config.base[375]: [[ .true. = \.\t\r\u\e\. ]]
+++ config.base[376]: export FHOUT=1
+++ config.base[376]: FHOUT=1
+++ config.base[377]: export FHOUT_ENKF=1
+++ config.base[377]: FHOUT_ENKF=1
+++ config.base[384]: [[ YES == \N\O ]]
+++ config.base[392]: export ENKF_SPREAD=YES
+++ config.base[392]: ENKF_SPREAD=YES
+++ config.base[395]: [[ cycled = \c\y\c\l\e\d ]]
+++ config.base[395]: [[ 2024022318 = \2\0\2\4\0\2\2\4\0\0 ]]
+++ config.base[395]: [[ NO = \N\O ]]
+++ config.base[396]: export IAU_OFFSET=0
+++ config.base[396]: IAU_OFFSET=0
+++ config.base[397]: export IAU_FHROT=0
+++ config.base[397]: IAU_FHROT=0
+++ config.base[398]: export IAUFHRS=6
+++ config.base[398]: IAUFHRS=6
+++ config.base[401]: [[ NO = \N\O ]]
+++ config.base[401]: export IAUFHRS_ENKF=6
+++ config.base[401]: IAUFHRS_ENKF=6
+++ config.base[405]: [[ NO == \Y\E\S ]]
+++ config.base[408]: export restart_interval_enkfgdas=6
+++ config.base[408]: restart_interval_enkfgdas=6
+++ config.base[411]: export restart_interval_enkfgfs=6
+++ config.base[411]: restart_interval_enkfgfs=6
+++ config.base[413]: [[ NO == \Y\E\S ]]
+++ config.base[416]: export restart_interval_gdas=6
+++ config.base[416]: restart_interval_gdas=6
+++ config.base[419]: export GSI_SOILANAL=NO
+++ config.base[419]: GSI_SOILANAL=NO
+++ config.base[422]: export DONST=YES
+++ config.base[422]: DONST=YES
+++ config.base[423]: [[ YES = \Y\E\S ]]
+++ config.base[423]: export 'FNTSFA= '
+++ config.base[423]: FNTSFA=' '
+++ config.base[426]: export nst_anl=.true.
+++ config.base[426]: nst_anl=.true.
+++ config.base[429]: export MAKE_NSSTBUFR=NO
+++ config.base[429]: MAKE_NSSTBUFR=NO
+++ config.base[432]: export MAKE_ACFTBUFR=NO
+++ config.base[432]: MAKE_ACFTBUFR=NO
+++ config.base[435]: export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[435]: INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[438]: export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[438]: INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[439]: export INCVARS_EFOLD=5
+++ config.base[439]: INCVARS_EFOLD=5
+++ config.base[444]: export netcdf_diag=.true.
+++ config.base[444]: netcdf_diag=.true.
+++ config.base[445]: export binary_diag=.false.
+++ config.base[445]: binary_diag=.false.
+++ config.base[448]: export DO_METP=YES
+++ config.base[448]: DO_METP=YES
+++ config.base[449]: export DO_FIT2OBS=YES
+++ config.base[449]: DO_FIT2OBS=YES
+++ config.base[450]: export DO_VRFY_OCEANDA=NO
+++ config.base[450]: DO_VRFY_OCEANDA=NO
+++ config.base[453]: export FHMAX_FITS=132
+++ config.base[453]: FHMAX_FITS=132
+++ config.base[454]: [[ 132 -gt 120 ]]
+++ config.base[454]: export FHMAX_FITS=120
+++ config.base[454]: FHMAX_FITS=120
+++ config.base[457]: export HPSSARCH=NO
+++ config.base[457]: HPSSARCH=NO
+++ config.base[458]: export LOCALARCH=NO
+++ config.base[458]: LOCALARCH=NO
+++ config.base[459]: [[ NO = \Y\E\S ]]
+++ config.base[463]: export ARCH_CYC=00
+++ config.base[463]: ARCH_CYC=00
+++ config.base[464]: export ARCH_WARMICFREQ=4
+++ config.base[464]: ARCH_WARMICFREQ=4
+++ config.base[465]: export ARCH_FCSTICFREQ=1
+++ config.base[465]: ARCH_FCSTICFREQ=1
+++ config.base[468]: [[ YES = \Y\E\S ]]
+++ config.base[469]: export DO_VERFOZN=NO
+++ config.base[469]: DO_VERFOZN=NO
+++ config.base[470]: export DO_VERFRAD=NO
+++ config.base[470]: DO_VERFRAD=NO
+++ config.base[471]: export DO_VMINMON=NO
+++ config.base[471]: DO_VMINMON=NO
+++ config.base[475]: export REPLAY_ICS=NO
+++ config.base[475]: REPLAY_ICS=NO
+++ config.base[476]: export OFFSET_START_HOUR=0
+++ config.base[476]: OFFSET_START_HOUR=0
+++ config.base[479]: export NUM_SND_COLLECTIVES=9
+++ config.base[479]: NUM_SND_COLLECTIVES=9
+++ config.base[481]: echo 'END: config.base'
END: config.base
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.atmensanl
+++ config.atmensanl[6]: echo 'BEGIN: config.atmensanl'
BEGIN: config.atmensanl
+++ config.atmensanl[8]: export JCB_BASE_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm/jcb-base.yaml.j2
+++ config.atmensanl[8]: JCB_BASE_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm/jcb-base.yaml.j2
+++ config.atmensanl[9]: export JCB_ALGO_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm/jcb-prototype_lgetkf.yaml.j2
+++ config.atmensanl[9]: JCB_ALGO_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm/jcb-prototype_lgetkf.yaml.j2
+++ config.atmensanl[11]: export INTERP_METHOD=barycentric
+++ config.atmensanl[11]: INTERP_METHOD=barycentric
+++ config.atmensanl[13]: export CRTM_FIX_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm_crtm_coeff.yaml.j2
+++ config.atmensanl[13]: CRTM_FIX_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm_crtm_coeff.yaml.j2
+++ config.atmensanl[14]: export JEDI_FIX_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm_jedi_fix.yaml.j2
+++ config.atmensanl[14]: JEDI_FIX_YAML=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/parm/gdas/atm_jedi_fix.yaml.j2
+++ config.atmensanl[16]: export layout_x_atmensanl=4
+++ config.atmensanl[16]: layout_x_atmensanl=4
+++ config.atmensanl[17]: export layout_y_atmensanl=4
+++ config.atmensanl[17]: layout_y_atmensanl=4
+++ config.atmensanl[19]: export io_layout_x=1
+++ config.atmensanl[19]: io_layout_x=1
+++ config.atmensanl[20]: export io_layout_y=1
+++ config.atmensanl[20]: io_layout_y=1
+++ config.atmensanl[22]: export JEDIEXE=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec/gdas.x
+++ config.atmensanl[22]: JEDIEXE=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec/gdas.x
+++ config.atmensanl[24]: echo 'END: config.atmensanl'
END: config.atmensanl
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.atmensanlfv3inc
+++ config.atmensanlfv3inc[6]: echo 'BEGIN: config.atmensanlfv3inc'
BEGIN: config.atmensanlfv3inc
+++ config.atmensanlfv3inc[9]: . /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.resources atmensanlfv3inc
++++ config.resources[9]: (( 1 != 1 ))
++++ config.resources[33]: step=atmensanlfv3inc
++++ config.resources[35]: echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[37]: case ${machine} in
++++ config.resources[39]: npe_node_max=128
++++ config.resources[41]: mem_node_max=500GB
++++ config.resources[125]: export npe_node_max
++++ config.resources[127]: case ${step} in
++++ config.resources[1064]: export layout_x=4
++++ config.resources[1064]: layout_x=4
++++ config.resources[1065]: export layout_y=4
++++ config.resources[1065]: layout_y=4
++++ config.resources[1067]: export wtime_atmensanlfv3inc=00:30:00
++++ config.resources[1067]: wtime_atmensanlfv3inc=00:30:00
++++ config.resources[1068]: export npe_atmensanlfv3inc_enkfgdas=96
++++ config.resources[1068]: npe_atmensanlfv3inc_enkfgdas=96
++++ config.resources[1069]: export npe_atmensanlfv3inc_enkfgfs=96
++++ config.resources[1069]: npe_atmensanlfv3inc_enkfgfs=96
++++ config.resources[1070]: export nth_atmensanlfv3inc_enkfgdas=1
++++ config.resources[1070]: nth_atmensanlfv3inc_enkfgdas=1
++++ config.resources[1071]: export nth_atmensanlfv3inc_enkfgfs=1
++++ config.resources[1071]: nth_atmensanlfv3inc_enkfgfs=1
++++ config.resources[1072]: export npe_node_atmensanlfv3inc_enkfgdas=128
++++ config.resources[1072]: npe_node_atmensanlfv3inc_enkfgdas=128
++++ config.resources[1073]: export npe_node_atmensanlfv3inc_enkfgfs=128
++++ config.resources[1073]: npe_node_atmensanlfv3inc_enkfgfs=128
++++ config.resources[1074]: export memory_atmensanlfv3inc=96GB
++++ config.resources[1074]: memory_atmensanlfv3inc=96GB
++++ config.resources[1075]: export is_exclusive=True
++++ config.resources[1075]: is_exclusive=True
++++ config.resources[1077]: var_npe_node=npe_node_atmensanlletkf_enkfgdas
++++ config.resources[1078]: var_nth=nth_atmensanlletkf_enkfgdas
++++ config.resources[1079]: var_npe=npe_atmensanlletkf_enkfgdas
++++ config.resources[1082]: [[ -n '' ]]
++++ config.resources[1396]: unset var_NTASKS var_npe var_npe_node var_nth
++++ config.resources[1402]: [[ -f /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.resources.WCOSS2 ]]
++++ config.resources[1403]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525/config.resources.WCOSS2
+++++ config.resources.WCOSS2[5]: case ${step} in
++++ config.resources[1406]: echo 'END: config.resources'
END: config.resources
+++ config.atmensanlfv3inc[11]: export JCB_ALGO=fv3jedi_fv3inc_lgetkf
+++ config.atmensanlfv3inc[11]: JCB_ALGO=fv3jedi_fv3inc_lgetkf
+++ config.atmensanlfv3inc[12]: export JEDIEXE=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec/fv3jedi_fv3inc.x
+++ config.atmensanlfv3inc[12]: JEDIEXE=/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/exec/fv3jedi_fv3inc.x
+++ config.atmensanlfv3inc[14]: echo 'END: config.atmensanlfv3inc'
END: config.atmensanlfv3inc
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[110]: source /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/env/WCOSS2.env atmensanlfv3inc
+++ WCOSS2.env[3]: [[ 1 -ne 1 ]]
+++ WCOSS2.env[10]: step=atmensanlfv3inc
+++ WCOSS2.env[13]: export 'launcher=mpiexec -l'
+++ WCOSS2.env[13]: launcher='mpiexec -l'
+++ WCOSS2.env[14]: export 'mpmd_opt=--cpu-bind verbose,core cfp'
+++ WCOSS2.env[14]: mpmd_opt='--cpu-bind verbose,core cfp'
+++ WCOSS2.env[16]: [[ atmensanlfv3inc = \p\r\e\p ]]
+++ WCOSS2.env[16]: [[ atmensanlfv3inc = \p\r\e\p\b\u\f\r ]]
+++ WCOSS2.env[25]: [[ atmensanlfv3inc = \p\r\e\p\s\n\o\w\o\b\s ]]
+++ WCOSS2.env[29]: [[ atmensanlfv3inc = \p\r\e\p\_\e\m\i\s\s\i\o\n\s ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\i\n\i\t ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\p\r\e\p ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\p\o\s\t\s\b\s ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\p\o\s\t\b\n\d\p\n\t ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\p\o\s\t\b\n\d\p\n\t\b\l\l ]]
+++ WCOSS2.env[33]: [[ atmensanlfv3inc = \w\a\v\e\p\o\s\t\p\n\t ]]
+++ WCOSS2.env[39]: [[ atmensanlfv3inc = \a\t\m\a\n\l\v\a\r ]]
+++ WCOSS2.env[47]: [[ atmensanlfv3inc = \a\t\m\e\n\s\a\n\l\l\e\t\k\f ]]
+++ WCOSS2.env[55]: [[ atmensanlfv3inc = \a\t\m\e\n\s\a\n\l\f\v\3\i\n\c ]]
/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/env/WCOSS2.env: line 57: npe_node_atmensanlfv3inc: unbound variable
++++ WCOSS2.env[1]: postamble JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT 1719129956 1
++++ preamble.sh[70]: set +x
End JGLOBAL_ATMENS_ANALYSIS_FV3_INCREMENT at 08:05:59 with error code 1 (time elapsed: 00:00:03)
+ atmensanlfv3inc.sh[1]: postamble atmensanlfv3inc.sh 1719129932 1
+ preamble.sh[70]: set +x
End atmensanlfv3inc.sh at 08:05:59 with error code 1 (time elapsed: 00:00:27)
PBS: Running epilogue on parent mom node: nid001295...
##### Job 153612767.dbqs01 - PBS Job Script:
(Note: Duplicate #PBS entries are a function how PBS interprets and caches the original job script.)
#! /bin/sh
#PBS -N C96C48_ufs_hybatmDA_cb03a525_enkfgdasatmensanlfv3inc_00
#PBS -A GFS-DEV
#PBS -q dev
#PBS -l walltime=00:30:00
#PBS -l select=1:mpiprocs=128:ompthreads=1:ncpus=128:mem=96GB
#PBS -j oe -o /lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT/C96C48_ufs_hybatmDA_cb03a525/logs/2024022400/enkfgdasatmensanlfv3inc.log
#PBS -l place=vscatter:exclhost
export RUN_ENVIR='emc'
export HOMEgfs='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow'
export EXPDIR='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_cb03a525'
export NET='gfs'
export CDUMP='enkfgdas'
export RUN='enkfgdas'
export CDATE='2024022400'
export PDY='20240224'
export cyc='00'
export COMROOT='/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/RUNTESTS/COMROOT'
export DATAROOT='/lfs/h2/emc/stmp/terry.mcguinness/RUNDIRS/C96C48_ufs_hybatmDA_cb03a525'
set -x
/lfs/h2/emc/global/noscrub/globalworkflow.ci/GFS_CI_ROOT/PR/2672/global-workflow/jobs/rocoto/atmensanlfv3inc.sh
##### End of job script
------------------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment