Skip to content

Instantly share code, notes, and snippets.

@emcbot
Created June 21, 2024 18:54
Show Gist options
  • Save emcbot/f6adb56886f77fc76ae380eac164f0b9 to your computer and use it in GitHub Desktop.
Save emcbot/f6adb56886f77fc76ae380eac164f0b9 to your computer and use it in GitHub Desktop.
error log file from CI run PR_2700
Begin prepoceanobs.sh at Fri Jun 21 18:47:43 UTC 2024
+ prepoceanobs.sh[8]: . /scratch1/NCEPDEV/global/CI/2700/gfs/ush/load_ufsda_modules.sh
++ load_ufsda_modules.sh[4]: [[ NO == \N\O ]]
++ load_ufsda_modules.sh[5]: echo 'Loading modules quietly...'
Loading modules quietly...
++ load_ufsda_modules.sh[6]: set +x
Running "module reset". Resetting modules to system default. The following $MODULEPATH directories have been removed: None
Currently Loaded Modules:
1) contrib 48) sp/2.5.0
2) intel/2022.1.2 49) gsl-lite/0.37.0
3) stack-intel/2021.5.0 50) libjpeg/2.1.0
4) impi/2022.1.2 51) krb5/1.20.1
5) stack-intel-oneapi-mpi/2021.5.1 52) libtirpc/1.3.3
6) cmake/3.23.1 53) hdf/4.2.15
7) gettext/0.19.8.1 54) jedi-cmake/1.4.0
8) pcre2/10.42 55) libpng/1.6.37
9) nghttp2/1.57.0 56) libxt/1.1.5
10) curl/8.4.0 57) libxmu/1.1.4
11) zlib/1.2.13 58) libxpm/4.11.0
12) git/2.18.0 59) libxaw/1.0.13
13) pkg-config/0.27.1 60) udunits/2.2.28
14) hdf5/1.14.0 61) ncview/2.1.9
15) parallel-netcdf/1.12.2 62) netcdf-cxx4/4.3.1
16) snappy/1.1.10 63) json/3.10.5
17) zstd/1.5.2 64) rocoto/1.3.6
18) c-blosc/1.21.5 65) bacio/2.4.1
19) netcdf-c/4.9.2 66) w3emc/2.10.0
20) nccmp/1.9.0.1 67) prod_util/2.1.1
21) netcdf-fortran/4.6.1 68) py-markupsafe/2.1.3
22) antlr/2.7.7 69) py-jinja2/3.0.3
23) gsl/2.7.1 70) py-cftime/1.0.3.4
24) nco/5.0.6 71) py-netcdf4/1.5.8
25) parallelio/2.5.10 72) py-pybind11/2.11.0
26) wget/1.14 73) py-pycodestyle/2.11.0
27) libxcrypt/4.4.35 74) libyaml/0.2.5
28) sqlite/3.43.2 75) py-pyyaml/6.0
29) util-linux-uuid/2.38.1 76) py-scipy/1.11.3
30) python/3.10.13 77) py-packaging/23.1
31) boost/1.83.0 78) py-bottleneck/1.3.7
32) py-setuptools/63.4.3 79) py-numexpr/2.8.4
33) py-numpy/1.22.3 80) py-et-xmlfile/1.0.1
34) bufr/12.0.1 81) py-openpyxl/3.1.2
35) git-lfs/2.10.0 82) py-six/1.16.0
36) ecbuild/3.7.2 83) py-python-dateutil/2.8.2
37) openjpeg/2.3.1 84) py-pytz/2023.3
38) eccodes/2.32.0 85) py-pyxlsb/1.0.10
39) eigen/3.4.0 86) py-xlrd/2.0.1
40) openblas/0.3.24 87) py-xlsxwriter/3.1.7
41) eckit/1.24.5 88) py-xlwt/1.3.0
42) fftw/3.3.10 89) py-pandas/1.5.3
43) fckit/0.11.0 90) py-xarray/2023.7.0
44) fiat/1.2.0 91) py-f90nml/1.4.3
45) ectrans/1.2.0 92) py-pip/23.1.2
46) qhull/2020.2 93) GDAS/hera.intel
47) atlas/0.35.1
Package Version
--------------- --------
Bottleneck 1.3.7
cftime 1.0.3.4
et-xmlfile 1.0.1
f90nml 1.4.3
Jinja2 3.0.3
MarkupSafe 2.1.3
netCDF4 1.5.8
numexpr 2.8.4
numpy 1.22.3
openpyxl 3.1.2
packaging 23.1
pandas 1.5.3
pip 23.1.2
pybind11 2.11.0
pycodestyle 2.11.0
python-dateutil 2.8.2
pytz 2023.3
pyxlsb 1.0.10
PyYAML 6.0
scipy 1.11.3
setuptools 63.4.3
six 1.16.0
xarray 2023.7.0
xlrd 2.0.1
XlsxWriter 3.1.7
xlwt 1.3.0
+ prepoceanobs.sh[9]: status=0
+ prepoceanobs.sh[10]: [[ 0 -ne 0 ]]
+ prepoceanobs.sh[12]: export job=prepoceanobs
+ prepoceanobs.sh[12]: job=prepoceanobs
+ prepoceanobs.sh[13]: export jobid=prepoceanobs.329436
+ prepoceanobs.sh[13]: jobid=prepoceanobs.329436
+ prepoceanobs.sh[18]: PYTHONPATH=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pip-23.1.2-z73urru/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-f90nml-1.4.3-dz2bima/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-xarray-2023.7.0-tbnsqaw/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pandas-1.5.3-7hathmq/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-xlwt-1.3.0-f7bd3ip/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-xlsxwriter-3.1.7-pmb7bam/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-xlrd-2.0.1-56miqff/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pyxlsb-1.0.10-jlrsqbq/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pytz-2023.3-5nykyqa/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-python-dateutil-2.8.2-lfyvko2/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-six-1.16.0-6knf6az/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-openpyxl-3.1.2-rv2hu6u/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-et-xmlfile-1.0.1-7goajc5/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-numexpr-2.8.4-ega4hge/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-bottleneck-1.3.7-snzpnsr/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-packaging-23.1-ke4uivr/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-scipy-1.11.3-36msxks/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pyyaml-6.0-nlgnppd/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pycodestyle-2.11.0-opcwzxa/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-pybind11-2.11.0-l6cenvi/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-netcdf4-1.5.8-qs672u4/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-cftime-1.0.3.4-rnt66hg/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-jinja2-3.0.3-2g4rjkz/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-markupsafe-2.1.3-q2gnvtr/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/bufr-12.0.1-nz7jhfd/lib64/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/bufr-12.0.1-nz7jhfd/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-numpy-1.22.3-snzl53m/lib/python3.10/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/py-setuptools-63.4.3-wvdr656/lib/python3.10/site-packages:/scratch1/NCEPDEV/global/CI/2700/gfs/ush
+ prepoceanobs.sh[22]: /scratch1/NCEPDEV/global/CI/2700/gfs/jobs/JGLOBAL_PREP_OCEAN_OBS
Begin JGLOBAL_PREP_OCEAN_OBS at Fri Jun 21 18:48:09 UTC 2024
+ JGLOBAL_PREP_OCEAN_OBS[3]: source /scratch1/NCEPDEV/global/CI/2700/gfs/ush/jjob_header.sh -e prepoceanobs -c 'base prepoceanobs'
++ jjob_header.sh[44]: OPTIND=1
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[48]: env_job=prepoceanobs
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[47]: read -ra configs
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[59]: shift 4
++ jjob_header.sh[61]: [[ -z prepoceanobs ]]
++ jjob_header.sh[69]: export DATA=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
++ jjob_header.sh[69]: DATA=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
++ jjob_header.sh[70]: [[ YES == \Y\E\S ]]
++ jjob_header.sh[71]: rm -rf /scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
++ jjob_header.sh[73]: mkdir -p /scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
++ jjob_header.sh[74]: cd /scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
++ jjob_header.sh[80]: export cycle=t18z
++ jjob_header.sh[80]: cycle=t18z
++ jjob_header.sh[81]: setpdy.sh
sed: can't read /scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT/date/t18z: No such file or directory
completed cleanly
completed cleanly
Source PDY script to export PDYm7, ..., PDY, ..., PDYp7 variables.
++ jjob_header.sh[82]: source ./PDY
+++ PDY[1]: export PDYm7=20210317
+++ PDY[1]: PDYm7=20210317
+++ PDY[2]: export PDYm6=20210318
+++ PDY[2]: PDYm6=20210318
+++ PDY[3]: export PDYm5=20210319
+++ PDY[3]: PDYm5=20210319
+++ PDY[4]: export PDYm4=20210320
+++ PDY[4]: PDYm4=20210320
+++ PDY[5]: export PDYm3=20210321
+++ PDY[5]: PDYm3=20210321
+++ PDY[6]: export PDYm2=20210322
+++ PDY[6]: PDYm2=20210322
+++ PDY[7]: export PDYm1=20210323
+++ PDY[7]: PDYm1=20210323
+++ PDY[8]: export PDY=20210324
+++ PDY[8]: PDY=20210324
+++ PDY[9]: export PDYp1=20210325
+++ PDY[9]: PDYp1=20210325
+++ PDY[10]: export PDYp2=20210326
+++ PDY[10]: PDYp2=20210326
+++ PDY[11]: export PDYp3=20210327
+++ PDY[11]: PDYp3=20210327
+++ PDY[12]: export PDYp4=20210328
+++ PDY[12]: PDYp4=20210328
+++ PDY[13]: export PDYp5=20210329
+++ PDY[13]: PDYp5=20210329
+++ PDY[14]: export PDYp6=20210330
+++ PDY[14]: PDYp6=20210330
+++ PDY[15]: export PDYp7=20210331
+++ PDY[15]: PDYp7=20210331
++ jjob_header.sh[88]: export pid=330140
++ jjob_header.sh[88]: pid=330140
++ jjob_header.sh[89]: export pgmout=OUTPUT.330140
++ jjob_header.sh[89]: pgmout=OUTPUT.330140
++ jjob_header.sh[90]: export pgmerr=errfile
++ jjob_header.sh[90]: pgmerr=errfile
++ jjob_header.sh[96]: export EXPDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95
++ jjob_header.sh[96]: EXPDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95/config.base
+++ config.base[6]: echo 'BEGIN: config.base'
BEGIN: config.base
+++ config.base[9]: export machine=HERA
+++ config.base[9]: machine=HERA
+++ config.base[12]: export RUN_ENVIR=emc
+++ config.base[12]: RUN_ENVIR=emc
+++ config.base[15]: export ACCOUNT=nems
+++ config.base[15]: ACCOUNT=nems
+++ config.base[16]: export ACCOUNT_SERVICE=fv3-cpu
+++ config.base[16]: ACCOUNT_SERVICE=fv3-cpu
+++ config.base[17]: export QUEUE=batch
+++ config.base[17]: QUEUE=batch
+++ config.base[18]: export QUEUE_SERVICE=batch
+++ config.base[18]: QUEUE_SERVICE=batch
+++ config.base[19]: export PARTITION_BATCH=hera
+++ config.base[19]: PARTITION_BATCH=hera
+++ config.base[20]: export PARTITION_SERVICE=service
+++ config.base[20]: PARTITION_SERVICE=service
+++ config.base[21]: export RESERVATION=
+++ config.base[21]: RESERVATION=
+++ config.base[24]: export HPSS_PROJECT=emc-global
+++ config.base[24]: HPSS_PROJECT=emc-global
+++ config.base[27]: export HOMEgfs=/scratch1/NCEPDEV/global/CI/2700/gfs
+++ config.base[27]: HOMEgfs=/scratch1/NCEPDEV/global/CI/2700/gfs
+++ config.base[28]: export EXECgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/exec
+++ config.base[28]: EXECgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/exec
+++ config.base[29]: export FIXgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/fix
+++ config.base[29]: FIXgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/fix
+++ config.base[30]: export PARMgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/parm
+++ config.base[30]: PARMgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/parm
+++ config.base[31]: export SCRgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/scripts
+++ config.base[31]: SCRgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/scripts
+++ config.base[32]: export USHgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/ush
+++ config.base[32]: USHgfs=/scratch1/NCEPDEV/global/CI/2700/gfs/ush
+++ config.base[34]: export FIXam=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/am
+++ config.base[34]: FIXam=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/am
+++ config.base[35]: export FIXaer=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/aer
+++ config.base[35]: FIXaer=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/aer
+++ config.base[36]: export FIXcpl=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/cpl
+++ config.base[36]: FIXcpl=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/cpl
+++ config.base[37]: export FIXlut=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/lut
+++ config.base[37]: FIXlut=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/lut
+++ config.base[38]: export FIXcice=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/cice
+++ config.base[38]: FIXcice=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/cice
+++ config.base[39]: export FIXmom=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/mom6
+++ config.base[39]: FIXmom=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/mom6
+++ config.base[40]: export FIXreg2grb2=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/reg2grb2
+++ config.base[40]: FIXreg2grb2=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/reg2grb2
+++ config.base[41]: export FIXgdas=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/gdas
+++ config.base[41]: FIXgdas=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/gdas
+++ config.base[46]: export PACKAGEROOT=/scratch1/NCEPDEV/global/glopara/nwpara
+++ config.base[46]: PACKAGEROOT=/scratch1/NCEPDEV/global/glopara/nwpara
+++ config.base[47]: export COMROOT=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT
+++ config.base[47]: COMROOT=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT
+++ config.base[48]: export COMINsyn=/scratch1/NCEPDEV/global/glopara/com/gfs/prod/syndat
+++ config.base[48]: COMINsyn=/scratch1/NCEPDEV/global/glopara/com/gfs/prod/syndat
+++ config.base[49]: export DMPDIR=/scratch1/NCEPDEV/global/glopara/dump
+++ config.base[49]: DMPDIR=/scratch1/NCEPDEV/global/glopara/dump
+++ config.base[50]: export BASE_CPLIC=/scratch1/NCEPDEV/global/glopara/data/ICSDIR/prototype_ICs
+++ config.base[50]: BASE_CPLIC=/scratch1/NCEPDEV/global/glopara/data/ICSDIR/prototype_ICs
+++ config.base[54]: export COMINecmwf=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ecmwf
+++ config.base[54]: COMINecmwf=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ecmwf
+++ config.base[55]: export COMINnam=/scratch1/NCEPDEV/global/glopara/data/external_gempak/nam
+++ config.base[55]: COMINnam=/scratch1/NCEPDEV/global/glopara/data/external_gempak/nam
+++ config.base[56]: export COMINukmet=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ukmet
+++ config.base[56]: COMINukmet=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ukmet
+++ config.base[59]: export HOMEDIR=/scratch1/NCEPDEV/global/Terry.McGuinness
+++ config.base[59]: HOMEDIR=/scratch1/NCEPDEV/global/Terry.McGuinness
+++ config.base[60]: export STMP=/scratch1/NCEPDEV/stmp2/Terry.McGuinness
+++ config.base[60]: STMP=/scratch1/NCEPDEV/stmp2/Terry.McGuinness
+++ config.base[61]: export PTMP=/scratch1/NCEPDEV/stmp4/Terry.McGuinness
+++ config.base[61]: PTMP=/scratch1/NCEPDEV/stmp4/Terry.McGuinness
+++ config.base[62]: export NOSCRUB=/scratch1/NCEPDEV/global/Terry.McGuinness
+++ config.base[62]: NOSCRUB=/scratch1/NCEPDEV/global/Terry.McGuinness
+++ config.base[65]: export BASE_GIT=/scratch1/NCEPDEV/global/glopara/git
+++ config.base[65]: BASE_GIT=/scratch1/NCEPDEV/global/glopara/git
+++ config.base[68]: export DO_GOES=NO
+++ config.base[68]: DO_GOES=NO
+++ config.base[69]: export DO_BUFRSND=NO
+++ config.base[69]: DO_BUFRSND=NO
+++ config.base[70]: export DO_GEMPAK=NO
+++ config.base[70]: DO_GEMPAK=NO
+++ config.base[71]: export DO_AWIPS=NO
+++ config.base[71]: DO_AWIPS=NO
+++ config.base[72]: export DO_NPOESS=NO
+++ config.base[72]: DO_NPOESS=NO
+++ config.base[73]: export DO_TRACKER=YES
+++ config.base[73]: DO_TRACKER=YES
+++ config.base[74]: export DO_GENESIS=YES
+++ config.base[74]: DO_GENESIS=YES
+++ config.base[75]: export DO_GENESIS_FSU=NO
+++ config.base[75]: DO_GENESIS_FSU=NO
+++ config.base[76]: export DO_VERFOZN=YES
+++ config.base[76]: DO_VERFOZN=YES
+++ config.base[77]: export DO_VERFRAD=YES
+++ config.base[77]: DO_VERFRAD=YES
+++ config.base[78]: export DO_VMINMON=YES
+++ config.base[78]: DO_VMINMON=YES
+++ config.base[79]: export DO_MOS=NO
+++ config.base[79]: DO_MOS=NO
+++ config.base[85]: export REALTIME=YES
+++ config.base[85]: REALTIME=YES
+++ config.base[88]: export MODE=cycled
+++ config.base[88]: MODE=cycled
+++ config.base[97]: export FIXgsi=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/gsi
+++ config.base[97]: FIXgsi=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/gsi
+++ config.base[98]: export HOMEpost=/scratch1/NCEPDEV/global/CI/2700/gfs
+++ config.base[98]: HOMEpost=/scratch1/NCEPDEV/global/CI/2700/gfs
+++ config.base[99]: export HOMEobsproc=/scratch1/NCEPDEV/global/glopara/git/obsproc/v1.1.2
+++ config.base[99]: HOMEobsproc=/scratch1/NCEPDEV/global/glopara/git/obsproc/v1.1.2
+++ config.base[102]: export 'NCP=/bin/cp -p'
+++ config.base[102]: NCP='/bin/cp -p'
+++ config.base[103]: export NMV=/bin/mv
+++ config.base[103]: NMV=/bin/mv
+++ config.base[104]: export 'NLN=/bin/ln -sf'
+++ config.base[104]: NLN='/bin/ln -sf'
+++ config.base[105]: export VERBOSE=YES
+++ config.base[105]: VERBOSE=YES
+++ config.base[106]: export KEEPDATA=NO
+++ config.base[106]: KEEPDATA=NO
+++ config.base[107]: export DEBUG_POSTSCRIPT=NO
+++ config.base[107]: DEBUG_POSTSCRIPT=NO
+++ config.base[108]: export CHGRP_RSTPROD=YES
+++ config.base[108]: CHGRP_RSTPROD=YES
+++ config.base[109]: export 'CHGRP_CMD=chgrp rstprod'
+++ config.base[109]: CHGRP_CMD='chgrp rstprod'
+++ config.base[110]: export NCDUMP=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/netcdf-c-4.9.2-ejp7j3k/bin/ncdump/bin/ncdump
+++ config.base[110]: NCDUMP=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/netcdf-c-4.9.2-ejp7j3k/bin/ncdump/bin/ncdump
+++ config.base[111]: export NCLEN=/scratch1/NCEPDEV/global/CI/2700/gfs/ush/getncdimlen
+++ config.base[111]: NCLEN=/scratch1/NCEPDEV/global/CI/2700/gfs/ush/getncdimlen
+++ config.base[114]: export BASE_ENV=/scratch1/NCEPDEV/global/CI/2700/gfs/env
+++ config.base[114]: BASE_ENV=/scratch1/NCEPDEV/global/CI/2700/gfs/env
+++ config.base[115]: export BASE_JOB=/scratch1/NCEPDEV/global/CI/2700/gfs/jobs/rocoto
+++ config.base[115]: BASE_JOB=/scratch1/NCEPDEV/global/CI/2700/gfs/jobs/rocoto
+++ config.base[118]: export SDATE=2021032412
+++ config.base[118]: SDATE=2021032412
+++ config.base[119]: export EDATE=2021032418
+++ config.base[119]: EDATE=2021032418
+++ config.base[120]: export EXP_WARM_START=.true.
+++ config.base[120]: EXP_WARM_START=.true.
+++ config.base[121]: export assim_freq=6
+++ config.base[121]: assim_freq=6
+++ config.base[122]: export PSLOT=C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[122]: PSLOT=C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[123]: export EXPDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[123]: EXPDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[124]: export ROTDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[124]: ROTDIR=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[125]: export ROTDIR_DUMP=YES
+++ config.base[125]: ROTDIR_DUMP=YES
+++ config.base[126]: export DUMP_SUFFIX=
+++ config.base[126]: DUMP_SUFFIX=
+++ config.base[127]: [[ 2021032418 -ge 2019092100 ]]
+++ config.base[127]: [[ 2021032418 -le 2019110700 ]]
+++ config.base[130]: export DATAROOT=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[130]: DATAROOT=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[131]: export RUNDIR=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[131]: RUNDIR=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[132]: export ARCDIR=/scratch1/NCEPDEV/global/Terry.McGuinness/archive/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[132]: ARCDIR=/scratch1/NCEPDEV/global/Terry.McGuinness/archive/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[133]: export ATARDIR=/NCEPDEV/emc-global/1year/Terry.McGuinness/HERA/scratch/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[133]: ATARDIR=/NCEPDEV/emc-global/1year/Terry.McGuinness/HERA/scratch/C48mx500_3DVarAOWCDA_7cc86d95
+++ config.base[136]: export envir=prod
+++ config.base[136]: envir=prod
+++ config.base[137]: export NET=gfs
+++ config.base[137]: NET=gfs
+++ config.base[138]: export RUN=gdas
+++ config.base[138]: RUN=gdas
+++ config.base[144]: source /scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95/config.com
++++ config.com[4]: echo 'BEGIN: config.com'
BEGIN: config.com
++++ config.com[37]: [[ emc == \n\c\o ]]
++++ config.com[41]: COM_OBS_TMPL='${ROTDIR}/${RUN}.${YMD}/${HH}/obs'
++++ config.com[42]: COM_RTOFS_TMPL='${DMPDIR}'
++++ config.com[44]: declare -rx COM_OBS_TMPL COM_RTOFS_TMPL
++++ config.com[45]: declare -rx 'COM_OBSDMP_TMPL=${DMPDIR}/${DUMP}${DUMP_SUFFIX}.${YMD}/${HH}/atmos'
++++ config.com[47]: COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}'
++++ config.com[49]: declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}'
++++ config.com[51]: declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf'
++++ config.com[52]: declare -rx 'COM_OBS_JEDI=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/obs_jedi'
++++ config.com[54]: declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/input'
++++ config.com[55]: declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/restart'
++++ config.com[56]: declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos'
++++ config.com[57]: declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow'
++++ config.com[58]: declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/history'
++++ config.com[59]: declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/master'
++++ config.com[60]: declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2'
++++ config.com[61]: declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}'
++++ config.com[62]: declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr'
++++ config.com[63]: declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}'
++++ config.com[64]: declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital'
++++ config.com[65]: declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks'
++++ config.com[66]: declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim'
++++ config.com[67]: declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery'
++++ config.com[68]: declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon'
++++ config.com[69]: declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon'
++++ config.com[70]: declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon'
++++ config.com[71]: declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo'
++++ config.com[73]: declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/restart'
++++ config.com[74]: declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/prep'
++++ config.com[75]: declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/history'
++++ config.com[76]: declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded'
++++ config.com[77]: declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station'
++++ config.com[78]: declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak'
++++ config.com[79]: declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo'
++++ config.com[81]: declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/history'
++++ config.com[82]: declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/restart'
++++ config.com[83]: declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/input'
++++ config.com[84]: declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean'
++++ config.com[85]: declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf'
++++ config.com[86]: declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2'
++++ config.com[87]: declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}'
++++ config.com[89]: declare -rx 'COM_ICE_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice'
++++ config.com[90]: declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/input'
++++ config.com[91]: declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/history'
++++ config.com[92]: declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/restart'
++++ config.com[93]: declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf'
++++ config.com[94]: declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2'
++++ config.com[95]: declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}'
++++ config.com[97]: declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/chem/history'
++++ config.com[98]: declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem'
++++ config.com[100]: declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/med/restart'
+++ config.base[147]: export 'ERRSCRIPT=eval [[ $err = 0 ]]'
+++ config.base[147]: ERRSCRIPT='eval [[ $err = 0 ]]'
+++ config.base[148]: export LOGSCRIPT=
+++ config.base[148]: LOGSCRIPT=
+++ config.base[151]: export 'REDOUT=1>'
+++ config.base[151]: REDOUT='1>'
+++ config.base[152]: export 'REDERR=2>'
+++ config.base[152]: REDERR='2>'
+++ config.base[154]: export SENDECF=NO
+++ config.base[154]: SENDECF=NO
+++ config.base[155]: export SENDSDM=NO
+++ config.base[155]: SENDSDM=NO
+++ config.base[156]: export SENDDBN_NTC=NO
+++ config.base[156]: SENDDBN_NTC=NO
+++ config.base[157]: export SENDDBN=NO
+++ config.base[157]: SENDDBN=NO
+++ config.base[158]: export DBNROOT=/fakedbn
+++ config.base[158]: DBNROOT=/fakedbn
+++ config.base[161]: export APP=S2S
+++ config.base[161]: APP=S2S
+++ config.base[163]: shopt -s extglob
+++ config.base[165]: case "${RUN}" in
+++ config.base[172]: shopt -u extglob
+++ config.base[175]: export DO_ATM=YES
+++ config.base[175]: DO_ATM=YES
+++ config.base[176]: export DO_COUPLED=NO
+++ config.base[176]: DO_COUPLED=NO
+++ config.base[177]: export DO_WAVE=NO
+++ config.base[177]: DO_WAVE=NO
+++ config.base[178]: export DO_OCN=NO
+++ config.base[178]: DO_OCN=NO
+++ config.base[179]: export DO_ICE=NO
+++ config.base[179]: DO_ICE=NO
+++ config.base[180]: export DO_AERO=NO
+++ config.base[180]: DO_AERO=NO
+++ config.base[181]: export DO_PREP_OBS_AERO=NO
+++ config.base[181]: DO_PREP_OBS_AERO=NO
+++ config.base[182]: export AERO_FCST_CDUMP=
+++ config.base[182]: AERO_FCST_CDUMP=
+++ config.base[183]: export AERO_ANL_CDUMP=
+++ config.base[183]: AERO_ANL_CDUMP=
+++ config.base[184]: export WAVE_CDUMP=
+++ config.base[184]: WAVE_CDUMP=
+++ config.base[185]: export DOBNDPNT_WAVE=NO
+++ config.base[185]: DOBNDPNT_WAVE=NO
+++ config.base[186]: export DOIBP_WAV=NO
+++ config.base[186]: DOIBP_WAV=NO
+++ config.base[187]: export FRAC_GRID=.true.
+++ config.base[187]: FRAC_GRID=.true.
+++ config.base[188]: export DO_NEST=NO
+++ config.base[188]: DO_NEST=NO
+++ config.base[189]: [[ NO == \Y\E\S ]]
+++ config.base[195]: export ntiles=6
+++ config.base[195]: ntiles=6
+++ config.base[196]: export FIXugwd=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/ugwd
+++ config.base[196]: FIXugwd=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/ugwd
+++ config.base[197]: export FIXorog=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/orog
+++ config.base[197]: FIXorog=/scratch1/NCEPDEV/global/CI/2700/gfs/fix/orog
+++ config.base[201]: export OPS_RES=C768
+++ config.base[201]: OPS_RES=C768
+++ config.base[204]: export LEVS=128
+++ config.base[204]: LEVS=128
+++ config.base[205]: export CASE=C48
+++ config.base[205]: CASE=C48
+++ config.base[206]: export CASE_ENS=@CASEENS@
+++ config.base[206]: CASE_ENS=@CASEENS@
+++ config.base[207]: export OCNRES=500
+++ config.base[207]: OCNRES=500
+++ config.base[208]: export ICERES=500
+++ config.base[208]: ICERES=500
+++ config.base[211]: case "${CASE}" in
+++ config.base[213]: export waveGRD=uglo_100km
+++ config.base[213]: waveGRD=uglo_100km
+++ config.base[230]: case "${APP}" in
+++ config.base[249]: export DO_COUPLED=YES
+++ config.base[249]: DO_COUPLED=YES
+++ config.base[250]: export DO_OCN=YES
+++ config.base[250]: DO_OCN=YES
+++ config.base[251]: export DO_ICE=YES
+++ config.base[251]: DO_ICE=YES
+++ config.base[253]: [[ S2S =~ A$ ]]
+++ config.base[259]: [[ S2S =~ ^S2SW ]]
+++ config.base[271]: [[ gdas =~ gdas ]]
+++ config.base[272]: export FHCYC=1
+++ config.base[272]: FHCYC=1
+++ config.base[273]: export FTSFS=10
+++ config.base[273]: FTSFS=10
+++ config.base[279]: export FHMIN=0
+++ config.base[279]: FHMIN=0
+++ config.base[280]: export FHMAX=9
+++ config.base[280]: FHMAX=9
+++ config.base[281]: export FHOUT=3
+++ config.base[281]: FHOUT=3
+++ config.base[282]: export FHOUT_OCN=3
+++ config.base[282]: FHOUT_OCN=3
+++ config.base[283]: export FHOUT_ICE=3
+++ config.base[283]: FHOUT_ICE=3
+++ config.base[286]: export EUPD_CYC=gdas
+++ config.base[286]: EUPD_CYC=gdas
+++ config.base[289]: export gfs_cyc=0
+++ config.base[289]: gfs_cyc=0
+++ config.base[292]: export FHMIN_GFS=0
+++ config.base[292]: FHMIN_GFS=0
+++ config.base[293]: export FHMAX_GFS=120
+++ config.base[293]: FHMAX_GFS=120
+++ config.base[294]: export FHOUT_GFS=3
+++ config.base[294]: FHOUT_GFS=3
+++ config.base[295]: export FHMAX_HF_GFS=0
+++ config.base[295]: FHMAX_HF_GFS=0
+++ config.base[296]: export FHOUT_HF_GFS=1
+++ config.base[296]: FHOUT_HF_GFS=1
+++ config.base[297]: export FHOUT_OCN_GFS=6
+++ config.base[297]: FHOUT_OCN_GFS=6
+++ config.base[298]: export FHOUT_ICE_GFS=6
+++ config.base[298]: FHOUT_ICE_GFS=6
+++ config.base[299]: export FHMIN_WAV=0
+++ config.base[299]: FHMIN_WAV=0
+++ config.base[300]: export FHOUT_WAV=3
+++ config.base[300]: FHOUT_WAV=3
+++ config.base[301]: export FHMAX_HF_WAV=120
+++ config.base[301]: FHMAX_HF_WAV=120
+++ config.base[302]: export FHOUT_HF_WAV=1
+++ config.base[302]: FHOUT_HF_WAV=1
+++ config.base[303]: export FHMAX_WAV=9
+++ config.base[303]: FHMAX_WAV=9
+++ config.base[304]: export FHMAX_WAV_GFS=120
+++ config.base[304]: FHMAX_WAV_GFS=120
+++ config.base[305]: (( gfs_cyc != 0 ))
+++ config.base[308]: export STEP_GFS=0
+++ config.base[308]: STEP_GFS=0
+++ config.base[311]: export ILPOST=1
+++ config.base[311]: ILPOST=1
+++ config.base[312]: (( FHMAX_HF_GFS < 120 ))
+++ config.base[313]: export ILPOST=3
+++ config.base[313]: ILPOST=3
+++ config.base[317]: export restart_interval_gfs=12
+++ config.base[317]: restart_interval_gfs=12
+++ config.base[322]: export QUILTING=.true.
+++ config.base[322]: QUILTING=.true.
+++ config.base[323]: export OUTPUT_GRID=gaussian_grid
+++ config.base[323]: OUTPUT_GRID=gaussian_grid
+++ config.base[324]: export WRITE_DOPOST=.true.
+++ config.base[324]: WRITE_DOPOST=.true.
+++ config.base[325]: export WRITE_NSFLIP=.true.
+++ config.base[325]: WRITE_NSFLIP=.true.
+++ config.base[328]: export DOIAU=YES
+++ config.base[328]: DOIAU=YES
+++ config.base[329]: export IAUFHRS=3,6,9
+++ config.base[329]: IAUFHRS=3,6,9
+++ config.base[330]: export IAU_FHROT=3
+++ config.base[330]: IAU_FHROT=3
+++ config.base[331]: export IAU_DELTHRS=6
+++ config.base[331]: IAU_DELTHRS=6
+++ config.base[332]: export IAU_OFFSET=6
+++ config.base[332]: IAU_OFFSET=6
+++ config.base[333]: export DOIAU_ENKF=YES
+++ config.base[333]: DOIAU_ENKF=YES
+++ config.base[334]: export IAUFHRS_ENKF=3,6,9
+++ config.base[334]: IAUFHRS_ENKF=3,6,9
+++ config.base[335]: export IAU_DELTHRS_ENKF=6
+++ config.base[335]: IAU_DELTHRS_ENKF=6
+++ config.base[338]: export lobsdiag_forenkf=.true.
+++ config.base[338]: lobsdiag_forenkf=.true.
+++ config.base[346]: export imp_physics=8
+++ config.base[346]: imp_physics=8
+++ config.base[350]: export DO_JEDIATMVAR=NO
+++ config.base[350]: DO_JEDIATMVAR=NO
+++ config.base[351]: export DO_JEDIATMENS=NO
+++ config.base[351]: DO_JEDIATMENS=NO
+++ config.base[352]: export DO_JEDIOCNVAR=YES
+++ config.base[352]: DO_JEDIOCNVAR=YES
+++ config.base[353]: export DO_JEDISNOWDA=NO
+++ config.base[353]: DO_JEDISNOWDA=NO
+++ config.base[354]: export DO_MERGENSST=NO
+++ config.base[354]: DO_MERGENSST=NO
+++ config.base[357]: export DOHYBVAR=NO
+++ config.base[357]: DOHYBVAR=NO
+++ config.base[358]: export NMEM_ENS=0
+++ config.base[358]: NMEM_ENS=0
+++ config.base[359]: export SMOOTH_ENKF=NO
+++ config.base[359]: SMOOTH_ENKF=NO
+++ config.base[360]: export l4densvar=.true.
+++ config.base[360]: l4densvar=.true.
+++ config.base[361]: export lwrite4danl=.true.
+++ config.base[361]: lwrite4danl=.true.
+++ config.base[362]: export DO_CALC_INCREMENT=NO
+++ config.base[362]: DO_CALC_INCREMENT=NO
+++ config.base[365]: export NMEM_ENS_GFS=30
+++ config.base[365]: NMEM_ENS_GFS=30
+++ config.base[366]: export NMEM_ENS_GFS_OFFSET=20
+++ config.base[366]: NMEM_ENS_GFS_OFFSET=20
+++ config.base[367]: export DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[367]: DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[370]: [[ NO = \Y\E\S ]]
+++ config.base[384]: [[ NO == \N\O ]]
+++ config.base[384]: [[ YES == \Y\E\S ]]
+++ config.base[385]: export IAUFHRS=6
+++ config.base[385]: IAUFHRS=6
+++ config.base[386]: export IAU_FHROT=3
+++ config.base[386]: IAU_FHROT=3
+++ config.base[387]: export IAU_FILTER_INCREMENTS=.true.
+++ config.base[387]: IAU_FILTER_INCREMENTS=.true.
+++ config.base[388]: export IAUFHRS_ENKF=6
+++ config.base[388]: IAUFHRS_ENKF=6
+++ config.base[392]: export ENKF_SPREAD=YES
+++ config.base[392]: ENKF_SPREAD=YES
+++ config.base[395]: [[ cycled = \c\y\c\l\e\d ]]
+++ config.base[395]: [[ 2021032412 = \2\0\2\1\0\3\2\4\1\8 ]]
+++ config.base[395]: [[ YES = \N\O ]]
+++ config.base[395]: [[ cycled = \f\o\r\e\c\a\s\t\-\o\n\l\y ]]
+++ config.base[401]: [[ YES = \N\O ]]
+++ config.base[405]: [[ YES == \Y\E\S ]]
+++ config.base[406]: export restart_interval_enkfgdas=3
+++ config.base[406]: restart_interval_enkfgdas=3
+++ config.base[411]: export restart_interval_enkfgfs=3
+++ config.base[411]: restart_interval_enkfgfs=3
+++ config.base[413]: [[ YES == \Y\E\S ]]
+++ config.base[414]: export restart_interval_gdas=3
+++ config.base[414]: restart_interval_gdas=3
+++ config.base[419]: export GSI_SOILANAL=NO
+++ config.base[419]: GSI_SOILANAL=NO
+++ config.base[422]: export DONST=YES
+++ config.base[422]: DONST=YES
+++ config.base[423]: [[ YES = \Y\E\S ]]
+++ config.base[423]: export 'FNTSFA= '
+++ config.base[423]: FNTSFA=' '
+++ config.base[426]: export nst_anl=.true.
+++ config.base[426]: nst_anl=.true.
+++ config.base[429]: export MAKE_NSSTBUFR=NO
+++ config.base[429]: MAKE_NSSTBUFR=NO
+++ config.base[432]: export MAKE_ACFTBUFR=NO
+++ config.base[432]: MAKE_ACFTBUFR=NO
+++ config.base[435]: export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[435]: INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[438]: export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[438]: INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[439]: export INCVARS_EFOLD=5
+++ config.base[439]: INCVARS_EFOLD=5
+++ config.base[444]: export netcdf_diag=.true.
+++ config.base[444]: netcdf_diag=.true.
+++ config.base[445]: export binary_diag=.false.
+++ config.base[445]: binary_diag=.false.
+++ config.base[448]: export DO_METP=NO
+++ config.base[448]: DO_METP=NO
+++ config.base[449]: export DO_FIT2OBS=YES
+++ config.base[449]: DO_FIT2OBS=YES
+++ config.base[450]: export DO_VRFY_OCEANDA=NO
+++ config.base[450]: DO_VRFY_OCEANDA=NO
+++ config.base[453]: export FHMAX_FITS=132
+++ config.base[453]: FHMAX_FITS=132
+++ config.base[454]: [[ 132 -gt 120 ]]
+++ config.base[454]: export FHMAX_FITS=120
+++ config.base[454]: FHMAX_FITS=120
+++ config.base[457]: export HPSSARCH=YES
+++ config.base[457]: HPSSARCH=YES
+++ config.base[458]: export LOCALARCH=NO
+++ config.base[458]: LOCALARCH=NO
+++ config.base[459]: [[ YES = \Y\E\S ]]
+++ config.base[459]: [[ NO = \Y\E\S ]]
+++ config.base[463]: export ARCH_CYC=00
+++ config.base[463]: ARCH_CYC=00
+++ config.base[464]: export ARCH_WARMICFREQ=4
+++ config.base[464]: ARCH_WARMICFREQ=4
+++ config.base[465]: export ARCH_FCSTICFREQ=1
+++ config.base[465]: ARCH_FCSTICFREQ=1
+++ config.base[468]: [[ NO = \Y\E\S ]]
+++ config.base[475]: export REPLAY_ICS=NO
+++ config.base[475]: REPLAY_ICS=NO
+++ config.base[476]: export OFFSET_START_HOUR=0
+++ config.base[476]: OFFSET_START_HOUR=0
+++ config.base[479]: export NUM_SND_COLLECTIVES=9
+++ config.base[479]: NUM_SND_COLLECTIVES=9
+++ config.base[481]: echo 'END: config.base'
END: config.base
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[97]: for config in "${configs[@]:-''}"
++ jjob_header.sh[98]: source /scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95/config.prepoceanobs
+++ config.prepoceanobs[5]: echo 'BEGIN: config.prepoceanobs'
BEGIN: config.prepoceanobs
+++ config.prepoceanobs[7]: export OCNOBS2IODAEXEC=/scratch1/NCEPDEV/global/CI/2700/gfs/sorc/gdas.cd/build/bin/gdas_obsprovider2ioda.x
+++ config.prepoceanobs[7]: OCNOBS2IODAEXEC=/scratch1/NCEPDEV/global/CI/2700/gfs/sorc/gdas.cd/build/bin/gdas_obsprovider2ioda.x
+++ config.prepoceanobs[9]: export SOCA_INPUT_FIX_DIR=/scratch2/NCEPDEV/ocean/Guillaume.Vernieres/data/static/72x35x25/soca
+++ config.prepoceanobs[9]: SOCA_INPUT_FIX_DIR=/scratch2/NCEPDEV/ocean/Guillaume.Vernieres/data/static/72x35x25/soca
+++ config.prepoceanobs[11]: export OBS_YAML_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/config
+++ config.prepoceanobs[11]: OBS_YAML_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/config
+++ config.prepoceanobs[12]: export OBSPREP_YAML=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obsprep/obsprep_config.yaml
+++ config.prepoceanobs[12]: OBSPREP_YAML=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obsprep/obsprep_config.yaml
+++ config.prepoceanobs[13]: export OBS_LIST=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/obs_list.yaml
+++ config.prepoceanobs[13]: OBS_LIST=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/obs_list.yaml
+++ config.prepoceanobs[14]: export OBS_YAML=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/obs_list.yaml
+++ config.prepoceanobs[14]: OBS_YAML=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/soca/obs/obs_list.yaml
+++ config.prepoceanobs[17]: export DMPDIR=/scratch1/NCEPDEV/global/glopara/data/experimental_obs
+++ config.prepoceanobs[17]: DMPDIR=/scratch1/NCEPDEV/global/glopara/data/experimental_obs
+++ config.prepoceanobs[20]: export JSON_TMPL_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/ioda/bufr2ioda
+++ config.prepoceanobs[20]: JSON_TMPL_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/parm/gdas/ioda/bufr2ioda
+++ config.prepoceanobs[21]: export BUFR2IODA_PY_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/ush
+++ config.prepoceanobs[21]: BUFR2IODA_PY_DIR=/scratch1/NCEPDEV/global/CI/2700/gfs/ush
+++ config.prepoceanobs[24]: . /scratch1/NCEPDEV/global/CI/2700/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_7cc86d95/config.resources prepoceanobs
++++ config.resources[7]: (( 1 != 1 ))
++++ config.resources[31]: step=prepoceanobs
++++ config.resources[33]: echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[35]: case ${machine} in
++++ config.resources[37]: npe_node_max=40
++++ config.resources[72]: export npe_node_max
++++ config.resources[74]: case ${step} in
++++ config.resources[387]: export wtime_prepoceanobs=00:10:00
++++ config.resources[387]: wtime_prepoceanobs=00:10:00
++++ config.resources[388]: export npe_prepoceanobs=1
++++ config.resources[388]: npe_prepoceanobs=1
++++ config.resources[389]: export nth_prepoceanobs=1
++++ config.resources[389]: nth_prepoceanobs=1
++++ config.resources[390]: export npe_node_prepoceanobs=40
++++ config.resources[390]: npe_node_prepoceanobs=40
++++ config.resources[391]: export memory_prepoceanobs=48GB
++++ config.resources[391]: memory_prepoceanobs=48GB
++++ config.resources[1310]: echo 'END: config.resources'
END: config.resources
+++ config.prepoceanobs[25]: echo 'END: config.prepoceanobs'
END: config.prepoceanobs
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[110]: source /scratch1/NCEPDEV/global/CI/2700/gfs/env/HERA.env prepoceanobs
+++ HERA.env[3]: [[ 1 -ne 1 ]]
+++ HERA.env[15]: step=prepoceanobs
+++ HERA.env[17]: export 'launcher=srun -l --export=ALL'
+++ HERA.env[17]: launcher='srun -l --export=ALL'
+++ HERA.env[18]: export 'mpmd_opt=--multi-prog --output=mpmd.%j.%t.out'
+++ HERA.env[18]: mpmd_opt='--multi-prog --output=mpmd.%j.%t.out'
+++ HERA.env[29]: export OMP_STACKSIZE=2048000
+++ HERA.env[29]: OMP_STACKSIZE=2048000
+++ HERA.env[30]: export NTHSTACK=1024000000
+++ HERA.env[30]: NTHSTACK=1024000000
+++ HERA.env[34]: [[ -n 62226923 ]]
+++ HERA.env[35]: ulimit -s unlimited
+++ HERA.env[36]: ulimit -a
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 1541221
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) 50331648
open files (-n) 131072
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 1541221
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
+++ HERA.env[39]: [[ prepoceanobs = \p\r\e\p ]]
+++ HERA.env[39]: [[ prepoceanobs = \p\r\e\p\b\u\f\r ]]
+++ HERA.env[48]: [[ prepoceanobs = \p\r\e\p\s\n\o\w\o\b\s ]]
+++ HERA.env[52]: [[ prepoceanobs = \p\r\e\p\_\e\m\i\s\s\i\o\n\s ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\i\n\i\t ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\p\r\e\p ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\p\o\s\t\s\b\s ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\p\o\s\t\b\n\d\p\n\t ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\p\o\s\t\b\n\d\p\n\t\b\l\l ]]
+++ HERA.env[56]: [[ prepoceanobs = \w\a\v\e\p\o\s\t\p\n\t ]]
+++ HERA.env[63]: [[ prepoceanobs = \a\t\m\a\n\l\v\a\r ]]
+++ HERA.env[71]: [[ prepoceanobs = \a\t\m\e\n\s\a\n\l\l\e\t\k\f ]]
+++ HERA.env[79]: [[ prepoceanobs = \a\t\m\e\n\s\a\n\l\f\v\3\i\n\c ]]
+++ HERA.env[87]: [[ prepoceanobs = \a\e\r\o\a\n\l\r\u\n ]]
+++ HERA.env[97]: [[ prepoceanobs = \a\t\m\a\n\l\f\v\3\i\n\c ]]
+++ HERA.env[105]: [[ prepoceanobs = \p\r\e\p\o\b\s\a\e\r\o ]]
+++ HERA.env[112]: [[ prepoceanobs = \s\n\o\w\a\n\l ]]
+++ HERA.env[122]: [[ prepoceanobs = \o\c\n\a\n\a\l\b\m\a\t ]]
+++ HERA.env[128]: [[ prepoceanobs = \o\c\n\a\n\a\l\r\u\n ]]
+++ HERA.env[134]: [[ prepoceanobs = \o\c\n\a\n\a\l\c\h\k\p\t ]]
+++ HERA.env[140]: [[ prepoceanobs = \o\c\n\a\n\a\l\e\c\e\n ]]
+++ HERA.env[148]: [[ prepoceanobs = \o\c\n\a\n\a\l\l\e\t\k\f ]]
+++ HERA.env[156]: [[ prepoceanobs = \a\n\a\l ]]
+++ HERA.env[156]: [[ prepoceanobs = \a\n\a\l\c\a\l\c ]]
+++ HERA.env[184]: [[ prepoceanobs = \s\f\c\a\n\l ]]
+++ HERA.env[193]: [[ prepoceanobs = \e\o\b\s ]]
+++ HERA.env[208]: [[ prepoceanobs = \e\u\p\d ]]
+++ HERA.env[220]: [[ prepoceanobs = \f\c\s\t ]]
+++ HERA.env[220]: [[ prepoceanobs = \e\f\c\s ]]
+++ HERA.env[236]: [[ prepoceanobs = \u\p\p ]]
+++ HERA.env[244]: [[ prepoceanobs = \a\t\m\o\s\_\p\r\o\d\u\c\t\s ]]
+++ HERA.env[248]: [[ prepoceanobs = \o\c\e\a\n\i\c\e\_\p\r\o\d\u\c\t\s ]]
+++ HERA.env[255]: [[ prepoceanobs = \e\c\e\n ]]
+++ HERA.env[271]: [[ prepoceanobs = \e\s\f\c ]]
+++ HERA.env[283]: [[ prepoceanobs = \e\p\o\s ]]
+++ HERA.env[291]: [[ prepoceanobs = \p\o\s\t\s\n\d ]]
+++ HERA.env[305]: [[ prepoceanobs = \a\w\i\p\s ]]
+++ HERA.env[313]: [[ prepoceanobs = \g\e\m\p\a\k ]]
+++ HERA.env[326]: [[ prepoceanobs = \f\i\t\2\o\b\s ]]
++ jjob_header.sh[111]: status=0
++ jjob_header.sh[112]: (( status != 0 ))
+ JGLOBAL_PREP_OCEAN_OBS[10]: export COMIN_OBS=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
+ JGLOBAL_PREP_OCEAN_OBS[10]: COMIN_OBS=/scratch1/NCEPDEV/stmp2/Terry.McGuinness/RUNDIRS/C48mx500_3DVarAOWCDA_7cc86d95/prepoceanobs.329436
+ JGLOBAL_PREP_OCEAN_OBS[11]: YMD=20210324
+ JGLOBAL_PREP_OCEAN_OBS[11]: HH=18
+ JGLOBAL_PREP_OCEAN_OBS[11]: declare_from_tmpl -rx COMOUT_OBS:COM_OBS_TMPL
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COMOUT_OBS=/scratch1/NCEPDEV/global/CI/2700/RUNTESTS/COMROOT/C48mx500_3DVarAOWCDA_7cc86d95/gdas.20210324/18/obs
+ JGLOBAL_PREP_OCEAN_OBS[20]: EXSCRIPT=/scratch1/NCEPDEV/global/CI/2700/gfs/scripts/exglobal_prep_ocean_obs.py
+ JGLOBAL_PREP_OCEAN_OBS[21]: /scratch1/NCEPDEV/global/CI/2700/gfs/scripts/exglobal_prep_ocean_obs.py
Traceback (most recent call last):
File "/scratch1/NCEPDEV/global/CI/2700/gfs/scripts/exglobal_prep_ocean_obs.py", line 7, in <module>
from wxflow import Logger, cast_strdict_as_dtypedict
ModuleNotFoundError: No module named 'wxflow'
+ JGLOBAL_PREP_OCEAN_OBS[22]: status=1
+ JGLOBAL_PREP_OCEAN_OBS[23]: [[ 1 -ne 0 ]]
+ JGLOBAL_PREP_OCEAN_OBS[23]: exit 1
+ JGLOBAL_PREP_OCEAN_OBS[1]: postamble JGLOBAL_PREP_OCEAN_OBS 1718995689 1
+ preamble.sh[70]: set +x
End JGLOBAL_PREP_OCEAN_OBS at 18:48:26 with error code 1 (time elapsed: 00:00:17)
+ prepoceanobs.sh[23]: status=1
+ prepoceanobs.sh[24]: exit 1
+ prepoceanobs.sh[1]: postamble prepoceanobs.sh 1718995663 1
+ preamble.sh[70]: set +x
End prepoceanobs.sh at 18:48:26 with error code 1 (time elapsed: 00:00:43)
_______________________________________________________________
Start Epilog on node h32m49 for job 62226923 :: Fri Jun 21 18:48:27 UTC 2024
Job 62226923 finished for user Terry.McGuinness in partition hera with exit code 1:0
_______________________________________________________________
End Epilogue Fri Jun 21 18:48:27 UTC 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment