Skip to content

Instantly share code, notes, and snippets.

@emcbot

emcbot/gfsatmos_prod_f072-f078.log

Created May 16, 2024 15:25
Show Gist options
  • Save emcbot/1b303a7e1c4471158c689c7310011910 to your computer and use it in GitHub Desktop.
Save emcbot/1b303a7e1c4471158c689c7310011910 to your computer and use it in GitHub Desktop.
Download ZIP
error log file from CI run PR_2564
Raw
gfsatmos_prod_f072-f078.log
Begin atmos_products.sh at Thu May 16 09:51:05 UTC 2024
+ atmos_products.sh[11]: . /work2/noaa/stmp/CI/ORION/2564/gfs/ush/load_fv3gfs_modules.sh
++ load_fv3gfs_modules.sh[4]: [[ NO == \N\O ]]
++ load_fv3gfs_modules.sh[5]: echo 'Loading modules quietly...'
Loading modules quietly...
++ load_fv3gfs_modules.sh[6]: set +x
Currently Loaded Modules:
1) intel/2022.1.2 41) g2tmpl/1.10.2
2) stack-intel/2022.0.2 42) gsi-ncdiag/1.1.2
3) impi/2022.1.2 43) crtm-fix/2.4.0.1_emc
4) stack-intel-oneapi-mpi/2021.5.1 44) git-lfs/2.12.0
5) gettext/0.19.8.1 45) crtm/2.4.0.1
6) libxcrypt/4.4.35 46) openblas/0.3.24
7) zlib/1.2.13 47) py-setuptools/63.4.3
8) sqlite/3.43.2 48) py-numpy/1.23.4
9) util-linux-uuid/2.38.1 49) bufr/11.7.0
10) python/3.11.6 50) gmake/3.82
11) gempak/7.5.1 51) wgrib2/2.0.8
12) ncl/6.6.2 52) py-f90nml/1.4.3
13) libjpeg/2.1.0 53) py-cftime/1.0.3.4
14) jasper/2.0.32 54) py-netcdf4/1.5.8
15) libpng/1.6.37 55) libyaml/0.2.5
16) openjpeg/2.3.1 56) py-pyyaml/6.0
17) eccodes/2.32.0 57) py-markupsafe/2.1.3
18) fftw/3.3.10 58) py-jinja2/3.1.2
19) nghttp2/1.57.0 59) py-bottleneck/1.3.7
20) curl/8.4.0 60) py-numexpr/2.8.4
21) proj/9.2.1 61) py-et-xmlfile/1.0.1
22) udunits/2.2.28 62) py-openpyxl/3.1.2
23) cdo/2.0.5 63) py-pytz/2023.3
24) snappy/1.1.10 64) py-pyxlsb/1.0.10
25) zstd/1.5.2 65) py-xlrd/2.0.1
26) c-blosc/1.21.5 66) py-xlsxwriter/3.1.7
27) pkg-config/0.27.1 67) py-xlwt/1.3.0
28) hdf5/1.14.0 68) py-pandas/1.5.3
29) netcdf-c/4.9.2 69) py-six/1.16.0
30) netcdf-fortran/4.6.1 70) py-python-dateutil/2.8.2
31) antlr/2.7.7 71) g2c/1.6.4
32) gsl/2.7.1 72) netcdf-cxx4/4.3.1
33) nco/5.0.6 73) met/9.1.3
34) bacio/2.4.1 74) metplus/3.1.1
35) w3emc/2.10.0 75) py-packaging/23.1
36) prod_util/2.1.1 76) py-xarray/2023.7.0
37) g2/3.4.5 77) prepobs/1.0.1
38) sp/2.5.0 78) fit2obs/1.1.1
39) ip/4.3.0 79) module_base.orion
40) grib-util/1.3.0
+ atmos_products.sh[12]: status=0
+ atmos_products.sh[13]: (( status != 0 ))
+ atmos_products.sh[15]: export job=atmos_products
+ atmos_products.sh[15]: job=atmos_products
+ atmos_products.sh[16]: export jobid=atmos_products.188958
+ atmos_products.sh[16]: jobid=atmos_products.188958
+ atmos[20]: IFS=_
+ atmos[20]: read -ra fhrs
+ atmos_products.sh[24]: for fhr in '"${fhrs[@]}"'
+ atmos_products.sh[27]: fhr=10#072
+ atmos_products.sh[28]: fhr=10#072
+ atmos_products.sh[29]: export FORECAST_HOUR=72
+ atmos_products.sh[29]: FORECAST_HOUR=72
+ atmos_products.sh[30]: /work2/noaa/stmp/CI/ORION/2564/gfs/jobs/JGLOBAL_ATMOS_PRODUCTS
Begin JGLOBAL_ATMOS_PRODUCTS at Thu May 16 09:51:27 UTC 2024
+ JGLOBAL_ATMOS_PRODUCTS[4]: source /work2/noaa/stmp/CI/ORION/2564/gfs/ush/jjob_header.sh -e atmos_products -c 'base atmos_products'
++ jjob_header.sh[44]: OPTIND=1
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[48]: env_job=atmos_products
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[46]: case "${option}" in
++ jjob_header.sh[47]: read -ra configs
++ jjob_header.sh[45]: getopts c:e: option
++ jjob_header.sh[59]: shift 4
++ jjob_header.sh[61]: [[ -z atmos_products ]]
++ jjob_header.sh[69]: export DATA=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
++ jjob_header.sh[69]: DATA=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
++ jjob_header.sh[70]: [[ YES == \Y\E\S ]]
++ jjob_header.sh[71]: rm -rf /work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
++ jjob_header.sh[73]: mkdir -p /work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
++ jjob_header.sh[74]: cd /work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
++ jjob_header.sh[80]: export cycle=t00z
++ jjob_header.sh[80]: cycle=t00z
++ jjob_header.sh[81]: setpdy.sh
sed: can't read /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/date/t00z: No such file or directory
completed cleanly
completed cleanly
Source PDY script to export PDYm7, ..., PDY, ..., PDYp7 variables.
++ jjob_header.sh[82]: source ./PDY
+++ PDY[1]: export PDYm7=20211214
+++ PDY[1]: PDYm7=20211214
+++ PDY[2]: export PDYm6=20211215
+++ PDY[2]: PDYm6=20211215
+++ PDY[3]: export PDYm5=20211216
+++ PDY[3]: PDYm5=20211216
+++ PDY[4]: export PDYm4=20211217
+++ PDY[4]: PDYm4=20211217
+++ PDY[5]: export PDYm3=20211218
+++ PDY[5]: PDYm3=20211218
+++ PDY[6]: export PDYm2=20211219
+++ PDY[6]: PDYm2=20211219
+++ PDY[7]: export PDYm1=20211220
+++ PDY[7]: PDYm1=20211220
+++ PDY[8]: export PDY=20211221
+++ PDY[8]: PDY=20211221
+++ PDY[9]: export PDYp1=20211222
+++ PDY[9]: PDYp1=20211222
+++ PDY[10]: export PDYp2=20211223
+++ PDY[10]: PDYp2=20211223
+++ PDY[11]: export PDYp3=20211224
+++ PDY[11]: PDYp3=20211224
+++ PDY[12]: export PDYp4=20211225
+++ PDY[12]: PDYp4=20211225
+++ PDY[13]: export PDYp5=20211226
+++ PDY[13]: PDYp5=20211226
+++ PDY[14]: export PDYp6=20211227
+++ PDY[14]: PDYp6=20211227
+++ PDY[15]: export PDYp7=20211228
+++ PDY[15]: PDYp7=20211228
++ jjob_header.sh[88]: export pid=189383
++ jjob_header.sh[88]: pid=189383
++ jjob_header.sh[89]: export pgmout=OUTPUT.189383
++ jjob_header.sh[89]: pgmout=OUTPUT.189383
++ jjob_header.sh[90]: export pgmerr=errfile
++ jjob_header.sh[90]: pgmerr=errfile
++ jjob_header.sh[96]: export EXPDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225
++ jjob_header.sh[96]: EXPDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225
++ jjob_header.sh[97]: for config in '"${configs[@]:-'\'''\''}"'
++ jjob_header.sh[98]: source /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225/config.base
+++ config.base[6]: echo 'BEGIN: config.base'
BEGIN: config.base
+++ config.base[9]: export machine=ORION
+++ config.base[9]: machine=ORION
+++ config.base[12]: export RUN_ENVIR=emc
+++ config.base[12]: RUN_ENVIR=emc
+++ config.base[15]: export ACCOUNT=nems
+++ config.base[15]: ACCOUNT=nems
+++ config.base[16]: export QUEUE=batch
+++ config.base[16]: QUEUE=batch
+++ config.base[17]: export QUEUE_SERVICE=batch
+++ config.base[17]: QUEUE_SERVICE=batch
+++ config.base[18]: export PARTITION_BATCH=orion
+++ config.base[18]: PARTITION_BATCH=orion
+++ config.base[19]: export PARTITION_SERVICE=service
+++ config.base[19]: PARTITION_SERVICE=service
+++ config.base[22]: export HPSS_PROJECT=emc-global
+++ config.base[22]: HPSS_PROJECT=emc-global
+++ config.base[25]: export HOMEgfs=/work2/noaa/stmp/CI/ORION/2564/gfs
+++ config.base[25]: HOMEgfs=/work2/noaa/stmp/CI/ORION/2564/gfs
+++ config.base[26]: export EXECgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/exec
+++ config.base[26]: EXECgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/exec
+++ config.base[27]: export FIXgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/fix
+++ config.base[27]: FIXgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/fix
+++ config.base[28]: export PARMgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/parm
+++ config.base[28]: PARMgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/parm
+++ config.base[29]: export SCRgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/scripts
+++ config.base[29]: SCRgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/scripts
+++ config.base[30]: export USHgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/ush
+++ config.base[30]: USHgfs=/work2/noaa/stmp/CI/ORION/2564/gfs/ush
+++ config.base[32]: export FIXam=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/am
+++ config.base[32]: FIXam=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/am
+++ config.base[33]: export FIXaer=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/aer
+++ config.base[33]: FIXaer=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/aer
+++ config.base[34]: export FIXcpl=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/cpl
+++ config.base[34]: FIXcpl=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/cpl
+++ config.base[35]: export FIXlut=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/lut
+++ config.base[35]: FIXlut=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/lut
+++ config.base[36]: export FIXorog=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/orog
+++ config.base[36]: FIXorog=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/orog
+++ config.base[37]: export FIXcice=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/cice
+++ config.base[37]: FIXcice=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/cice
+++ config.base[38]: export FIXmom=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/mom6
+++ config.base[38]: FIXmom=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/mom6
+++ config.base[39]: export FIXreg2grb2=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/reg2grb2
+++ config.base[39]: FIXreg2grb2=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/reg2grb2
+++ config.base[40]: export FIXugwd=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/ugwd
+++ config.base[40]: FIXugwd=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/ugwd
+++ config.base[41]: export FIXgdas=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/gdas
+++ config.base[41]: FIXgdas=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/gdas
+++ config.base[46]: export PACKAGEROOT=/work/noaa/global/glopara/nwpara
+++ config.base[46]: PACKAGEROOT=/work/noaa/global/glopara/nwpara
+++ config.base[47]: export COMROOT=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT
+++ config.base[47]: COMROOT=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT
+++ config.base[48]: export COMINsyn=/work/noaa/global/glopara/com/gfs/prod/syndat
+++ config.base[48]: COMINsyn=/work/noaa/global/glopara/com/gfs/prod/syndat
+++ config.base[49]: export DMPDIR=/work/noaa/rstprod/dump
+++ config.base[49]: DMPDIR=/work/noaa/rstprod/dump
+++ config.base[50]: export BASE_CPLIC=/work/noaa/global/glopara/data/ICSDIR/prototype_ICs
+++ config.base[50]: BASE_CPLIC=/work/noaa/global/glopara/data/ICSDIR/prototype_ICs
+++ config.base[54]: export COMINecmwf=/work/noaa/global/glopara/data/external_gempak/ecmwf
+++ config.base[54]: COMINecmwf=/work/noaa/global/glopara/data/external_gempak/ecmwf
+++ config.base[55]: export COMINnam=/work/noaa/global/glopara/data/external_gempak/nam
+++ config.base[55]: COMINnam=/work/noaa/global/glopara/data/external_gempak/nam
+++ config.base[56]: export COMINukmet=/work/noaa/global/glopara/data/external_gempak/ukmet
+++ config.base[56]: COMINukmet=/work/noaa/global/glopara/data/external_gempak/ukmet
+++ config.base[59]: export HOMEDIR=/work/noaa/global/mterry
+++ config.base[59]: HOMEDIR=/work/noaa/global/mterry
+++ config.base[60]: export STMP=/work/noaa/stmp/mterry
+++ config.base[60]: STMP=/work/noaa/stmp/mterry
+++ config.base[61]: export PTMP=/work/noaa/stmp/mterry
+++ config.base[61]: PTMP=/work/noaa/stmp/mterry
+++ config.base[62]: export NOSCRUB=/work/noaa/global/mterry
+++ config.base[62]: NOSCRUB=/work/noaa/global/mterry
+++ config.base[65]: export BASE_GIT=/work/noaa/global/glopara/git
+++ config.base[65]: BASE_GIT=/work/noaa/global/glopara/git
+++ config.base[68]: export DO_GOES=NO
+++ config.base[68]: DO_GOES=NO
+++ config.base[69]: export DO_BUFRSND=NO
+++ config.base[69]: DO_BUFRSND=NO
+++ config.base[70]: export DO_GEMPAK=NO
+++ config.base[70]: DO_GEMPAK=NO
+++ config.base[71]: export DO_AWIPS=NO
+++ config.base[71]: DO_AWIPS=NO
+++ config.base[72]: export DO_NPOESS=NO
+++ config.base[72]: DO_NPOESS=NO
+++ config.base[73]: export DO_TRACKER=YES
+++ config.base[73]: DO_TRACKER=YES
+++ config.base[74]: export DO_GENESIS=YES
+++ config.base[74]: DO_GENESIS=YES
+++ config.base[75]: export DO_GENESIS_FSU=NO
+++ config.base[75]: DO_GENESIS_FSU=NO
+++ config.base[76]: export DO_VERFOZN=YES
+++ config.base[76]: DO_VERFOZN=YES
+++ config.base[77]: export DO_VERFRAD=YES
+++ config.base[77]: DO_VERFRAD=YES
+++ config.base[78]: export DO_VMINMON=YES
+++ config.base[78]: DO_VMINMON=YES
+++ config.base[79]: export DO_MOS=NO
+++ config.base[79]: DO_MOS=NO
+++ config.base[85]: export REALTIME=YES
+++ config.base[85]: REALTIME=YES
+++ config.base[88]: export MODE=cycled
+++ config.base[88]: MODE=cycled
+++ config.base[97]: export FIXgsi=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/gsi
+++ config.base[97]: FIXgsi=/work2/noaa/stmp/CI/ORION/2564/gfs/fix/gsi
+++ config.base[98]: export HOMEpost=/work2/noaa/stmp/CI/ORION/2564/gfs
+++ config.base[98]: HOMEpost=/work2/noaa/stmp/CI/ORION/2564/gfs
+++ config.base[99]: export HOMEobsproc=/work/noaa/global/glopara/git/obsproc/v1.1.2
+++ config.base[99]: HOMEobsproc=/work/noaa/global/glopara/git/obsproc/v1.1.2
+++ config.base[102]: export 'NCP=/bin/cp -p'
+++ config.base[102]: NCP='/bin/cp -p'
+++ config.base[103]: export NMV=/bin/mv
+++ config.base[103]: NMV=/bin/mv
+++ config.base[104]: export 'NLN=/bin/ln -sf'
+++ config.base[104]: NLN='/bin/ln -sf'
+++ config.base[105]: export VERBOSE=YES
+++ config.base[105]: VERBOSE=YES
+++ config.base[106]: export KEEPDATA=NO
+++ config.base[106]: KEEPDATA=NO
+++ config.base[107]: export DEBUG_POSTSCRIPT=NO
+++ config.base[107]: DEBUG_POSTSCRIPT=NO
+++ config.base[108]: export CHGRP_RSTPROD=YES
+++ config.base[108]: CHGRP_RSTPROD=YES
+++ config.base[109]: export 'CHGRP_CMD=chgrp rstprod'
+++ config.base[109]: CHGRP_CMD='chgrp rstprod'
+++ config.base[110]: export NCDUMP=/work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.6.0/envs/unified-env/install/intel/2022.0.2/netcdf-c-4.9.2-4g3gg4n/bin/ncdump
+++ config.base[110]: NCDUMP=/work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.6.0/envs/unified-env/install/intel/2022.0.2/netcdf-c-4.9.2-4g3gg4n/bin/ncdump
+++ config.base[111]: export NCLEN=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/getncdimlen
+++ config.base[111]: NCLEN=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/getncdimlen
+++ config.base[114]: export BASE_ENV=/work2/noaa/stmp/CI/ORION/2564/gfs/env
+++ config.base[114]: BASE_ENV=/work2/noaa/stmp/CI/ORION/2564/gfs/env
+++ config.base[115]: export BASE_JOB=/work2/noaa/stmp/CI/ORION/2564/gfs/jobs/rocoto
+++ config.base[115]: BASE_JOB=/work2/noaa/stmp/CI/ORION/2564/gfs/jobs/rocoto
+++ config.base[118]: export SDATE=2021122018
+++ config.base[118]: SDATE=2021122018
+++ config.base[119]: export EDATE=2021122106
+++ config.base[119]: EDATE=2021122106
+++ config.base[120]: export EXP_WARM_START=.false.
+++ config.base[120]: EXP_WARM_START=.false.
+++ config.base[121]: export assim_freq=6
+++ config.base[121]: assim_freq=6
+++ config.base[122]: export PSLOT=C96_atm3DVar_f8846225
+++ config.base[122]: PSLOT=C96_atm3DVar_f8846225
+++ config.base[123]: export EXPDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225
+++ config.base[123]: EXPDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225
+++ config.base[124]: export ROTDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225
+++ config.base[124]: ROTDIR=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225
+++ config.base[125]: export ROTDIR_DUMP=YES
+++ config.base[125]: ROTDIR_DUMP=YES
+++ config.base[126]: export DUMP_SUFFIX=
+++ config.base[126]: DUMP_SUFFIX=
+++ config.base[127]: [[ 2021122100 -ge 2019092100 ]]
+++ config.base[127]: [[ 2021122100 -le 2019110700 ]]
+++ config.base[130]: export DATAROOT=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225
+++ config.base[130]: DATAROOT=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225
+++ config.base[131]: export RUNDIR=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225
+++ config.base[131]: RUNDIR=/work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225
+++ config.base[132]: export ARCDIR=/work/noaa/global/mterry/archive/C96_atm3DVar_f8846225
+++ config.base[132]: ARCDIR=/work/noaa/global/mterry/archive/C96_atm3DVar_f8846225
+++ config.base[133]: export ATARDIR=/work/noaa/global/mterry/archive_rotdir/C96_atm3DVar_f8846225
+++ config.base[133]: ATARDIR=/work/noaa/global/mterry/archive_rotdir/C96_atm3DVar_f8846225
+++ config.base[136]: export envir=prod
+++ config.base[136]: envir=prod
+++ config.base[137]: export NET=gfs
+++ config.base[137]: NET=gfs
+++ config.base[138]: export RUN=gfs
+++ config.base[138]: RUN=gfs
+++ config.base[144]: source /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225/config.com
++++ config.com[4]: echo 'BEGIN: config.com'
BEGIN: config.com
++++ config.com[37]: [[ emc == \n\c\o ]]
++++ config.com[41]: COM_OBS_TMPL='${ROTDIR}/${RUN}.${YMD}/${HH}/obs'
++++ config.com[42]: COM_RTOFS_TMPL='${DMPDIR}'
++++ config.com[44]: declare -rx COM_OBS_TMPL COM_RTOFS_TMPL
++++ config.com[45]: declare -rx 'COM_OBSDMP_TMPL=${DMPDIR}/${DUMP}${DUMP_SUFFIX}.${YMD}/${HH}/atmos'
++++ config.com[47]: COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}'
++++ config.com[49]: declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}'
++++ config.com[51]: declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf'
++++ config.com[52]: declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/input'
++++ config.com[53]: declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/restart'
++++ config.com[54]: declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos'
++++ config.com[55]: declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow'
++++ config.com[56]: declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/history'
++++ config.com[57]: declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/atmos/master'
++++ config.com[58]: declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2'
++++ config.com[59]: declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}'
++++ config.com[60]: declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr'
++++ config.com[61]: declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}'
++++ config.com[62]: declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital'
++++ config.com[63]: declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks'
++++ config.com[64]: declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim'
++++ config.com[65]: declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery'
++++ config.com[66]: declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon'
++++ config.com[67]: declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon'
++++ config.com[68]: declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon'
++++ config.com[69]: declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo'
++++ config.com[71]: declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/restart'
++++ config.com[72]: declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/prep'
++++ config.com[73]: declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/wave/history'
++++ config.com[74]: declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded'
++++ config.com[75]: declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station'
++++ config.com[76]: declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak'
++++ config.com[77]: declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo'
++++ config.com[79]: declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/history'
++++ config.com[80]: declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/restart'
++++ config.com[81]: declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ocean/input'
++++ config.com[82]: declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean'
++++ config.com[83]: declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf'
++++ config.com[84]: declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2'
++++ config.com[85]: declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}'
++++ config.com[87]: declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/input'
++++ config.com[88]: declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/history'
++++ config.com[89]: declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/ice/restart'
++++ config.com[90]: declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf'
++++ config.com[91]: declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2'
++++ config.com[92]: declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}'
++++ config.com[94]: declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/chem/history'
++++ config.com[95]: declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem'
++++ config.com[97]: declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model_data/med/restart'
+++ config.base[147]: export 'ERRSCRIPT=eval [[ $err = 0 ]]'
+++ config.base[147]: ERRSCRIPT='eval [[ $err = 0 ]]'
+++ config.base[148]: export LOGSCRIPT=
+++ config.base[148]: LOGSCRIPT=
+++ config.base[151]: export 'REDOUT=1>'
+++ config.base[151]: REDOUT='1>'
+++ config.base[152]: export 'REDERR=2>'
+++ config.base[152]: REDERR='2>'
+++ config.base[154]: export SENDECF=NO
+++ config.base[154]: SENDECF=NO
+++ config.base[155]: export SENDSDM=NO
+++ config.base[155]: SENDSDM=NO
+++ config.base[156]: export SENDDBN_NTC=NO
+++ config.base[156]: SENDDBN_NTC=NO
+++ config.base[157]: export SENDDBN=NO
+++ config.base[157]: SENDDBN=NO
+++ config.base[158]: export DBNROOT=/work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.6.0/envs/unified-env/install/intel/2022.0.2/prod-util-2.1.1-hevcp3q/fakedbn
+++ config.base[158]: DBNROOT=/work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.6.0/envs/unified-env/install/intel/2022.0.2/prod-util-2.1.1-hevcp3q/fakedbn
+++ config.base[161]: export APP=ATM
+++ config.base[161]: APP=ATM
+++ config.base[163]: shopt -s extglob
+++ config.base[165]: case "${RUN}" in
+++ config.base[167]: APP=ATM
+++ config.base[175]: shopt -u extglob
+++ config.base[178]: export DO_ATM=YES
+++ config.base[178]: DO_ATM=YES
+++ config.base[179]: export DO_COUPLED=NO
+++ config.base[179]: DO_COUPLED=NO
+++ config.base[180]: export DO_WAVE=NO
+++ config.base[180]: DO_WAVE=NO
+++ config.base[181]: export DO_OCN=NO
+++ config.base[181]: DO_OCN=NO
+++ config.base[182]: export DO_ICE=NO
+++ config.base[182]: DO_ICE=NO
+++ config.base[183]: export DO_AERO=NO
+++ config.base[183]: DO_AERO=NO
+++ config.base[184]: export WAVE_CDUMP=
+++ config.base[184]: WAVE_CDUMP=
+++ config.base[185]: export DOBNDPNT_WAVE=NO
+++ config.base[185]: DOBNDPNT_WAVE=NO
+++ config.base[186]: export FRAC_GRID=.true.
+++ config.base[186]: FRAC_GRID=.true.
+++ config.base[187]: export DO_NEST=NO
+++ config.base[187]: DO_NEST=NO
+++ config.base[188]: [[ NO == \Y\E\S ]]
+++ config.base[192]: export ntiles=6
+++ config.base[192]: ntiles=6
+++ config.base[196]: export OPS_RES=C768
+++ config.base[196]: OPS_RES=C768
+++ config.base[199]: export LEVS=128
+++ config.base[199]: LEVS=128
+++ config.base[200]: export CASE=C96
+++ config.base[200]: CASE=C96
+++ config.base[201]: export CASE_ENS=@CASEENS@
+++ config.base[201]: CASE_ENS=@CASEENS@
+++ config.base[202]: export OCNRES=500
+++ config.base[202]: OCNRES=500
+++ config.base[203]: export ICERES=500
+++ config.base[203]: ICERES=500
+++ config.base[206]: case "${CASE}" in
+++ config.base[211]: export waveGRD=uglo_100km
+++ config.base[211]: waveGRD=uglo_100km
+++ config.base[225]: case "${APP}" in
+++ config.base[262]: [[ gfs =~ gdas ]]
+++ config.base[265]: [[ gfs =~ gfs ]]
+++ config.base[266]: export FHCYC=24
+++ config.base[266]: FHCYC=24
+++ config.base[270]: export FHMIN=0
+++ config.base[270]: FHMIN=0
+++ config.base[271]: export FHMAX=9
+++ config.base[271]: FHMAX=9
+++ config.base[272]: export FHOUT=3
+++ config.base[272]: FHOUT=3
+++ config.base[273]: export FHOUT_OCNICE=3
+++ config.base[273]: FHOUT_OCNICE=3
+++ config.base[276]: export EUPD_CYC=gdas
+++ config.base[276]: EUPD_CYC=gdas
+++ config.base[279]: export gfs_cyc=1
+++ config.base[279]: gfs_cyc=1
+++ config.base[282]: export FHMIN_GFS=0
+++ config.base[282]: FHMIN_GFS=0
+++ config.base[283]: export FHMAX_GFS=120
+++ config.base[283]: FHMAX_GFS=120
+++ config.base[284]: export FHOUT_GFS=3
+++ config.base[284]: FHOUT_GFS=3
+++ config.base[285]: export FHMAX_HF_GFS=0
+++ config.base[285]: FHMAX_HF_GFS=0
+++ config.base[286]: export FHOUT_HF_GFS=1
+++ config.base[286]: FHOUT_HF_GFS=1
+++ config.base[287]: export FHOUT_OCNICE_GFS=6
+++ config.base[287]: FHOUT_OCNICE_GFS=6
+++ config.base[288]: (( gfs_cyc != 0 ))
+++ config.base[289]: export STEP_GFS=24
+++ config.base[289]: STEP_GFS=24
+++ config.base[294]: export ILPOST=1
+++ config.base[294]: ILPOST=1
+++ config.base[295]: (( FHMAX_HF_GFS < 120 ))
+++ config.base[296]: export ILPOST=3
+++ config.base[296]: ILPOST=3
+++ config.base[300]: export restart_interval_gfs=12
+++ config.base[300]: restart_interval_gfs=12
+++ config.base[305]: export QUILTING=.true.
+++ config.base[305]: QUILTING=.true.
+++ config.base[306]: export OUTPUT_GRID=gaussian_grid
+++ config.base[306]: OUTPUT_GRID=gaussian_grid
+++ config.base[307]: export WRITE_DOPOST=.true.
+++ config.base[307]: WRITE_DOPOST=.true.
+++ config.base[308]: export WRITE_NSFLIP=.true.
+++ config.base[308]: WRITE_NSFLIP=.true.
+++ config.base[311]: export DOIAU=YES
+++ config.base[311]: DOIAU=YES
+++ config.base[312]: export IAUFHRS=3,6,9
+++ config.base[312]: IAUFHRS=3,6,9
+++ config.base[313]: export IAU_FHROT=3
+++ config.base[313]: IAU_FHROT=3
+++ config.base[314]: export IAU_DELTHRS=6
+++ config.base[314]: IAU_DELTHRS=6
+++ config.base[315]: export IAU_OFFSET=6
+++ config.base[315]: IAU_OFFSET=6
+++ config.base[316]: export DOIAU_ENKF=YES
+++ config.base[316]: DOIAU_ENKF=YES
+++ config.base[317]: export IAUFHRS_ENKF=3,6,9
+++ config.base[317]: IAUFHRS_ENKF=3,6,9
+++ config.base[318]: export IAU_DELTHRS_ENKF=6
+++ config.base[318]: IAU_DELTHRS_ENKF=6
+++ config.base[321]: export lobsdiag_forenkf=.true.
+++ config.base[321]: lobsdiag_forenkf=.true.
+++ config.base[329]: export imp_physics=8
+++ config.base[329]: imp_physics=8
+++ config.base[333]: export DO_JEDIATMVAR=NO
+++ config.base[333]: DO_JEDIATMVAR=NO
+++ config.base[334]: export DO_JEDIATMENS=NO
+++ config.base[334]: DO_JEDIATMENS=NO
+++ config.base[335]: export DO_JEDIOCNVAR=NO
+++ config.base[335]: DO_JEDIOCNVAR=NO
+++ config.base[336]: export DO_JEDISNOWDA=NO
+++ config.base[336]: DO_JEDISNOWDA=NO
+++ config.base[337]: export DO_MERGENSST=NO
+++ config.base[337]: DO_MERGENSST=NO
+++ config.base[340]: export DOHYBVAR=NO
+++ config.base[340]: DOHYBVAR=NO
+++ config.base[341]: export NMEM_ENS=0
+++ config.base[341]: NMEM_ENS=0
+++ config.base[342]: export SMOOTH_ENKF=NO
+++ config.base[342]: SMOOTH_ENKF=NO
+++ config.base[343]: export l4densvar=.true.
+++ config.base[343]: l4densvar=.true.
+++ config.base[344]: export lwrite4danl=.true.
+++ config.base[344]: lwrite4danl=.true.
+++ config.base[347]: export NMEM_ENS_GFS=30
+++ config.base[347]: NMEM_ENS_GFS=30
+++ config.base[348]: export NMEM_ENS_GFS_OFFSET=20
+++ config.base[348]: NMEM_ENS_GFS_OFFSET=20
+++ config.base[349]: export DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[349]: DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[352]: [[ NO = \Y\E\S ]]
+++ config.base[366]: [[ NO == \N\O ]]
+++ config.base[366]: [[ YES == \Y\E\S ]]
+++ config.base[367]: export IAUFHRS=6
+++ config.base[367]: IAUFHRS=6
+++ config.base[368]: export IAU_FHROT=3
+++ config.base[368]: IAU_FHROT=3
+++ config.base[369]: export IAU_FILTER_INCREMENTS=.true.
+++ config.base[369]: IAU_FILTER_INCREMENTS=.true.
+++ config.base[370]: export IAUFHRS_ENKF=6
+++ config.base[370]: IAUFHRS_ENKF=6
+++ config.base[374]: [[ cycled = \c\y\c\l\e\d ]]
+++ config.base[374]: [[ 2021122018 = \2\0\2\1\1\2\2\1\0\0 ]]
+++ config.base[374]: [[ YES = \N\O ]]
+++ config.base[374]: [[ cycled = \f\o\r\e\c\a\s\t\-\o\n\l\y ]]
+++ config.base[380]: [[ YES = \N\O ]]
+++ config.base[382]: export GSI_SOILANAL=NO
+++ config.base[382]: GSI_SOILANAL=NO
+++ config.base[385]: export DONST=YES
+++ config.base[385]: DONST=YES
+++ config.base[386]: [[ YES = \Y\E\S ]]
+++ config.base[386]: export 'FNTSFA= '
+++ config.base[386]: FNTSFA=' '
+++ config.base[389]: export nst_anl=.true.
+++ config.base[389]: nst_anl=.true.
+++ config.base[392]: export MAKE_NSSTBUFR=NO
+++ config.base[392]: MAKE_NSSTBUFR=NO
+++ config.base[395]: export MAKE_ACFTBUFR=NO
+++ config.base[395]: MAKE_ACFTBUFR=NO
+++ config.base[398]: export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[398]: INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[401]: export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[401]: INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[402]: export INCVARS_EFOLD=5
+++ config.base[402]: INCVARS_EFOLD=5
+++ config.base[407]: export netcdf_diag=.true.
+++ config.base[407]: netcdf_diag=.true.
+++ config.base[408]: export binary_diag=.false.
+++ config.base[408]: binary_diag=.false.
+++ config.base[411]: export DO_METP=NO
+++ config.base[411]: DO_METP=NO
+++ config.base[412]: export DO_FIT2OBS=YES
+++ config.base[412]: DO_FIT2OBS=YES
+++ config.base[413]: export DO_VRFY_OCEANDA=NO
+++ config.base[413]: DO_VRFY_OCEANDA=NO
+++ config.base[416]: export HPSSARCH=NO
+++ config.base[416]: HPSSARCH=NO
+++ config.base[417]: export LOCALARCH=NO
+++ config.base[417]: LOCALARCH=NO
+++ config.base[418]: [[ NO = \Y\E\S ]]
+++ config.base[422]: export ARCH_CYC=00
+++ config.base[422]: ARCH_CYC=00
+++ config.base[423]: export ARCH_WARMICFREQ=4
+++ config.base[423]: ARCH_WARMICFREQ=4
+++ config.base[424]: export ARCH_FCSTICFREQ=1
+++ config.base[424]: ARCH_FCSTICFREQ=1
+++ config.base[427]: export FITSARC=YES
+++ config.base[427]: FITSARC=YES
+++ config.base[428]: export FHMAX_FITS=132
+++ config.base[428]: FHMAX_FITS=132
+++ config.base[429]: [[ 132 -gt 120 ]]
+++ config.base[429]: export FHMAX_FITS=120
+++ config.base[429]: FHMAX_FITS=120
+++ config.base[432]: [[ NO = \Y\E\S ]]
+++ config.base[438]: echo 'END: config.base'
END: config.base
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[97]: for config in '"${configs[@]:-'\'''\''}"'
++ jjob_header.sh[98]: source /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225/config.atmos_products
+++ config.atmos_products[6]: echo 'BEGIN: config.atmos_products'
BEGIN: config.atmos_products
+++ config.atmos_products[9]: . /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/EXPDIR/C96_atm3DVar_f8846225/config.resources atmos_products
++++ config.resources[7]: (( 1 != 1 ))
++++ config.resources[31]: step=atmos_products
++++ config.resources[33]: echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[35]: case ${machine} in
++++ config.resources[38]: npe_node_max=40
++++ config.resources[71]: export npe_node_max
++++ config.resources[73]: case ${step} in
++++ config.resources[806]: export wtime_atmos_products=00:15:00
++++ config.resources[806]: wtime_atmos_products=00:15:00
++++ config.resources[807]: export npe_atmos_products=24
++++ config.resources[807]: npe_atmos_products=24
++++ config.resources[808]: export nth_atmos_products=1
++++ config.resources[808]: nth_atmos_products=1
++++ config.resources[809]: export npe_node_atmos_products=24
++++ config.resources[809]: npe_node_atmos_products=24
++++ config.resources[810]: export wtime_atmos_products_gfs=00:15:00
++++ config.resources[810]: wtime_atmos_products_gfs=00:15:00
++++ config.resources[811]: export npe_atmos_products_gfs=24
++++ config.resources[811]: npe_atmos_products_gfs=24
++++ config.resources[812]: export nth_atmos_products_gfs=1
++++ config.resources[812]: nth_atmos_products_gfs=1
++++ config.resources[813]: export npe_node_atmos_products_gfs=24
++++ config.resources[813]: npe_node_atmos_products_gfs=24
++++ config.resources[814]: export is_exclusive=True
++++ config.resources[814]: is_exclusive=True
++++ config.resources[1285]: echo 'END: config.resources'
END: config.resources
+++ config.atmos_products[12]: export NFHRS_PER_GROUP=3
+++ config.atmos_products[12]: NFHRS_PER_GROUP=3
+++ config.atmos_products[15]: export INTERP_ATMOS_MASTERSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_master.sh
+++ config.atmos_products[15]: INTERP_ATMOS_MASTERSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_master.sh
+++ config.atmos_products[16]: export INTERP_ATMOS_SFLUXSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_sflux.sh
+++ config.atmos_products[16]: INTERP_ATMOS_SFLUXSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_sflux.sh
+++ config.atmos_products[18]: [[ gfs == \g\d\a\s ]]
+++ config.atmos_products[24]: [[ gfs == \g\f\s ]]
+++ config.atmos_products[25]: export downset=2
+++ config.atmos_products[25]: downset=2
+++ config.atmos_products[26]: export FHOUT_PGBS=3
+++ config.atmos_products[26]: FHOUT_PGBS=3
+++ config.atmos_products[27]: export FLXGF=YES
+++ config.atmos_products[27]: FLXGF=YES
+++ config.atmos_products[28]: export WGNE=YES
+++ config.atmos_products[28]: WGNE=YES
+++ config.atmos_products[29]: export FHMAX_WGNE=180
+++ config.atmos_products[29]: FHMAX_WGNE=180
+++ config.atmos_products[32]: export APCP_MSG=597
+++ config.atmos_products[32]: APCP_MSG=597
+++ config.atmos_products[35]: export paramlista=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.fFFF.paramlist.a.txt
+++ config.atmos_products[35]: paramlista=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.fFFF.paramlist.a.txt
+++ config.atmos_products[36]: export paramlista_anl=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.anl.paramlist.a.txt
+++ config.atmos_products[36]: paramlista_anl=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.anl.paramlist.a.txt
+++ config.atmos_products[37]: export paramlista_f000=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.f000.paramlist.a.txt
+++ config.atmos_products[37]: paramlista_f000=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.f000.paramlist.a.txt
+++ config.atmos_products[38]: export paramlistb=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.fFFF.paramlist.b.txt
+++ config.atmos_products[38]: paramlistb=/work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.fFFF.paramlist.b.txt
+++ config.atmos_products[40]: echo 'END: config.atmos_products'
END: config.atmos_products
++ jjob_header.sh[99]: status=0
++ jjob_header.sh[100]: (( status != 0 ))
++ jjob_header.sh[110]: source /work2/noaa/stmp/CI/ORION/2564/gfs/env/ORION.env atmos_products
+++ ORION.env[3]: [[ 1 -ne 1 ]]
+++ ORION.env[15]: step=atmos_products
+++ ORION.env[17]: export 'launcher=srun -l --export=ALL'
+++ ORION.env[17]: launcher='srun -l --export=ALL'
+++ ORION.env[18]: export 'mpmd_opt=--multi-prog --output=mpmd.%j.%t.out'
+++ ORION.env[18]: mpmd_opt='--multi-prog --output=mpmd.%j.%t.out'
+++ ORION.env[21]: export MPI_BUFS_PER_PROC=2048
+++ ORION.env[21]: MPI_BUFS_PER_PROC=2048
+++ ORION.env[22]: export MPI_BUFS_PER_HOST=2048
+++ ORION.env[22]: MPI_BUFS_PER_HOST=2048
+++ ORION.env[23]: export MPI_GROUP_MAX=256
+++ ORION.env[23]: MPI_GROUP_MAX=256
+++ ORION.env[24]: export MPI_MEMMAP_OFF=1
+++ ORION.env[24]: MPI_MEMMAP_OFF=1
+++ ORION.env[25]: export MP_STDOUTMODE=ORDERED
+++ ORION.env[25]: MP_STDOUTMODE=ORDERED
+++ ORION.env[26]: export KMP_AFFINITY=scatter
+++ ORION.env[26]: KMP_AFFINITY=scatter
+++ ORION.env[27]: export OMP_STACKSIZE=2048000
+++ ORION.env[27]: OMP_STACKSIZE=2048000
+++ ORION.env[28]: export NTHSTACK=1024000000
+++ ORION.env[28]: NTHSTACK=1024000000
+++ ORION.env[31]: ulimit -s unlimited
+++ ORION.env[32]: ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 767215
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) 115507200
open files (-n) 131072
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 4096
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
+++ ORION.env[34]: [[ atmos_products = \p\r\e\p ]]
+++ ORION.env[34]: [[ atmos_products = \p\r\e\p\b\u\f\r ]]
+++ ORION.env[43]: [[ atmos_products = \p\r\e\p\s\n\o\w\o\b\s ]]
+++ ORION.env[47]: [[ atmos_products = \p\r\e\p\_\e\m\i\s\s\i\o\n\s ]]
+++ ORION.env[51]: [[ atmos_products = \w\a\v\e\i\n\i\t ]]
+++ ORION.env[51]: [[ atmos_products = \w\a\v\e\p\r\e\p ]]
+++ ORION.env[51]: [[ atmos_products = \w\a\v\e\p\o\s\t\s\b\s ]]
+++ ORION.env[52]: [[ atmos_products = \w\a\v\e\p\o\s\t\b\n\d\p\n\t ]]
+++ ORION.env[52]: [[ atmos_products = \w\a\v\e\p\o\s\t\p\n\t ]]
+++ ORION.env[52]: [[ atmos_products == \w\a\v\e\p\o\s\t\b\n\d\p\n\t\b\l\l ]]
+++ ORION.env[59]: [[ atmos_products = \a\t\m\a\n\l\v\a\r ]]
+++ ORION.env[67]: [[ atmos_products = \a\t\m\e\n\s\a\n\l\r\u\n ]]
+++ ORION.env[75]: [[ atmos_products = \a\e\r\o\a\n\l\r\u\n ]]
+++ ORION.env[85]: [[ atmos_products = \s\n\o\w\a\n\l ]]
+++ ORION.env[95]: [[ atmos_products = \a\t\m\a\n\l\f\v\3\i\n\c ]]
+++ ORION.env[103]: [[ atmos_products = \o\c\n\a\n\a\l\b\m\a\t ]]
+++ ORION.env[113]: [[ atmos_products = \o\c\n\a\n\a\l\r\u\n ]]
+++ ORION.env[123]: [[ atmos_products = \o\c\n\a\n\a\l\c\h\k\p\t ]]
+++ ORION.env[133]: [[ atmos_products = \o\c\n\a\n\a\l\e\c\e\n ]]
+++ ORION.env[141]: [[ atmos_products = \o\c\n\a\n\a\l\l\e\t\k\f ]]
+++ ORION.env[149]: [[ atmos_products = \a\n\a\l ]]
+++ ORION.env[149]: [[ atmos_products = \a\n\a\l\c\a\l\c ]]
+++ ORION.env[177]: [[ atmos_products = \s\f\c\a\n\l ]]
+++ ORION.env[185]: [[ atmos_products = \e\o\b\s ]]
+++ ORION.env[200]: [[ atmos_products = \e\u\p\d ]]
+++ ORION.env[212]: [[ atmos_products = \f\c\s\t ]]
+++ ORION.env[212]: [[ atmos_products = \e\f\c\s ]]
+++ ORION.env[228]: [[ atmos_products = \u\p\p ]]
+++ ORION.env[236]: [[ atmos_products = \a\t\m\o\s\_\p\r\o\d\u\c\t\s ]]
+++ ORION.env[238]: export USE_CFP=YES
+++ ORION.env[238]: USE_CFP=YES
++ jjob_header.sh[111]: status=0
++ jjob_header.sh[112]: (( status != 0 ))
+ JGLOBAL_ATMOS_PRODUCTS[12]: YMD=20211221
+ JGLOBAL_ATMOS_PRODUCTS[12]: HH=00
+ JGLOBAL_ATMOS_PRODUCTS[12]: declare_from_tmpl -rx COM_ATMOS_ANALYSIS COM_ATMOS_HISTORY COM_ATMOS_MASTER
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COM_ATMOS_ANALYSIS=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//analysis/atmos
declare_from_tmpl :: COM_ATMOS_HISTORY=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/history
declare_from_tmpl :: COM_ATMOS_MASTER=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master
+ JGLOBAL_ATMOS_PRODUCTS[14]: for grid in ''\''0p25'\''' ''\''0p50'\''' ''\''1p00'\'''
+ JGLOBAL_ATMOS_PRODUCTS[15]: prod_dir=COM_ATMOS_GRIB_0p25
+ JGLOBAL_ATMOS_PRODUCTS[16]: GRID=0p25
+ JGLOBAL_ATMOS_PRODUCTS[16]: YMD=20211221
+ JGLOBAL_ATMOS_PRODUCTS[16]: HH=00
+ JGLOBAL_ATMOS_PRODUCTS[16]: declare_from_tmpl -rx COM_ATMOS_GRIB_0p25:COM_ATMOS_GRIB_GRID_TMPL
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COM_ATMOS_GRIB_0p25=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/0p25
+ JGLOBAL_ATMOS_PRODUCTS[17]: [[ ! -d /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/0p25 ]]
+ JGLOBAL_ATMOS_PRODUCTS[14]: for grid in ''\''0p25'\''' ''\''0p50'\''' ''\''1p00'\'''
+ JGLOBAL_ATMOS_PRODUCTS[15]: prod_dir=COM_ATMOS_GRIB_0p50
+ JGLOBAL_ATMOS_PRODUCTS[16]: GRID=0p50
+ JGLOBAL_ATMOS_PRODUCTS[16]: YMD=20211221
+ JGLOBAL_ATMOS_PRODUCTS[16]: HH=00
+ JGLOBAL_ATMOS_PRODUCTS[16]: declare_from_tmpl -rx COM_ATMOS_GRIB_0p50:COM_ATMOS_GRIB_GRID_TMPL
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COM_ATMOS_GRIB_0p50=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/0p50
+ JGLOBAL_ATMOS_PRODUCTS[17]: [[ ! -d /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/0p50 ]]
+ JGLOBAL_ATMOS_PRODUCTS[14]: for grid in ''\''0p25'\''' ''\''0p50'\''' ''\''1p00'\'''
+ JGLOBAL_ATMOS_PRODUCTS[15]: prod_dir=COM_ATMOS_GRIB_1p00
+ JGLOBAL_ATMOS_PRODUCTS[16]: GRID=1p00
+ JGLOBAL_ATMOS_PRODUCTS[16]: YMD=20211221
+ JGLOBAL_ATMOS_PRODUCTS[16]: HH=00
+ JGLOBAL_ATMOS_PRODUCTS[16]: declare_from_tmpl -rx COM_ATMOS_GRIB_1p00:COM_ATMOS_GRIB_GRID_TMPL
+ bash_utils.sh[35]: [[ NO == \N\O ]]
+ bash_utils.sh[35]: set +x
declare_from_tmpl :: COM_ATMOS_GRIB_1p00=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/1p00
+ JGLOBAL_ATMOS_PRODUCTS[17]: [[ ! -d /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//products/atmos/grib2/1p00 ]]
+ JGLOBAL_ATMOS_PRODUCTS[21]: export PREFIX=gfs.t00z.
+ JGLOBAL_ATMOS_PRODUCTS[21]: PREFIX=gfs.t00z.
+ JGLOBAL_ATMOS_PRODUCTS[25]: /work2/noaa/stmp/CI/ORION/2564/gfs/scripts/exglobal_atmos_products.sh
Begin exglobal_atmos_products.sh at Thu May 16 09:52:14 UTC 2024
+ exglobal_atmos_products.sh[6]: export WGRIB2=wgrib2
+ exglobal_atmos_products.sh[6]: WGRIB2=wgrib2
+ exglobal_atmos_products.sh[9]: INTERP_ATMOS_MASTERSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_master.sh
+ exglobal_atmos_products.sh[10]: INTERP_ATMOS_SFLUXSH=/work2/noaa/stmp/CI/ORION/2564/gfs/ush/interp_atmos_sflux.sh
+ exglobal_atmos_products.sh[13]: downset=2
+ exglobal_atmos_products.sh[14]: npe_atmos_products=24
+ exglobal_atmos_products.sh[17]: WGNE=YES
+ exglobal_atmos_products.sh[18]: FHMAX_WGNE=180
+ exglobal_atmos_products.sh[20]: cd /work/noaa/stmp/mterry/RUNDIRS/C96_atm3DVar_f8846225/atmos_products.188958
+ exglobal_atmos_products.sh[24]: (( FORECAST_HOUR <= 0 ))
++ exglobal_atmos_products.sh[35]: printf f%03d 72
+ exglobal_atmos_products.sh[35]: fhr3=f072
+ exglobal_atmos_products.sh[36]: (( FORECAST_HOUR%FHOUT_PGBS == 0 ))
+ exglobal_atmos_products.sh[37]: PGBS=YES
+ exglobal_atmos_products.sh[45]: MASTER_FILE=/work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master/gfs.t00z.master.grb2f072
+ exglobal_atmos_products.sh[50]: grep -F -f /work2/noaa/stmp/CI/ORION/2564/gfs/parm/product/gfs.fFFF.paramlist.a.txt
+ exglobal_atmos_products.sh[50]: wgrib2 /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master/gfs.t00z.master.grb2f072
+ exglobal_atmos_products.sh[50]: wgrib2 -i -grib tmpfile_f072 /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master/gfs.t00z.master.grb2f072
*** FATAL ERROR: missing input file /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master/gfs.t00z.master.grb2f072 ***
*** FATAL ERROR: missing input file /work2/noaa/stmp/CI/ORION/2564/RUNTESTS/COMROOT/C96_atm3DVar_f8846225/gfs.20211221/00//model_data/atmos/master/gfs.t00z.master.grb2f072 ***
+ exglobal_atmos_products.sh[1]: postamble exglobal_atmos_products.sh 1715853134 8
+ preamble.sh[70]: set +x
End exglobal_atmos_products.sh at 09:52:14 with error code 8 (time elapsed: 00:00:00)
+ JGLOBAL_ATMOS_PRODUCTS[1]: postamble JGLOBAL_ATMOS_PRODUCTS 1715853087 8
+ preamble.sh[70]: set +x
End JGLOBAL_ATMOS_PRODUCTS at 09:52:15 with error code 8 (time elapsed: 00:00:48)
+ atmos_products.sh[1]: postamble atmos_products.sh 1715853065 8
+ preamble.sh[70]: set +x
End atmos_products.sh at 09:52:15 with error code 8 (time elapsed: 00:01:10)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment