Skip to content

Instantly share code, notes, and snippets.

@emcbot
Created June 2, 2025 21:18
Show Gist options
  • Save emcbot/30a5f2c9979dee8d50c52471246a1244 to your computer and use it in GitHub Desktop.
Save emcbot/30a5f2c9979dee8d50c52471246a1244 to your computer and use it in GitHub Desktop.
error log file from CI run PR_3745 - enkfgdas_fcst_mem001.log
+ source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/detect_machine.sh
++ [[ -n '' ]]
++ case $(hostname -f) in
+++ hostname -f
++ MACHINE_ID=UNKNOWN
++ [[ UNKNOWN == \U\N\K\N\O\W\N ]]
++ case ${PW_CSP:-} in
++ PW_CSP=UNKNOWN
++ MACHINE_ID=UNKNOWN
++ [[ UNKNOWN != \U\N\K\N\O\W\N ]]
++ [[ -d /lfs/h3 ]]
++ [[ -d /lfs/h1 ]]
++ [[ -d /mnt/lfs5 ]]
++ [[ -d /scratch1 ]]
++ MACHINE_ID=hera
+ [[ hera == \w\c\o\s\s\2 ]]
+ source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/load_fv3gfs_modules.sh
++ [[ hxB == *x* ]]
++ set_x=YES
++ [[ NO == \N\O ]]
++ echo 'Loading modules quietly...'
Loading modules quietly...
++ set +x
Running "module reset". Resetting modules to system default. The following $MODULEPATH directories have been removed: /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/modulefiles
Currently Loaded Modules:
1) contrib 45) sp/2.5.0
2) intel/2022.1.2 46) ip/4.3.0
3) stack-intel/2021.5.0 47) grib-util/1.3.0
4) impi/2022.1.2 48) g2tmpl/1.13.0
5) stack-intel-oneapi-mpi/2021.5.1 49) gsi-ncdiag/1.1.2
6) gettext/0.19.8.1 50) crtm-fix/2.4.0.1_emc
7) libxcrypt/4.4.35 51) git-lfs/2.10.0
8) zlib/1.2.13 52) crtm/2.4.0.1
9) sqlite/3.43.2 53) openblas/0.3.24
10) util-linux-uuid/2.38.1 54) py-setuptools/63.4.3
11) python/3.11.6 55) py-numpy/1.23.4
12) hpss/hpss 56) bufr/11.7.0
13) gempak/7.17.0 57) gmake/3.82
14) ncl/6.6.2 58) wgrib2/2.0.8
15) libjpeg/2.1.0 59) py-f90nml/1.4.3
16) jasper/2.0.32 60) py-cftime/1.0.3.4
17) libpng/1.6.37 61) py-netcdf4/1.5.8
18) openjpeg/2.3.1 62) libyaml/0.2.5
19) eccodes/2.32.0 63) py-pyyaml/6.0
20) fftw/3.3.10 64) py-markupsafe/2.1.3
21) nghttp2/1.57.0 65) py-jinja2/3.1.2
22) curl/8.4.0 66) py-bottleneck/1.3.7
23) proj/9.2.1 67) py-numexpr/2.8.4
24) udunits/2.2.28 68) py-et-xmlfile/1.0.1
25) cdo/2.2.0 69) py-openpyxl/3.1.2
26) R/3.6.1 70) py-pytz/2023.3
27) perl/5.38.0 71) py-pyxlsb/1.0.10
28) pkg-config/0.27.1 72) py-xlrd/2.0.1
29) hdf5/1.14.0 73) py-xlsxwriter/3.1.7
30) snappy/1.1.10 74) py-xlwt/1.3.0
31) zstd/1.5.2 75) py-pandas/1.5.3
32) c-blosc/1.21.5 76) py-six/1.16.0
33) netcdf-c/4.9.2 77) py-python-dateutil/2.8.2
34) netcdf-fortran/4.6.1 78) g2c/1.8.0
35) parallel-netcdf/1.12.2 79) netcdf-cxx4/4.3.1
36) parallelio/2.5.10 80) met/9.1.3
37) esmf/8.6.0 81) metplus/3.1.1
38) antlr/2.7.7 82) py-packaging/23.1
39) gsl/2.7.1 83) py-xarray/2023.7.0
40) nco/5.0.6 84) prepobs/1.1.0
41) bacio/2.4.1 85) fit2obs/1.1.7
42) w3emc/2.10.0 86) imagemagick/7.1.1-11
43) prod_util/2.1.1 87) module_base.hera
44) g2/3.4.5
++ wxflowPATH=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/python
++ PYTHONPATH=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-xarray-2023.7.0-joweppx/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-packaging-23.1-5gvg7qo/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-python-dateutil-2.8.2-3qglnj4/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-six-1.16.0-t54borv/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-pandas-1.5.3-tguwpv3/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-xlwt-1.3.0-5nxruci/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-xlsxwriter-3.1.7-7l25bnt/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-xlrd-2.0.1-fwxe33t/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-pyxlsb-1.0.10-ghdqaaw/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-pytz-2023.3-kkz2z3d/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-openpyxl-3.1.2-4tswswo/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-et-xmlfile-1.0.1-it6uamo/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-numexpr-2.8.4-uqnmadj/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-bottleneck-1.3.7-4itjkyr/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-jinja2-3.1.2-3yb4fme/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-markupsafe-2.1.3-clrlf2z/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-pyyaml-6.0-4sduut5/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-netcdf4-1.5.8-haeompg/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-cftime-1.0.3.4-4s5bg7j/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-f90nml-1.4.3-b4vzhct/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/bufr-11.7.0-w62mmgj/lib64/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/bufr-11.7.0-w62mmgj/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-numpy-1.23.4-yrvnxwk/lib/python3.11/site-packages:/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/gsi-addon-dev-fms-2024.01/install/intel/2021.5.0/py-setuptools-63.4.3-qppw6fo/lib/python3.11/site-packages:/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush:/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/python
++ export PYTHONPATH
++ ulimit -S -s unlimited
++ unset ulimit_s
+ status=0
+ [[ 0 -ne 0 ]]
+ export job=fcst
+ job=fcst
+ export jobid=fcst.3242745
+ jobid=fcst.3242745
+ /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/jobs/JGLOBAL_FORECAST
Begin /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/jobs/JGLOBAL_FORECAST at Mon Jun 2 21:11:40 UTC 2025
++ jjob_header.sh[46]OPTIND=1
++ jjob_header.sh[47]getopts c:e: option
++ jjob_header.sh[48]case "${option}" in
++ jjob_header.sh[50]env_job=efcs
++ jjob_header.sh[47]getopts c:e: option
++ jjob_header.sh[48]case "${option}" in
++ jjob_header.sh[49]read -ra configs
++ jjob_header.sh[47]getopts c:e: option
++ jjob_header.sh[61]shift 4
++ jjob_header.sh[63][[ -z efcs ]]
++ jjob_header.sh[71]export DATA=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
++ jjob_header.sh[71]DATA=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
++ jjob_header.sh[72][[ YES == \Y\E\S ]]
++ jjob_header.sh[73]rm -rf /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
++ jjob_header.sh[75]mkdir -p /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
++ jjob_header.sh[76]cd /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
++ jjob_header.sh[85]export pid=3243393
++ jjob_header.sh[85]pid=3243393
++ jjob_header.sh[86]export pgmout=OUTPUT.3243393
++ jjob_header.sh[86]pgmout=OUTPUT.3243393
++ jjob_header.sh[87]export pgmerr=errfile
++ jjob_header.sh[87]pgmerr=errfile
++ jjob_header.sh[90]export pgm=
++ jjob_header.sh[90]pgm=
++ jjob_header.sh[96]export cycle=t18z
++ jjob_header.sh[96]cycle=t18z
++ jjob_header.sh[97]setpdy.sh
+ setpdy.sh[20]'[' /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745 == /home/role.glopara ']'
+ setpdy.sh[25][[ ! t18z =~ t??z ]]
+ setpdy.sh[30]case $# in
+ setpdy.sh[31]dates_before_PDY=7
+ setpdy.sh[32]dates_after_PDY=7
+ setpdy.sh[50]COMDATEROOT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT
+ setpdy.sh[53]'[' -z 20210324 ']'
+ setpdy.sh[57]sed 's/[0-9]\{8\}/20210324/' /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/date/t18z
sed: can't read /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/date/t18z: No such file or directory
++ jjob_header.sh[97]true
++ jjob_header.sh[98]source ./PDY
/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/jjob_header.sh: line 98: ./PDY: No such file or directory
++ jjob_header.sh[98]true
++ jjob_header.sh[104]export EXPDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940
++ jjob_header.sh[104]EXPDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940
++ jjob_header.sh[105]for config in "${configs[@]:-''}"
++ jjob_header.sh[106]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.base
+++ config.base[6]echo 'BEGIN: config.base'
BEGIN: config.base
+++ config.base[9]export machine=HERA
+++ config.base[9]machine=HERA
+++ config.base[12]export RUN_ENVIR=emc
+++ config.base[12]RUN_ENVIR=emc
+++ config.base[15]export ACCOUNT=fv3-cpu
+++ config.base[15]ACCOUNT=fv3-cpu
+++ config.base[16]export QUEUE=batch
+++ config.base[16]QUEUE=batch
+++ config.base[17]export QUEUE_SERVICE=batch
+++ config.base[17]QUEUE_SERVICE=batch
+++ config.base[18]export QUEUE_DTN=batch
+++ config.base[18]QUEUE_DTN=batch
+++ config.base[19]export PARTITION_BATCH=hera
+++ config.base[19]PARTITION_BATCH=hera
+++ config.base[20]export PARTITION_SERVICE=service
+++ config.base[20]PARTITION_SERVICE=service
+++ config.base[21]export PARTITION_DTN=
+++ config.base[21]PARTITION_DTN=
+++ config.base[22]export RESERVATION=
+++ config.base[22]RESERVATION=
+++ config.base[23]export CLUSTERS=
+++ config.base[23]CLUSTERS=
+++ config.base[24]export CLUSTERS_SERVICE=
+++ config.base[24]CLUSTERS_SERVICE=
+++ config.base[25]export CLUSTERS_DTN=
+++ config.base[25]CLUSTERS_DTN=
+++ config.base[28]export HPSS_PROJECT=emc-global
+++ config.base[28]HPSS_PROJECT=emc-global
+++ config.base[31]export HOMEgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow
+++ config.base[31]HOMEgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow
+++ config.base[32]export EXECgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/exec
+++ config.base[32]EXECgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/exec
+++ config.base[33]export FIXgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix
+++ config.base[33]FIXgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix
+++ config.base[34]export PARMgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm
+++ config.base[34]PARMgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm
+++ config.base[35]export SCRgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/scripts
+++ config.base[35]SCRgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/scripts
+++ config.base[36]export USHgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush
+++ config.base[36]USHgfs=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush
+++ config.base[38]export FIXam=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am
+++ config.base[38]FIXam=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am
+++ config.base[39]export FIXaer=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer
+++ config.base[39]FIXaer=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer
+++ config.base[40]export FIXcpl=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl
+++ config.base[40]FIXcpl=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl
+++ config.base[41]export FIXlut=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut
+++ config.base[41]FIXlut=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut
+++ config.base[42]export FIXcice=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice
+++ config.base[42]FIXcice=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice
+++ config.base[43]export FIXmom=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6
+++ config.base[43]FIXmom=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6
+++ config.base[44]export FIXreg2grb2=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/reg2grb2
+++ config.base[44]FIXreg2grb2=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/reg2grb2
+++ config.base[45]export FIXgdas=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/gdas
+++ config.base[45]FIXgdas=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/gdas
+++ config.base[50]export PACKAGEROOT=/scratch1/NCEPDEV/global/glopara/nwpara
+++ config.base[50]PACKAGEROOT=/scratch1/NCEPDEV/global/glopara/nwpara
+++ config.base[51]export COMROOT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT
+++ config.base[51]COMROOT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT
+++ config.base[52]export COMINsyn=/scratch1/NCEPDEV/global/glopara/com/gfs/prod/syndat
+++ config.base[52]COMINsyn=/scratch1/NCEPDEV/global/glopara/com/gfs/prod/syndat
+++ config.base[53]export DMPDIR=/scratch1/NCEPDEV/global/glopara/dump
+++ config.base[53]DMPDIR=/scratch1/NCEPDEV/global/glopara/dump
+++ config.base[57]export COMINecmwf=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ecmwf
+++ config.base[57]COMINecmwf=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ecmwf
+++ config.base[58]export COMINnam=/scratch1/NCEPDEV/global/glopara/data/external_gempak/nam
+++ config.base[58]COMINnam=/scratch1/NCEPDEV/global/glopara/data/external_gempak/nam
+++ config.base[59]export COMINukmet=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ukmet
+++ config.base[59]COMINukmet=/scratch1/NCEPDEV/global/glopara/data/external_gempak/ukmet
+++ config.base[62]export HOMEDIR=/scratch1/NCEPDEV/global/role.glopara
+++ config.base[62]HOMEDIR=/scratch1/NCEPDEV/global/role.glopara
+++ config.base[63]export STMP=/scratch1/NCEPDEV/stmp2/role.glopara
+++ config.base[63]STMP=/scratch1/NCEPDEV/stmp2/role.glopara
+++ config.base[64]export PTMP=/scratch1/NCEPDEV/stmp4/role.glopara
+++ config.base[64]PTMP=/scratch1/NCEPDEV/stmp4/role.glopara
+++ config.base[65]export NOSCRUB=/scratch1/NCEPDEV/global/role.glopara
+++ config.base[65]NOSCRUB=/scratch1/NCEPDEV/global/role.glopara
+++ config.base[68]export BASE_GIT=/scratch1/NCEPDEV/global/glopara/git
+++ config.base[68]BASE_GIT=/scratch1/NCEPDEV/global/glopara/git
+++ config.base[71]export BASE_DATA=/scratch1/NCEPDEV/global/glopara/data
+++ config.base[71]BASE_DATA=/scratch1/NCEPDEV/global/glopara/data
+++ config.base[74]export DO_PREP_SFC=NO
+++ config.base[74]DO_PREP_SFC=NO
+++ config.base[77]export DO_GOES=NO
+++ config.base[77]DO_GOES=NO
+++ config.base[78]export DO_BUFRSND=NO
+++ config.base[78]DO_BUFRSND=NO
+++ config.base[79]export DO_GEMPAK=NO
+++ config.base[79]DO_GEMPAK=NO
+++ config.base[80]export DO_AWIPS=NO
+++ config.base[80]DO_AWIPS=NO
+++ config.base[81]export DO_NPOESS=NO
+++ config.base[81]DO_NPOESS=NO
+++ config.base[82]export DO_TRACKER=YES
+++ config.base[82]DO_TRACKER=YES
+++ config.base[83]export DO_GENESIS=YES
+++ config.base[83]DO_GENESIS=YES
+++ config.base[84]export DO_GENESIS_FSU=NO
+++ config.base[84]DO_GENESIS_FSU=NO
+++ config.base[85]export DO_VERFOZN=YES
+++ config.base[85]DO_VERFOZN=YES
+++ config.base[86]export DO_VERFRAD=YES
+++ config.base[86]DO_VERFRAD=YES
+++ config.base[87]export DO_VMINMON=YES
+++ config.base[87]DO_VMINMON=YES
+++ config.base[88]export DO_ANLSTAT=NO
+++ config.base[88]DO_ANLSTAT=NO
+++ config.base[91]export MODE=cycled
+++ config.base[91]MODE=cycled
+++ config.base[92]export DO_TEST_MODE=NO
+++ config.base[92]DO_TEST_MODE=NO
+++ config.base[101]export FIXgsi=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/gsi
+++ config.base[101]FIXgsi=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/gsi
+++ config.base[102]export HOMEpost=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow
+++ config.base[102]HOMEpost=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow
+++ config.base[103]export HOMEobsproc=/scratch1/NCEPDEV/global/glopara/git/obsproc/v1.2.0
+++ config.base[103]HOMEobsproc=/scratch1/NCEPDEV/global/glopara/git/obsproc/v1.2.0
+++ config.base[106]export NMV=/bin/mv
+++ config.base[106]NMV=/bin/mv
+++ config.base[107]export 'NLN=/bin/ln -sf'
+++ config.base[107]NLN='/bin/ln -sf'
+++ config.base[108]export VERBOSE=YES
+++ config.base[108]VERBOSE=YES
+++ config.base[109]export KEEPDATA=NO
+++ config.base[109]KEEPDATA=NO
+++ config.base[110]export DEBUG_POSTSCRIPT=NO
+++ config.base[110]DEBUG_POSTSCRIPT=NO
+++ config.base[111]export CHGRP_RSTPROD=YES
+++ config.base[111]CHGRP_RSTPROD=YES
+++ config.base[112]export 'CHGRP_CMD=chgrp rstprod'
+++ config.base[112]CHGRP_CMD='chgrp rstprod'
+++ config.base[113]export NCDUMP=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/netcdf-c-4.9.2-ejp7j3k/bin/ncdump
+++ config.base[113]NCDUMP=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/netcdf-c-4.9.2-ejp7j3k/bin/ncdump
+++ config.base[114]export NCLEN=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/getncdimlen
+++ config.base[114]NCLEN=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/getncdimlen
+++ config.base[117]export BASE_ENV=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/env
+++ config.base[117]BASE_ENV=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/env
+++ config.base[120]export SDATE=2021032418
+++ config.base[120]SDATE=2021032418
+++ config.base[121]export EDATE=2021032500
+++ config.base[121]EDATE=2021032500
+++ config.base[122]export EXP_WARM_START=.true.
+++ config.base[122]EXP_WARM_START=.true.
+++ config.base[123]export assim_freq=6
+++ config.base[123]assim_freq=6
+++ config.base[124]export PSLOT=C48mx500_hybAOWCDA_285cc940
+++ config.base[124]PSLOT=C48mx500_hybAOWCDA_285cc940
+++ config.base[125]export EXPDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940
+++ config.base[125]EXPDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940
+++ config.base[126]export ROTDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940
+++ config.base[126]ROTDIR=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940
+++ config.base[127]export DUMP_SUFFIX=
+++ config.base[127]DUMP_SUFFIX=
+++ config.base[128][[ 2021032418 -ge 2019092100 ]]
+++ config.base[128][[ 2021032418 -le 2019110700 ]]
+++ config.base[131]export ARCDIR=/scratch1/NCEPDEV/global/role.glopara/archive/C48mx500_hybAOWCDA_285cc940
+++ config.base[131]ARCDIR=/scratch1/NCEPDEV/global/role.glopara/archive/C48mx500_hybAOWCDA_285cc940
+++ config.base[132]export ATARDIR=/NCEPDEV/emc-global/1year/role.glopara/HERA/scratch/C48mx500_hybAOWCDA_285cc940
+++ config.base[132]ATARDIR=/NCEPDEV/emc-global/1year/role.glopara/HERA/scratch/C48mx500_hybAOWCDA_285cc940
+++ config.base[133]export 'FETCHDIR={{ FETCHDIR }}'
+++ config.base[133]FETCHDIR='{{ FETCHDIR }}'
+++ config.base[136]export envir=prod
+++ config.base[136]envir=prod
+++ config.base[137]export NET=gfs
+++ config.base[137]NET=gfs
+++ config.base[138]export RUN=enkfgdas
+++ config.base[138]RUN=enkfgdas
+++ config.base[141]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.com
++++ config.com[4]echo 'BEGIN: config.com'
BEGIN: config.com
++++ config.com[38][[ emc == \n\c\o ]]
++++ config.com[43]COM_OBSPROC_TMPL='${DMPDIR}/${RUN}${DUMP_SUFFIX}.${YMD}/${HH}/atmos'
++++ config.com[44]COM_RTOFS_TMPL='${DMPDIR}'
++++ config.com[45]COM_TCVITAL_TMPL='${DMPDIR}/${RUN}.${YMD}/${HH}/atmos'
++++ config.com[47]declare -rx 'COM_OBS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/obs'
++++ config.com[48]declare -rx COM_OBSPROC_TMPL COM_RTOFS_TMPL
++++ config.com[50]COM_BASE='${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}'
++++ config.com[52]declare -rx 'COM_TOP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}'
++++ config.com[54]declare -rx 'COM_CONF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/conf'
++++ config.com[55]declare -rx 'COM_OBS_JEDI=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/obs_jedi'
++++ config.com[57]declare -rx 'COM_ATMOS_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/input'
++++ config.com[58]declare -rx 'COM_ATMOS_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/restart'
++++ config.com[59]declare -rx 'COM_ATMOS_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/atmos'
++++ config.com[60]declare -rx 'COM_SNOW_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/snow'
++++ config.com[61]declare -rx 'COM_SNOW_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/snow/anlmon'
++++ config.com[62]declare -rx 'COM_ATMOS_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/history'
++++ config.com[63]declare -rx 'COM_ATMOS_MASTER_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/atmos/master'
++++ config.com[64]declare -rx 'COM_ATMOS_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2'
++++ config.com[65]declare -rx 'COM_ATMOS_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/grib2/${GRID}'
++++ config.com[66]declare -rx 'COM_ATMOS_BUFR_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/bufr'
++++ config.com[67]declare -rx 'COM_ATMOS_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/gempak/${GRID}'
++++ config.com[68]declare -rx 'COM_ATMOS_GENESIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/genesis_vital'
++++ config.com[69]declare -rx 'COM_ATMOS_TRACK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/cyclone/tracks'
++++ config.com[70]declare -rx 'COM_ATMOS_GOES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/goes_sim'
++++ config.com[71]declare -rx 'COM_ATMOS_IMAGERY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/imagery'
++++ config.com[72]declare -rx 'COM_ATMOS_OZNMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/oznmon'
++++ config.com[73]declare -rx 'COM_ATMOS_RADMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/radmon'
++++ config.com[74]declare -rx 'COM_ATMOS_MINMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/minmon'
++++ config.com[75]declare -rx 'COM_ATMOS_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/anlmon'
++++ config.com[76]declare -rx 'COM_ATMOS_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/atmos/wmo'
++++ config.com[78]declare -rx 'COM_WAVE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/restart'
++++ config.com[79]declare -rx 'COM_WAVE_PREP_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/prep'
++++ config.com[80]declare -rx 'COM_WAVE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/wave/history'
++++ config.com[81]declare -rx 'COM_WAVE_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded'
++++ config.com[82]declare -rx 'COM_WAVE_GRID_RES_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gridded/${GRDRESNAME}'
++++ config.com[83]declare -rx 'COM_WAVE_STATION_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/station'
++++ config.com[84]declare -rx 'COM_WAVE_GEMPAK_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/gempak'
++++ config.com[85]declare -rx 'COM_WAVE_WMO_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/wave/wmo'
++++ config.com[87]declare -rx 'COM_OCEAN_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/history'
++++ config.com[88]declare -rx 'COM_OCEAN_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/restart'
++++ config.com[89]declare -rx 'COM_OCEAN_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ocean/input'
++++ config.com[90]declare -rx 'COM_OCEAN_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean'
++++ config.com[91]declare -rx 'COM_OCEAN_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/anlmon'
++++ config.com[92]declare -rx 'COM_OCEAN_LETKF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ocean/letkf'
++++ config.com[93]declare -rx 'COM_OCEAN_BMATRIX_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/bmatrix/ocean'
++++ config.com[94]declare -rx 'COM_OCEAN_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/netcdf'
++++ config.com[95]declare -rx 'COM_OCEAN_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2'
++++ config.com[96]declare -rx 'COM_OCEAN_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ocean/grib2/${GRID}'
++++ config.com[98]declare -rx 'COM_ICE_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice'
++++ config.com[99]declare -rx 'COM_ICE_LETKF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/ice/letkf'
++++ config.com[100]declare -rx 'COM_ICE_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/anlmon'
++++ config.com[101]declare -rx 'COM_ICE_BMATRIX_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/bmatrix/ice'
++++ config.com[102]declare -rx 'COM_ICE_INPUT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/input'
++++ config.com[103]declare -rx 'COM_ICE_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/history'
++++ config.com[104]declare -rx 'COM_ICE_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/ice/restart'
++++ config.com[105]declare -rx 'COM_ICE_NETCDF_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/netcdf'
++++ config.com[106]declare -rx 'COM_ICE_GRIB_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2'
++++ config.com[107]declare -rx 'COM_ICE_GRIB_GRID_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/ice/grib2/${GRID}'
++++ config.com[109]declare -rx 'COM_CHEM_HISTORY_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/chem/history'
++++ config.com[110]declare -rx 'COM_CHEM_ANALYSIS_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem'
++++ config.com[111]declare -rx 'COM_CHEM_BMAT_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/analysis/chem/bmatrix'
++++ config.com[112]declare -rx 'COM_CHEM_ANLMON_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/products/chem/anlmon'
++++ config.com[114]declare -rx 'COM_MED_RESTART_TMPL=${ROTDIR}/${RUN}.${YMD}/${HH}/${MEMDIR}/model/med/restart'
+++ config.base[143]export LOGSCRIPT=
+++ config.base[143]LOGSCRIPT=
+++ config.base[145]export 'REDOUT=1>'
+++ config.base[145]REDOUT='1>'
+++ config.base[146]export 'REDERR=2>'
+++ config.base[146]REDERR='2>'
+++ config.base[148]export SENDECF=NO
+++ config.base[148]SENDECF=NO
+++ config.base[149]export SENDSDM=NO
+++ config.base[149]SENDSDM=NO
+++ config.base[150]export SENDDBN_NTC=NO
+++ config.base[150]SENDDBN_NTC=NO
+++ config.base[151]export SENDDBN=NO
+++ config.base[151]SENDDBN=NO
+++ config.base[152]export DBNROOT=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/prod-util-2.1.1-4vpcrpl/fakedbn
+++ config.base[152]DBNROOT=/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/unified-env-rocky8/install/intel/2021.5.0/prod-util-2.1.1-4vpcrpl/fakedbn
+++ config.base[155]export APP=S2S
+++ config.base[155]APP=S2S
+++ config.base[157]shopt -s extglob
+++ config.base[160]case "${RUN}" in
+++ config.base[162]APP=S2S
+++ config.base[167]shopt -u extglob
+++ config.base[170]export DO_ATM=YES
+++ config.base[170]DO_ATM=YES
+++ config.base[171]export DO_COUPLED=NO
+++ config.base[171]DO_COUPLED=NO
+++ config.base[172]export DO_WAVE=NO
+++ config.base[172]DO_WAVE=NO
+++ config.base[173]export DO_OCN=NO
+++ config.base[173]DO_OCN=NO
+++ config.base[174]export DO_ICE=NO
+++ config.base[174]DO_ICE=NO
+++ config.base[175]DO_AERO=NO
+++ config.base[176]export DO_PREP_OBS_AERO=NO
+++ config.base[176]DO_PREP_OBS_AERO=NO
+++ config.base[177]aero_fcst_runs=gdas
+++ config.base[178]aero_anl_runs='gdas gfs'
+++ config.base[179]export DO_AERO_FCST=NO
+++ config.base[179]DO_AERO_FCST=NO
+++ config.base[180]export DO_AERO_ANL=NO
+++ config.base[180]DO_AERO_ANL=NO
+++ config.base[181]export DOBNDPNT_WAVE=YES
+++ config.base[181]DOBNDPNT_WAVE=YES
+++ config.base[182]export DOIBP_WAV=NO
+++ config.base[182]DOIBP_WAV=NO
+++ config.base[183]export FRAC_GRID=.true.
+++ config.base[183]FRAC_GRID=.true.
+++ config.base[184]export DO_NEST=NO
+++ config.base[184]DO_NEST=NO
+++ config.base[185][[ NO == \Y\E\S ]]
+++ config.base[191]export ntiles=6
+++ config.base[191]ntiles=6
+++ config.base[192]export FIXugwd=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd
+++ config.base[192]FIXugwd=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd
+++ config.base[193]export FIXorog=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog
+++ config.base[193]FIXorog=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog
+++ config.base[197]export OPS_RES=C768
+++ config.base[197]OPS_RES=C768
+++ config.base[200]export LEVS=128
+++ config.base[200]LEVS=128
+++ config.base[201]export CASE=C48
+++ config.base[201]CASE=C48
+++ config.base[202]export CASE_ENS=C48
+++ config.base[202]CASE_ENS=C48
+++ config.base[203]export OCNRES=500
+++ config.base[203]OCNRES=500
+++ config.base[204]export ICERES=500
+++ config.base[204]ICERES=500
+++ config.base[207]case "${CASE}" in
+++ config.base[209]export waveGRD=uglo_100km
+++ config.base[209]waveGRD=uglo_100km
+++ config.base[226]case "${APP}" in
+++ config.base[242]export DO_COUPLED=YES
+++ config.base[242]DO_COUPLED=YES
+++ config.base[243]export DO_OCN=YES
+++ config.base[243]DO_OCN=YES
+++ config.base[244]export DO_ICE=YES
+++ config.base[244]DO_ICE=YES
+++ config.base[246][[ S2S =~ A$ ]]
+++ config.base[250][[ S2S =~ ^S2SW ]]
+++ config.base[261][[ NO == \Y\E\S ]]
+++ config.base[271][[ enkfgdas =~ gdas ]]
+++ config.base[272]export FHCYC=1
+++ config.base[272]FHCYC=1
+++ config.base[273]export FTSFS=10
+++ config.base[273]FTSFS=10
+++ config.base[279]export FHMIN=0
+++ config.base[279]FHMIN=0
+++ config.base[280]export FHMAX=9
+++ config.base[280]FHMAX=9
+++ config.base[281]export FHOUT=3
+++ config.base[281]FHOUT=3
+++ config.base[282]export FHOUT_OCN=3
+++ config.base[282]FHOUT_OCN=3
+++ config.base[283]export FHOUT_ICE=3
+++ config.base[283]FHOUT_ICE=3
+++ config.base[284]export FHOUT_AERO=3
+++ config.base[284]FHOUT_AERO=3
+++ config.base[287]export EUPD_CYC=gdas
+++ config.base[287]EUPD_CYC=gdas
+++ config.base[290]export INTERVAL_GFS=0
+++ config.base[290]INTERVAL_GFS=0
+++ config.base[291]export SDATE_GFS=2021032500
+++ config.base[291]SDATE_GFS=2021032500
+++ config.base[294]export FHMIN_GFS=0
+++ config.base[294]FHMIN_GFS=0
+++ config.base[295]export FHMAX_GFS=120
+++ config.base[295]FHMAX_GFS=120
+++ config.base[297]breakpnts=
+++ config.base[298]export FCST_SEGMENTS=0,120
+++ config.base[298]FCST_SEGMENTS=0,120
+++ config.base[299]export FHOUT_GFS=3
+++ config.base[299]FHOUT_GFS=3
+++ config.base[300]export FHMAX_HF_GFS=0
+++ config.base[300]FHMAX_HF_GFS=0
+++ config.base[301]export FHOUT_HF_GFS=1
+++ config.base[301]FHOUT_HF_GFS=1
+++ config.base[302]export FHOUT_OCN_GFS=6
+++ config.base[302]FHOUT_OCN_GFS=6
+++ config.base[303]export FHOUT_ICE_GFS=6
+++ config.base[303]FHOUT_ICE_GFS=6
+++ config.base[304]export FHMIN_WAV=0
+++ config.base[304]FHMIN_WAV=0
+++ config.base[305]export FHOUT_WAV=3
+++ config.base[305]FHOUT_WAV=3
+++ config.base[306]export FHMAX_HF_WAV=120
+++ config.base[306]FHMAX_HF_WAV=120
+++ config.base[307]export FHOUT_HF_WAV=1
+++ config.base[307]FHOUT_HF_WAV=1
+++ config.base[308]export FHMAX_WAV=9
+++ config.base[308]FHMAX_WAV=9
+++ config.base[309]export FHMAX_WAV_GFS=120
+++ config.base[309]FHMAX_WAV_GFS=120
+++ config.base[310]export FHMAX_HF_GFS=0
+++ config.base[310]FHMAX_HF_GFS=0
+++ config.base[311]export FHMAX_WAV=9
+++ config.base[311]FHMAX_WAV=9
+++ config.base[312]export FHMAX_WAV_GFS=120
+++ config.base[312]FHMAX_WAV_GFS=120
+++ config.base[313]export FHMAX_HF_WAV=120
+++ config.base[313]FHMAX_HF_WAV=120
+++ config.base[316]export ILPOST=1
+++ config.base[316]ILPOST=1
+++ config.base[317](( FHMAX_HF_GFS < 120 ))
+++ config.base[318]export ILPOST=3
+++ config.base[318]ILPOST=3
+++ config.base[322]export FHMAX_GOES=180
+++ config.base[322]FHMAX_GOES=180
+++ config.base[323]export FHOUT_GOES=3
+++ config.base[323]FHOUT_GOES=3
+++ config.base[324](( FHMAX_GOES > FHMAX_GFS ))
+++ config.base[325]export FHMAX_GOES=120
+++ config.base[325]FHMAX_GOES=120
+++ config.base[329]export restart_interval_gfs=12
+++ config.base[329]restart_interval_gfs=12
+++ config.base[334]export QUILTING=.true.
+++ config.base[334]QUILTING=.true.
+++ config.base[335]export OUTPUT_GRID=gaussian_grid
+++ config.base[335]OUTPUT_GRID=gaussian_grid
+++ config.base[336]export WRITE_DOPOST=.true.
+++ config.base[336]WRITE_DOPOST=.true.
+++ config.base[337]export WRITE_NSFLIP=.true.
+++ config.base[337]WRITE_NSFLIP=.true.
+++ config.base[340]export DOIAU=YES
+++ config.base[340]DOIAU=YES
+++ config.base[341]export IAUFHRS=3,6,9
+++ config.base[341]IAUFHRS=3,6,9
+++ config.base[342]export IAU_FHROT=3
+++ config.base[342]IAU_FHROT=3
+++ config.base[343]export IAU_DELTHRS=6
+++ config.base[343]IAU_DELTHRS=6
+++ config.base[344]export IAU_OFFSET=6
+++ config.base[344]IAU_OFFSET=6
+++ config.base[345]export DOIAU_ENKF=YES
+++ config.base[345]DOIAU_ENKF=YES
+++ config.base[346]export IAUFHRS_ENKF=3,6,9
+++ config.base[346]IAUFHRS_ENKF=3,6,9
+++ config.base[347]export IAU_DELTHRS_ENKF=6
+++ config.base[347]IAU_DELTHRS_ENKF=6
+++ config.base[350]export lobsdiag_forenkf=.true.
+++ config.base[350]lobsdiag_forenkf=.true.
+++ config.base[358]export imp_physics=8
+++ config.base[358]imp_physics=8
+++ config.base[362]export DO_JEDIATMVAR=NO
+++ config.base[362]DO_JEDIATMVAR=NO
+++ config.base[363]export DO_JEDIATMENS=NO
+++ config.base[363]DO_JEDIATMENS=NO
+++ config.base[364]export DO_JEDIOCNVAR=YES
+++ config.base[364]DO_JEDIOCNVAR=YES
+++ config.base[365]export DO_JEDISNOWDA=NO
+++ config.base[365]DO_JEDISNOWDA=NO
+++ config.base[366]export DO_MERGENSST=NO
+++ config.base[366]DO_MERGENSST=NO
+++ config.base[367]export DO_STARTMEM_FROM_JEDIICE=NO
+++ config.base[367]DO_STARTMEM_FROM_JEDIICE=NO
+++ config.base[370]export DOHYBVAR=YES
+++ config.base[370]DOHYBVAR=YES
+++ config.base[371]export DOHYBVAR_OCN=YES
+++ config.base[371]DOHYBVAR_OCN=YES
+++ config.base[372]export DOLETKF_OCN=YES
+++ config.base[372]DOLETKF_OCN=YES
+++ config.base[373]export NMEM_ENS=2
+++ config.base[373]NMEM_ENS=2
+++ config.base[374]export SMOOTH_ENKF=NO
+++ config.base[374]SMOOTH_ENKF=NO
+++ config.base[375]export l4densvar=.true.
+++ config.base[375]l4densvar=.true.
+++ config.base[376]export lwrite4danl=.true.
+++ config.base[376]lwrite4danl=.true.
+++ config.base[377]export DO_CALC_INCREMENT=NO
+++ config.base[377]DO_CALC_INCREMENT=NO
+++ config.base[380]export NMEM_ENS_GFS=30
+++ config.base[380]NMEM_ENS_GFS=30
+++ config.base[381]export NMEM_ENS_GFS_OFFSET=20
+++ config.base[381]NMEM_ENS_GFS_OFFSET=20
+++ config.base[382]export DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[382]DO_CALC_INCREMENT_ENKF_GFS=NO
+++ config.base[385][[ YES = \Y\E\S ]]
+++ config.base[386]export FHMIN_ENKF=3
+++ config.base[386]FHMIN_ENKF=3
+++ config.base[387]export FHMAX_ENKF=9
+++ config.base[387]FHMAX_ENKF=9
+++ config.base[388]export FHMAX_ENKF_GFS=12
+++ config.base[388]FHMAX_ENKF_GFS=12
+++ config.base[389]export FHOUT_ENKF_GFS=3
+++ config.base[389]FHOUT_ENKF_GFS=3
+++ config.base[390][[ .true. = \.\t\r\u\e\. ]]
+++ config.base[391]export FHOUT=1
+++ config.base[391]FHOUT=1
+++ config.base[392]export FHOUT_ENKF=1
+++ config.base[392]FHOUT_ENKF=1
+++ config.base[399][[ YES == \N\O ]]
+++ config.base[407]export ENKF_SPREAD=YES
+++ config.base[407]ENKF_SPREAD=YES
+++ config.base[410][[ cycled = \c\y\c\l\e\d ]]
+++ config.base[410][[ 2021032418 = \2\0\2\1\0\3\2\4\1\8 ]]
+++ config.base[410][[ .true. = \.\f\a\l\s\e\. ]]
+++ config.base[410][[ YES = \N\O ]]
+++ config.base[410][[ cycled = \f\o\r\e\c\a\s\t\-\o\n\l\y ]]
+++ config.base[416][[ YES = \N\O ]]
+++ config.base[420][[ YES == \Y\E\S ]]
+++ config.base[421]export restart_interval_enkfgdas=3
+++ config.base[421]restart_interval_enkfgdas=3
+++ config.base[426]export restart_interval_enkfgfs=3
+++ config.base[426]restart_interval_enkfgfs=3
+++ config.base[428][[ YES == \Y\E\S ]]
+++ config.base[429]export restart_interval_gdas=3
+++ config.base[429]restart_interval_gdas=3
+++ config.base[434]export DO_GSISOILDA=NO
+++ config.base[434]DO_GSISOILDA=NO
+++ config.base[437]export DONST=YES
+++ config.base[437]DONST=YES
+++ config.base[438][[ YES = \Y\E\S ]]
+++ config.base[438]export 'FNTSFA= '
+++ config.base[438]FNTSFA=' '
+++ config.base[441]export nst_anl=.true.
+++ config.base[441]nst_anl=.true.
+++ config.base[444]export MAKE_NSSTBUFR=NO
+++ config.base[444]MAKE_NSSTBUFR=NO
+++ config.base[447]export MAKE_ACFTBUFR=NO
+++ config.base[447]MAKE_ACFTBUFR=NO
+++ config.base[450]export 'INCREMENTS_TO_ZERO='\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[450]INCREMENTS_TO_ZERO=''\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[453]export 'INCVARS_ZERO_STRAT='\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[453]INCVARS_ZERO_STRAT=''\''sphum_inc'\'','\''liq_wat_inc'\'','\''icmr_inc'\'','\''rwmr_inc'\'','\''snmr_inc'\'','\''grle_inc'\'''
+++ config.base[454]export INCVARS_EFOLD=5
+++ config.base[454]INCVARS_EFOLD=5
+++ config.base[459]export netcdf_diag=.true.
+++ config.base[459]netcdf_diag=.true.
+++ config.base[460]export binary_diag=.false.
+++ config.base[460]binary_diag=.false.
+++ config.base[463]export DO_CA=YES
+++ config.base[463]DO_CA=YES
+++ config.base[466]export DO_METP=YES
+++ config.base[466]DO_METP=YES
+++ config.base[467]export DO_FIT2OBS=YES
+++ config.base[467]DO_FIT2OBS=YES
+++ config.base[470]export FHMAX_FITS=132
+++ config.base[470]FHMAX_FITS=132
+++ config.base[471][[ 132 -gt 120 ]]
+++ config.base[472]export FHMAX_FITS=120
+++ config.base[472]FHMAX_FITS=120
+++ config.base[477]export DO_FETCH_HPSS=NO
+++ config.base[477]DO_FETCH_HPSS=NO
+++ config.base[478]export DO_FETCH_LOCAL=NO
+++ config.base[478]DO_FETCH_LOCAL=NO
+++ config.base[481]export DO_ARCHCOM=YES
+++ config.base[481]DO_ARCHCOM=YES
+++ config.base[482]export ARCHCOM_TO=hpss
+++ config.base[482]ARCHCOM_TO=hpss
+++ config.base[485]export 'CLIENT_GLOBUS_UUID={{ CLIENT_GLOBUS_UUID }}'
+++ config.base[485]CLIENT_GLOBUS_UUID='{{ CLIENT_GLOBUS_UUID }}'
+++ config.base[488][[ NO = \Y\E\S ]]
+++ config.base[495][[ NO = \Y\E\S ]]
+++ config.base[495][[ YES = \Y\E\S ]]
+++ config.base[496]export DO_ANLSTAT=YES
+++ config.base[496]DO_ANLSTAT=YES
+++ config.base[501]export REPLAY_ICS=NO
+++ config.base[501]REPLAY_ICS=NO
+++ config.base[502]export OFFSET_START_HOUR=0
+++ config.base[502]OFFSET_START_HOUR=0
+++ config.base[505]export NUM_SND_COLLECTIVES=9
+++ config.base[505]NUM_SND_COLLECTIVES=9
+++ config.base[507]echo 'END: config.base'
END: config.base
++ jjob_header.sh[106]true
++ jjob_header.sh[107]export err=0
++ jjob_header.sh[107]err=0
++ jjob_header.sh[108][[ 0 -ne 0 ]]
++ jjob_header.sh[105]for config in "${configs[@]:-''}"
++ jjob_header.sh[106]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.fcst
+++ config.fcst[6]echo 'BEGIN: config.fcst'
BEGIN: config.fcst
+++ config.fcst[8]export USE_ESMF_THREADING=YES
+++ config.fcst[8]USE_ESMF_THREADING=YES
+++ config.fcst[9]export COPY_FINAL_RESTARTS=NO
+++ config.fcst[9]COPY_FINAL_RESTARTS=NO
+++ config.fcst[12]string='--fv3 C48'
+++ config.fcst[13][[ YES == \Y\E\S ]]
+++ config.fcst[14]string='--fv3 C48 --mom6 500'
+++ config.fcst[16][[ YES == \Y\E\S ]]
+++ config.fcst[17]string='--fv3 C48 --mom6 500 --cice6 500'
+++ config.fcst[19][[ NO == \Y\E\S ]]
+++ config.fcst[22][[ NO == \Y\E\S ]]
+++ config.fcst[27]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ufs --fv3 C48 --mom6 500 --cice6 500
++++ config.ufs[9]echo 'BEGIN: config.ufs'
BEGIN: config.ufs
++++ config.ufs[11](( 6 <= 1 ))
++++ config.ufs[26]skip_mom6=true
++++ config.ufs[27]skip_cice6=true
++++ config.ufs[28]skip_ww3=true
++++ config.ufs[29]skip_gocart=true
++++ config.ufs[30]skip_mediator=true
++++ config.ufs[33](( 6 > 0 ))
++++ config.ufs[34]key=--fv3
++++ config.ufs[35]case "${key}" in
++++ config.ufs[37]fv3_res=C48
++++ config.ufs[38]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 4 > 0 ))
++++ config.ufs[34]key=--mom6
++++ config.ufs[35]case "${key}" in
++++ config.ufs[41]mom6_res=500
++++ config.ufs[42]skip_mom6=false
++++ config.ufs[43]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 2 > 0 ))
++++ config.ufs[34]key=--cice6
++++ config.ufs[35]case "${key}" in
++++ config.ufs[46]cice6_res=500
++++ config.ufs[47]skip_cice6=false
++++ config.ufs[48]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 0 > 0 ))
++++ config.ufs[67][[ false == \f\a\l\s\e ]]
++++ config.ufs[68]skip_mediator=false
++++ config.ufs[71][[ NO == \Y\E\S ]]
++++ config.ufs[84]export grid_type=-1
++++ config.ufs[84]grid_type=-1
++++ config.ufs[88]case "${fv3_res}" in
++++ config.ufs[90]export layout_x=2
++++ config.ufs[90]layout_x=2
++++ config.ufs[91]export layout_y=1
++++ config.ufs[91]layout_y=1
++++ config.ufs[92]export nthreads_fv3=1
++++ config.ufs[92]nthreads_fv3=1
++++ config.ufs[93]export nthreads_ufs=1
++++ config.ufs[93]nthreads_ufs=1
++++ config.ufs[94]export WRITE_GROUP=1
++++ config.ufs[94]WRITE_GROUP=1
++++ config.ufs[95]export WRTTASK_PER_GROUP_PER_THREAD_PER_TILE=1
++++ config.ufs[95]WRTTASK_PER_GROUP_PER_THREAD_PER_TILE=1
++++ config.ufs[99]export DELTIM=900
++++ config.ufs[99]DELTIM=900
++++ config.ufs[100]export xr_cnvcld=.false.
++++ config.ufs[100]xr_cnvcld=.false.
++++ config.ufs[101]export cdmbgwd=0.071,2.1,1.0,1.0
++++ config.ufs[101]cdmbgwd=0.071,2.1,1.0,1.0
++++ config.ufs[102]export cdmbgwd_gsl=40.0,1.77,1.0,1.0
++++ config.ufs[102]cdmbgwd_gsl=40.0,1.77,1.0,1.0
++++ config.ufs[103]export psl_gwd_dx_factor=6.0
++++ config.ufs[103]psl_gwd_dx_factor=6.0
++++ config.ufs[104]export knob_ugwp_tauamp=6.0e-3
++++ config.ufs[104]knob_ugwp_tauamp=6.0e-3
++++ config.ufs[105]export k_split=1
++++ config.ufs[105]k_split=1
++++ config.ufs[106]export n_split=4
++++ config.ufs[106]n_split=4
++++ config.ufs[107]export tau=8.0
++++ config.ufs[107]tau=8.0
++++ config.ufs[108]export rf_cutoff=100.0
++++ config.ufs[108]rf_cutoff=100.0
++++ config.ufs[109]export fv_sg_adj=3600
++++ config.ufs[109]fv_sg_adj=3600
++++ config.ufs[341](( WRTTASK_PER_GROUP_PER_THREAD = WRTTASK_PER_GROUP_PER_THREAD_PER_TILE * 6 ))
++++ config.ufs[342]export WRTTASK_PER_GROUP_PER_THREAD
++++ config.ufs[344](( ntasks_fv3 = layout_x * layout_y * 6 ))
++++ config.ufs[345][[ NO == \Y\E\S ]]
++++ config.ufs[348]export ntasks_fv3
++++ config.ufs[350](( ntasks_quilt = WRITE_GROUP * WRTTASK_PER_GROUP_PER_THREAD ))
++++ config.ufs[351]export ntasks_quilt
++++ config.ufs[355]case ${fv3_res} in
++++ config.ufs[357]zstandard_level=0
++++ config.ufs[358]ideflate=0
++++ config.ufs[359]quantize_nsd=0
++++ config.ufs[360]OUTPUT_FILETYPE_ATM=netcdf
++++ config.ufs[361]OUTPUT_FILETYPE_SFC=netcdf
++++ config.ufs[379]export zstandard_level ideflate quantize_nsd
++++ config.ufs[380]export OUTPUT_FILETYPE_ATM OUTPUT_FILETYPE_SFC
++++ config.ufs[383]export cpl=.false.
++++ config.ufs[383]cpl=.false.
++++ config.ufs[384]export cplflx=.false.
++++ config.ufs[384]cplflx=.false.
++++ config.ufs[385]export cplice=.false.
++++ config.ufs[385]cplice=.false.
++++ config.ufs[386]export cplchm=.false.
++++ config.ufs[386]cplchm=.false.
++++ config.ufs[387]export cplwav=.false.
++++ config.ufs[387]cplwav=.false.
++++ config.ufs[388]export cplwav2atm=.false.
++++ config.ufs[388]cplwav2atm=.false.
++++ config.ufs[389][[ NO == \Y\E\S ]]
++++ config.ufs[392]export CCPP_SUITE=FV3_GFS_v17_p8_ugwpv1
++++ config.ufs[392]CCPP_SUITE=FV3_GFS_v17_p8_ugwpv1
++++ config.ufs[394]model_list=atm
++++ config.ufs[397][[ false == \f\a\l\s\e ]]
++++ config.ufs[398]export cpl=.true.
++++ config.ufs[398]cpl=.true.
++++ config.ufs[399]export nthreads_mediator=1
++++ config.ufs[399]nthreads_mediator=1
++++ config.ufs[400]export CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[400]CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[404][[ false == \f\a\l\s\e ]]
++++ config.ufs[405]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ocn
+++++ config.ocn[3]echo 'BEGIN: config.ocn'
BEGIN: config.ocn
+++++ config.ocn[5]export MESH_OCN=mesh.mx500.nc
+++++ config.ocn[5]MESH_OCN=mesh.mx500.nc
+++++ config.ocn[7]export DO_OCN_SPPT=NO
+++++ config.ocn[7]DO_OCN_SPPT=NO
+++++ config.ocn[8]export DO_OCN_PERT_EPBL=NO
+++++ config.ocn[8]DO_OCN_PERT_EPBL=NO
+++++ config.ocn[11]export MOM6_USE_LI2016=True
+++++ config.ocn[11]MOM6_USE_LI2016=True
+++++ config.ocn[12]export MOM6_THERMO_SPAN=False
+++++ config.ocn[12]MOM6_THERMO_SPAN=False
+++++ config.ocn[14][[ YES == \Y\E\S ]]
+++++ config.ocn[15]export ODA_INCUPD=True
+++++ config.ocn[15]ODA_INCUPD=True
+++++ config.ocn[21][[ YES == \Y\E\S ]]
+++++ config.ocn[22]export ODA_INCUPD_NHOURS=6.0
+++++ config.ocn[22]ODA_INCUPD_NHOURS=6.0
+++++ config.ocn[27]MOM6_INTERP_ICS='{{ MOM6_INTERP_ICS }}'
+++++ config.ocn[28][[ {{ MOM6_INTERP_ICS }} == \Y\E\S ]]
+++++ config.ocn[34]echo 'END: config.ocn'
END: config.ocn
++++ config.ufs[406]export cplflx=.true.
++++ config.ufs[406]cplflx=.true.
++++ config.ufs[407]model_list=atm.ocean
++++ config.ufs[408]nthreads_mom6=1
++++ config.ufs[409]case "${mom6_res}" in
++++ config.ufs[411]ntasks_mom6=8
++++ config.ufs[412]OCNTIM=3600
++++ config.ufs[413]NX_GLB=72
++++ config.ufs[414]NY_GLB=35
++++ config.ufs[415]DT_DYNAM_MOM6=3600
++++ config.ufs[416]DT_THERM_MOM6=3600
++++ config.ufs[417]FRUNOFF=
++++ config.ufs[418]CHLCLIM=seawifs_1998-2006_smoothed_2X.nc
++++ config.ufs[419]MOM6_RESTART_SETTING=r
++++ config.ufs[420]MOM6_RIVER_RUNOFF=False
++++ config.ufs[421]case ${RUN} in
++++ config.ufs[425]MOM6_DIAG_MISVAL=0.0
++++ config.ufs[431]eps_imesh=4.0e-1
++++ config.ufs[432]MOM6_DIAG_COORD_DEF_Z_FILE=oceanda_zgrid_25L.nc
++++ config.ufs[433]MOM6_ALLOW_LANDMASK_CHANGES=False
++++ config.ufs[434]TOPOEDITS=
++++ config.ufs[529]export nthreads_mom6 ntasks_mom6
++++ config.ufs[530]export OCNTIM
++++ config.ufs[531]export NX_GLB NY_GLB
++++ config.ufs[532]export DT_DYNAM_MOM6 DT_THERM_MOM6
++++ config.ufs[533]export FRUNOFF
++++ config.ufs[534]export CHLCLIM
++++ config.ufs[535]export TOPOEDITS
++++ config.ufs[536]export MOM6_RIVER_RUNOFF
++++ config.ufs[537]export MOM6_RESTART_SETTING
++++ config.ufs[538]export eps_imesh
++++ config.ufs[539]export MOM6_DIAG_COORD_DEF_Z_FILE
++++ config.ufs[540]export MOM6_DIAG_MISVAL
++++ config.ufs[541]export MOM6_ALLOW_LANDMASK_CHANGES
++++ config.ufs[545][[ false == \f\a\l\s\e ]]
++++ config.ufs[546]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ice
+++++ config.ice[3]echo 'BEGIN: config.ice'
BEGIN: config.ice
+++++ config.ice[6]export min_seaice=1.0e-6
+++++ config.ice[6]min_seaice=1.0e-6
+++++ config.ice[7]export use_cice_alb=.true.
+++++ config.ice[7]use_cice_alb=.true.
+++++ config.ice[9]export MESH_ICE=mesh.mx500.nc
+++++ config.ice[9]MESH_ICE=mesh.mx500.nc
+++++ config.ice[11]export CICE_GRID=grid_cice_NEMS_mx500.nc
+++++ config.ice[11]CICE_GRID=grid_cice_NEMS_mx500.nc
+++++ config.ice[12]export CICE_MASK=kmtu_cice_NEMS_mx500.nc
+++++ config.ice[12]CICE_MASK=kmtu_cice_NEMS_mx500.nc
+++++ config.ice[14]echo 'END: config.ice'
END: config.ice
++++ config.ufs[547]export cplice=.true.
++++ config.ufs[547]cplice=.true.
++++ config.ufs[548]model_list=atm.ocean.ice
++++ config.ufs[550][[ false == \t\r\u\e ]]
++++ config.ufs[555]nthreads_cice6=1
++++ config.ufs[556]case "${cice6_res}" in
++++ config.ufs[558]ntasks_cice6=4
++++ config.ufs[559]cice6_processor_shape=slenderX1
++++ config.ufs[580]export nthreads_cice6 ntasks_cice6
++++ config.ufs[581]export cice6_processor_shape
++++ config.ufs[585][[ true == \f\a\l\s\e ]]
++++ config.ufs[629][[ true == \f\a\l\s\e ]]
++++ config.ufs[638]case "${model_list}" in
++++ config.ufs[649]default_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[669]export ufs_configure_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[669]ufs_configure_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[670]unset model_list default_template
++++ config.ufs[673]export 'WW3_RSTFLDS= '
++++ config.ufs[673]WW3_RSTFLDS=' '
++++ config.ufs[675][[ ! -r /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN ]]
++++ config.ufs[680]echo 'END: config.ufs'
END: config.ufs
+++ config.fcst[30]case ${RUN} in
+++ config.fcst[48]export FHMAX_HF=0
+++ config.fcst[48]FHMAX_HF=0
+++ config.fcst[49]export FHOUT_HF=0
+++ config.fcst[49]FHOUT_HF=0
+++ config.fcst[57]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources fcst
++++ config.resources[10](( 1 != 1 ))
++++ config.resources[34]step=fcst
++++ config.resources[36]echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[38]case ${machine} in
++++ config.resources[46]max_tasks_per_node=40
++++ config.resources[48]mem_node_max=96GB
++++ config.resources[106]export max_tasks_per_node
++++ config.resources[108]case ${step} in
++++ config.resources[794]export is_exclusive=True
++++ config.resources[794]is_exclusive=True
++++ config.resources[798][[ YES == \Y\E\S ]]
++++ config.resources[799]export UFS_THREADS=1
++++ config.resources[799]UFS_THREADS=1
++++ config.resources[815](( ntiles > 6 ))
++++ config.resources[823][[ YES == \Y\E\S ]]
++++ config.resources[824](( FV3THREADS = nthreads_fv3 ))
++++ config.resources[825](( FV3PETS = ntasks_fv3 * nthreads_fv3 ))
++++ config.resources[830]echo 'FV3 using (nthreads, PETS) = (1, 12)'
FV3 using (nthreads, PETS) = (1, 12)
++++ config.resources[833]QUILTPETS=0
++++ config.resources[833]QUILTTHREADS=0
++++ config.resources[834][[ .true. == \.\t\r\u\e\. ]]
++++ config.resources[835][[ YES == \Y\E\S ]]
++++ config.resources[836](( QUILTTHREADS = nthreads_fv3 ))
++++ config.resources[837](( QUILTPETS = ntasks_quilt * nthreads_fv3 ))
++++ config.resources[842](( WRTTASK_PER_GROUP = WRTTASK_PER_GROUP_PER_THREAD ))
++++ config.resources[843]export WRTTASK_PER_GROUP
++++ config.resources[845]echo 'QUILT using (nthreads, PETS) = (1, 6)'
QUILT using (nthreads, PETS) = (1, 6)
++++ config.resources[848]ATMTHREADS=1
++++ config.resources[849](( ATMPETS = FV3PETS + QUILTPETS ))
++++ config.resources[850]export ATMPETS ATMTHREADS
++++ config.resources[851]echo 'FV3ATM using (nthreads, PETS) = (1, 18)'
FV3ATM using (nthreads, PETS) = (1, 18)
++++ config.resources[854]NTASKS_TOT=18
++++ config.resources[861]MEDTHREADS=1
++++ config.resources[862]MEDPETS=12
++++ config.resources[863](( 12 > 300 ))
++++ config.resources[864]export MEDPETS MEDTHREADS
++++ config.resources[865]echo 'MEDIATOR using (threads, PETS) = (1, 12)'
MEDIATOR using (threads, PETS) = (1, 12)
++++ config.resources[868]CHMPETS=0
++++ config.resources[868]CHMTHREADS=0
++++ config.resources[869][[ NO == \Y\E\S ]]
++++ config.resources[876]export CHMPETS CHMTHREADS
++++ config.resources[879]WAVPETS=0
++++ config.resources[879]WAVTHREADS=0
++++ config.resources[880][[ NO == \Y\E\S ]]
++++ config.resources[891]export WAVPETS WAVTHREADS
++++ config.resources[894]OCNPETS=0
++++ config.resources[894]OCNTHREADS=0
++++ config.resources[895][[ YES == \Y\E\S ]]
++++ config.resources[896][[ YES == \Y\E\S ]]
++++ config.resources[897](( OCNTHREADS = nthreads_mom6 ))
++++ config.resources[898](( OCNPETS = ntasks_mom6 * nthreads_mom6 ))
++++ config.resources[903]echo 'MOM6 using (threads, PETS) = (1, 8)'
MOM6 using (threads, PETS) = (1, 8)
++++ config.resources[904](( NTASKS_TOT = NTASKS_TOT + OCNPETS ))
++++ config.resources[906]export OCNPETS OCNTHREADS
++++ config.resources[909]ICEPETS=0
++++ config.resources[909]ICETHREADS=0
++++ config.resources[910][[ YES == \Y\E\S ]]
++++ config.resources[911][[ YES == \Y\E\S ]]
++++ config.resources[912](( ICETHREADS = nthreads_cice6 ))
++++ config.resources[913](( ICEPETS = ntasks_cice6 * nthreads_cice6 ))
++++ config.resources[918]echo 'CICE6 using (threads, PETS) = (1, 4)'
CICE6 using (threads, PETS) = (1, 4)
++++ config.resources[919](( NTASKS_TOT = NTASKS_TOT + ICEPETS ))
++++ config.resources[921]export ICEPETS ICETHREADS
++++ config.resources[923]echo 'Total PETS for enkfgdas = 30'
Total PETS for enkfgdas = 30
++++ config.resources[925]declare -x ntasks=30
++++ config.resources[926]declare -x threads_per_task=1
++++ config.resources[927]tasks_per_node=40
++++ config.resources[930][[ enkfgdas == gdas ]]
++++ config.resources[947][[ enkfgdas == enkfgfs ]]
++++ config.resources[947][[ enkfgdas == enkfgdas ]]
++++ config.resources[948]case "${CASE_ENS}" in
++++ config.resources[950]declare -x walltime=00:20:00
++++ config.resources[975]unset NTASKS_TOT
++++ config.resources[1400][[ -f /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources.HERA ]]
++++ config.resources[1401]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources.HERA
+++++ config.resources.HERA[5]case ${step} in
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=threads_per_task_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export threads_per_task
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=ntasks_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export ntasks
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=tasks_per_node_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export tasks_per_node
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=NTASKS_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n '' ]]
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=memory_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n '' ]]
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=walltime_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export walltime
++++ config.resources[1414]echo 'END: config.resources'
END: config.resources
+++ config.fcst[58]export domains_stack_size=16000000
+++ config.fcst[58]domains_stack_size=16000000
+++ config.fcst[61][[ YES == \Y\E\S ]]
+++ config.fcst[62]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.nsst
++++ config.nsst[6]echo 'BEGIN: config.nsst'
BEGIN: config.nsst
++++ config.nsst[11]export NST_MODEL=2
++++ config.nsst[11]NST_MODEL=2
++++ config.nsst[14][[ NO == \Y\E\S ]]
++++ config.nsst[14][[ NO == \Y\E\S ]]
++++ config.nsst[19]export NST_SPINUP=0
++++ config.nsst[19]NST_SPINUP=0
++++ config.nsst[20]cdate=2021032418
++++ config.nsst[21](( cdate < 2017072000 ))
++++ config.nsst[26]export NST_RESV=0
++++ config.nsst[26]NST_RESV=0
++++ config.nsst[29]export ZSEA1=0
++++ config.nsst[29]ZSEA1=0
++++ config.nsst[30]export ZSEA2=0
++++ config.nsst[30]ZSEA2=0
++++ config.nsst[32]export NST_GSI=3
++++ config.nsst[32]NST_GSI=3
++++ config.nsst[36]export NSTINFO=0
++++ config.nsst[36]NSTINFO=0
++++ config.nsst[37](( NST_GSI > 0 ))
++++ config.nsst[37]export NSTINFO=4
++++ config.nsst[37]NSTINFO=4
++++ config.nsst[39]echo 'END: config.nsst'
END: config.nsst
+++ config.fcst[65]export esmf_profile=.false.
+++ config.fcst[65]esmf_profile=.false.
+++ config.fcst[66]export esmf_logkind=ESMF_LOGKIND_MULTI_ON_ERROR
+++ config.fcst[66]esmf_logkind=ESMF_LOGKIND_MULTI_ON_ERROR
+++ config.fcst[71]export FORECASTSH=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/scripts/exglobal_forecast.sh
+++ config.fcst[71]FORECASTSH=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/scripts/exglobal_forecast.sh
+++ config.fcst[73]export FCSTEXEC=gfs_model.x
+++ config.fcst[73]FCSTEXEC=gfs_model.x
+++ config.fcst[77]export TYPE=nh
+++ config.fcst[77]TYPE=nh
+++ config.fcst[78]export MONO=non-mono
+++ config.fcst[78]MONO=non-mono
+++ config.fcst[81]export h2o_phys=.true.
+++ config.fcst[81]h2o_phys=.true.
+++ config.fcst[84]export new_o3forc=YES
+++ config.fcst[84]new_o3forc=YES
+++ config.fcst[86]export gwd_opt=2
+++ config.fcst[86]gwd_opt=2
+++ config.fcst[91](( gwd_opt == 1 ))
+++ config.fcst[101](( gwd_opt == 2 ))
+++ config.fcst[117]export knob_ugwp_version=1
+++ config.fcst[117]knob_ugwp_version=1
+++ config.fcst[118]export do_ugwp=.false.
+++ config.fcst[118]do_ugwp=.false.
+++ config.fcst[119]export do_tofd=.false.
+++ config.fcst[119]do_tofd=.false.
+++ config.fcst[120]export do_ugwp_v0=.false.
+++ config.fcst[120]do_ugwp_v0=.false.
+++ config.fcst[121]export do_ugwp_v1=.true.
+++ config.fcst[121]do_ugwp_v1=.true.
+++ config.fcst[122]export do_ugwp_v0_orog_only=.false.
+++ config.fcst[122]do_ugwp_v0_orog_only=.false.
+++ config.fcst[123]export do_ugwp_v0_nst_only=.false.
+++ config.fcst[123]do_ugwp_v0_nst_only=.false.
+++ config.fcst[124]export do_gsl_drag_ls_bl=.true.
+++ config.fcst[124]do_gsl_drag_ls_bl=.true.
+++ config.fcst[125]export do_gsl_drag_ss=.false.
+++ config.fcst[125]do_gsl_drag_ss=.false.
+++ config.fcst[126]export do_gsl_drag_tofd=.true.
+++ config.fcst[126]do_gsl_drag_tofd=.true.
+++ config.fcst[127]export do_gwd_opt_psl=.true.
+++ config.fcst[127]do_gwd_opt_psl=.true.
+++ config.fcst[128]export do_ugwp_v1_orog_only=.false.
+++ config.fcst[128]do_ugwp_v1_orog_only=.false.
++++ config.fcst[129]echo 128/2.35
++++ config.fcst[129]bc
+++ config.fcst[129]launch_level=54
+++ config.fcst[130]export launch_level
+++ config.fcst[134]export d2_bg_k1=0.20
+++ config.fcst[134]d2_bg_k1=0.20
+++ config.fcst[135]export d2_bg_k2=0.04
+++ config.fcst[135]d2_bg_k2=0.04
+++ config.fcst[136]export dz_min=6
+++ config.fcst[136]dz_min=6
+++ config.fcst[137]export n_sponge=42
+++ config.fcst[137]n_sponge=42
+++ config.fcst[140]export hybedmf=.false.
+++ config.fcst[140]hybedmf=.false.
+++ config.fcst[141][[ FV3_GFS_v17_coupled_p8_ugwpv1 == \F\V\3\_\g\l\o\b\a\l\_\n\e\s\t* ]]
+++ config.fcst[144]export satmedmf=.true.
+++ config.fcst[144]satmedmf=.true.
+++ config.fcst[146]export isatmedmf=1
+++ config.fcst[146]isatmedmf=1
+++ config.fcst[147]tbf=
+++ config.fcst[148][[ .true. == \.\t\r\u\e\. ]]
+++ config.fcst[148]tbf=_satmedmf
+++ config.fcst[151]export progsigma=.true.
+++ config.fcst[151]progsigma=.true.
+++ config.fcst[152]tbp=
+++ config.fcst[153][[ .true. == \.\t\r\u\e\. ]]
+++ config.fcst[153]tbp=_progsigma
+++ config.fcst[156][[ NO == \Y\E\S ]]
+++ config.fcst[159]export IAER=1011
+++ config.fcst[159]IAER=1011
+++ config.fcst[161]export iovr_lw=3
+++ config.fcst[161]iovr_lw=3
+++ config.fcst[162]export iovr_sw=3
+++ config.fcst[162]iovr_sw=3
+++ config.fcst[163]export iovr=3
+++ config.fcst[163]iovr=3
+++ config.fcst[164]export icliq_sw=2
+++ config.fcst[164]icliq_sw=2
+++ config.fcst[165]export isubc_sw=2
+++ config.fcst[165]isubc_sw=2
+++ config.fcst[166]export isubc_lw=2
+++ config.fcst[166]isubc_lw=2
+++ config.fcst[169]export do_RRTMGP=.false.
+++ config.fcst[169]do_RRTMGP=.false.
+++ config.fcst[170]export doGP_cldoptics_LUT=.false.
+++ config.fcst[170]doGP_cldoptics_LUT=.false.
+++ config.fcst[171]export doGP_lwscat=.false.
+++ config.fcst[171]doGP_lwscat=.false.
+++ config.fcst[175]export iopt_sfc=3
+++ config.fcst[175]iopt_sfc=3
+++ config.fcst[176]export iopt_trs=2
+++ config.fcst[176]iopt_trs=2
+++ config.fcst[179]export dnats=0
+++ config.fcst[179]dnats=0
+++ config.fcst[180]export cal_pre=.true.
+++ config.fcst[180]cal_pre=.true.
+++ config.fcst[181]export do_sat_adj=.false.
+++ config.fcst[181]do_sat_adj=.false.
+++ config.fcst[182]export random_clds=.true.
+++ config.fcst[182]random_clds=.true.
+++ config.fcst[184]case ${imp_physics} in
+++ config.fcst[196]export ncld=2
+++ config.fcst[196]ncld=2
+++ config.fcst[197]export FIELD_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/field_table_thompson_noaero_tke_progsigma
+++ config.fcst[197]FIELD_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/field_table_thompson_noaero_tke_progsigma
+++ config.fcst[198]export nwat=6
+++ config.fcst[198]nwat=6
+++ config.fcst[200]export cal_pre=.false.
+++ config.fcst[200]cal_pre=.false.
+++ config.fcst[201]export random_clds=.false.
+++ config.fcst[201]random_clds=.false.
+++ config.fcst[202]export effr_in=.true.
+++ config.fcst[202]effr_in=.true.
+++ config.fcst[203]export ltaerosol=.false.
+++ config.fcst[203]ltaerosol=.false.
+++ config.fcst[204]export lradar=.true.
+++ config.fcst[204]lradar=.true.
+++ config.fcst[205]export ttendlim=-999
+++ config.fcst[205]ttendlim=-999
+++ config.fcst[206]export dt_inner=450
+++ config.fcst[206]dt_inner=450
+++ config.fcst[207]export sedi_semi=.true.
+++ config.fcst[207]sedi_semi=.true.
+++ config.fcst[208][[ .true. == .true. ]]
+++ config.fcst[208]export dt_inner=900
+++ config.fcst[208]dt_inner=900
+++ config.fcst[209][[ dt_inner -gt 300 ]]
+++ config.fcst[209]export dt_inner=300
+++ config.fcst[209]dt_inner=300
+++ config.fcst[210]export decfl=10
+++ config.fcst[210]decfl=10
+++ config.fcst[212]export hord_mt_nh_nonmono=5
+++ config.fcst[212]hord_mt_nh_nonmono=5
+++ config.fcst[213]export hord_xx_nh_nonmono=5
+++ config.fcst[213]hord_xx_nh_nonmono=5
+++ config.fcst[214]export hord_dp_nh_nonmono=-5
+++ config.fcst[214]hord_dp_nh_nonmono=-5
+++ config.fcst[215]export vtdm4_nh_nonmono=0.02
+++ config.fcst[215]vtdm4_nh_nonmono=0.02
+++ config.fcst[216]export nord=2
+++ config.fcst[216]nord=2
+++ config.fcst[217]export dddmp=0.1
+++ config.fcst[217]dddmp=0.1
+++ config.fcst[218]export d4_bg=0.12
+++ config.fcst[218]d4_bg=0.12
+++ config.fcst[220][[ FV3_GFS_v17_coupled_p8_ugwpv1 == \F\V\3\_\g\l\o\b\a\l\_\n\e\s\t* ]]
+++ config.fcst[258]export DO_SPPT=NO
+++ config.fcst[258]DO_SPPT=NO
+++ config.fcst[259]export DO_SKEB=NO
+++ config.fcst[259]DO_SKEB=NO
+++ config.fcst[260]export DO_SHUM=NO
+++ config.fcst[260]DO_SHUM=NO
+++ config.fcst[261]export DO_LAND_PERT=NO
+++ config.fcst[261]DO_LAND_PERT=NO
+++ config.fcst[262]export DO_OCN_SPPT=NO
+++ config.fcst[262]DO_OCN_SPPT=NO
+++ config.fcst[263]export DO_OCN_PERT_EPBL=NO
+++ config.fcst[263]DO_OCN_PERT_EPBL=NO
+++ config.fcst[266]export cplmode=ufs.frac
+++ config.fcst[266]cplmode=ufs.frac
+++ config.fcst[267][[ .true. == \.\f\a\l\s\e\. ]]
+++ config.fcst[270]export psm_bc=1
+++ config.fcst[270]psm_bc=1
+++ config.fcst[272]export min_lakeice=0.15
+++ config.fcst[272]min_lakeice=0.15
+++ config.fcst[273]export min_seaice=1.0e-6
+++ config.fcst[273]min_seaice=1.0e-6
+++ config.fcst[274]export use_cice_alb=.true.
+++ config.fcst[274]use_cice_alb=.true.
+++ config.fcst[276]export FSICL=0
+++ config.fcst[276]FSICL=0
+++ config.fcst[277]export FSICS=0
+++ config.fcst[277]FSICS=0
+++ config.fcst[280][[ enkfgdas =~ gdas ]]
+++ config.fcst[283]export DIAG_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/diag_table_da
+++ config.fcst[283]DIAG_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/diag_table_da
+++ config.fcst[286]export restart_interval=3
+++ config.fcst[286]restart_interval=3
+++ config.fcst[289]export adjust_dry_mass=.true.
+++ config.fcst[289]adjust_dry_mass=.true.
+++ config.fcst[315]echo 'END: config.fcst'
END: config.fcst
++ jjob_header.sh[106]true
++ jjob_header.sh[107]export err=0
++ jjob_header.sh[107]err=0
++ jjob_header.sh[108][[ 0 -ne 0 ]]
++ jjob_header.sh[105]for config in "${configs[@]:-''}"
++ jjob_header.sh[106]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.efcs
+++ config.efcs[6]echo 'BEGIN: config.efcs'
BEGIN: config.efcs
+++ config.efcs[8]export CASE=C48
+++ config.efcs[8]CASE=C48
+++ config.efcs[11]string='--fv3 C48'
+++ config.efcs[13][[ YES == \Y\E\S ]]
+++ config.efcs[14]string='--fv3 C48 --mom6 500'
+++ config.efcs[16][[ YES == \Y\E\S ]]
+++ config.efcs[17]string='--fv3 C48 --mom6 500 --cice6 500'
+++ config.efcs[19][[ NO == \Y\E\S ]]
+++ config.efcs[22][[ NO == \Y\E\S ]]
+++ config.efcs[27]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ufs --fv3 C48 --mom6 500 --cice6 500
++++ config.ufs[9]echo 'BEGIN: config.ufs'
BEGIN: config.ufs
++++ config.ufs[11](( 6 <= 1 ))
++++ config.ufs[26]skip_mom6=true
++++ config.ufs[27]skip_cice6=true
++++ config.ufs[28]skip_ww3=true
++++ config.ufs[29]skip_gocart=true
++++ config.ufs[30]skip_mediator=true
++++ config.ufs[33](( 6 > 0 ))
++++ config.ufs[34]key=--fv3
++++ config.ufs[35]case "${key}" in
++++ config.ufs[37]fv3_res=C48
++++ config.ufs[38]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 4 > 0 ))
++++ config.ufs[34]key=--mom6
++++ config.ufs[35]case "${key}" in
++++ config.ufs[41]mom6_res=500
++++ config.ufs[42]skip_mom6=false
++++ config.ufs[43]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 2 > 0 ))
++++ config.ufs[34]key=--cice6
++++ config.ufs[35]case "${key}" in
++++ config.ufs[46]cice6_res=500
++++ config.ufs[47]skip_cice6=false
++++ config.ufs[48]shift
++++ config.ufs[63]shift
++++ config.ufs[33](( 0 > 0 ))
++++ config.ufs[67][[ false == \f\a\l\s\e ]]
++++ config.ufs[68]skip_mediator=false
++++ config.ufs[71][[ NO == \Y\E\S ]]
++++ config.ufs[84]export grid_type=-1
++++ config.ufs[84]grid_type=-1
++++ config.ufs[88]case "${fv3_res}" in
++++ config.ufs[90]export layout_x=2
++++ config.ufs[90]layout_x=2
++++ config.ufs[91]export layout_y=1
++++ config.ufs[91]layout_y=1
++++ config.ufs[92]export nthreads_fv3=1
++++ config.ufs[92]nthreads_fv3=1
++++ config.ufs[93]export nthreads_ufs=1
++++ config.ufs[93]nthreads_ufs=1
++++ config.ufs[94]export WRITE_GROUP=1
++++ config.ufs[94]WRITE_GROUP=1
++++ config.ufs[95]export WRTTASK_PER_GROUP_PER_THREAD_PER_TILE=1
++++ config.ufs[95]WRTTASK_PER_GROUP_PER_THREAD_PER_TILE=1
++++ config.ufs[99]export DELTIM=900
++++ config.ufs[99]DELTIM=900
++++ config.ufs[100]export xr_cnvcld=.false.
++++ config.ufs[100]xr_cnvcld=.false.
++++ config.ufs[101]export cdmbgwd=0.071,2.1,1.0,1.0
++++ config.ufs[101]cdmbgwd=0.071,2.1,1.0,1.0
++++ config.ufs[102]export cdmbgwd_gsl=40.0,1.77,1.0,1.0
++++ config.ufs[102]cdmbgwd_gsl=40.0,1.77,1.0,1.0
++++ config.ufs[103]export psl_gwd_dx_factor=6.0
++++ config.ufs[103]psl_gwd_dx_factor=6.0
++++ config.ufs[104]export knob_ugwp_tauamp=6.0e-3
++++ config.ufs[104]knob_ugwp_tauamp=6.0e-3
++++ config.ufs[105]export k_split=1
++++ config.ufs[105]k_split=1
++++ config.ufs[106]export n_split=4
++++ config.ufs[106]n_split=4
++++ config.ufs[107]export tau=8.0
++++ config.ufs[107]tau=8.0
++++ config.ufs[108]export rf_cutoff=100.0
++++ config.ufs[108]rf_cutoff=100.0
++++ config.ufs[109]export fv_sg_adj=3600
++++ config.ufs[109]fv_sg_adj=3600
++++ config.ufs[341](( WRTTASK_PER_GROUP_PER_THREAD = WRTTASK_PER_GROUP_PER_THREAD_PER_TILE * 6 ))
++++ config.ufs[342]export WRTTASK_PER_GROUP_PER_THREAD
++++ config.ufs[344](( ntasks_fv3 = layout_x * layout_y * 6 ))
++++ config.ufs[345][[ NO == \Y\E\S ]]
++++ config.ufs[348]export ntasks_fv3
++++ config.ufs[350](( ntasks_quilt = WRITE_GROUP * WRTTASK_PER_GROUP_PER_THREAD ))
++++ config.ufs[351]export ntasks_quilt
++++ config.ufs[355]case ${fv3_res} in
++++ config.ufs[357]zstandard_level=0
++++ config.ufs[358]ideflate=0
++++ config.ufs[359]quantize_nsd=0
++++ config.ufs[360]OUTPUT_FILETYPE_ATM=netcdf
++++ config.ufs[361]OUTPUT_FILETYPE_SFC=netcdf
++++ config.ufs[379]export zstandard_level ideflate quantize_nsd
++++ config.ufs[380]export OUTPUT_FILETYPE_ATM OUTPUT_FILETYPE_SFC
++++ config.ufs[383]export cpl=.false.
++++ config.ufs[383]cpl=.false.
++++ config.ufs[384]export cplflx=.false.
++++ config.ufs[384]cplflx=.false.
++++ config.ufs[385]export cplice=.false.
++++ config.ufs[385]cplice=.false.
++++ config.ufs[386]export cplchm=.false.
++++ config.ufs[386]cplchm=.false.
++++ config.ufs[387]export cplwav=.false.
++++ config.ufs[387]cplwav=.false.
++++ config.ufs[388]export cplwav2atm=.false.
++++ config.ufs[388]cplwav2atm=.false.
++++ config.ufs[389][[ NO == \Y\E\S ]]
++++ config.ufs[392]export CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[392]CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[394]model_list=atm
++++ config.ufs[397][[ false == \f\a\l\s\e ]]
++++ config.ufs[398]export cpl=.true.
++++ config.ufs[398]cpl=.true.
++++ config.ufs[399]export nthreads_mediator=1
++++ config.ufs[399]nthreads_mediator=1
++++ config.ufs[400]export CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[400]CCPP_SUITE=FV3_GFS_v17_coupled_p8_ugwpv1
++++ config.ufs[404][[ false == \f\a\l\s\e ]]
++++ config.ufs[405]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ocn
+++++ config.ocn[3]echo 'BEGIN: config.ocn'
BEGIN: config.ocn
+++++ config.ocn[5]export MESH_OCN=mesh.mx500.nc
+++++ config.ocn[5]MESH_OCN=mesh.mx500.nc
+++++ config.ocn[7]export DO_OCN_SPPT=NO
+++++ config.ocn[7]DO_OCN_SPPT=NO
+++++ config.ocn[8]export DO_OCN_PERT_EPBL=NO
+++++ config.ocn[8]DO_OCN_PERT_EPBL=NO
+++++ config.ocn[11]export MOM6_USE_LI2016=True
+++++ config.ocn[11]MOM6_USE_LI2016=True
+++++ config.ocn[12]export MOM6_THERMO_SPAN=False
+++++ config.ocn[12]MOM6_THERMO_SPAN=False
+++++ config.ocn[14][[ YES == \Y\E\S ]]
+++++ config.ocn[15]export ODA_INCUPD=True
+++++ config.ocn[15]ODA_INCUPD=True
+++++ config.ocn[21][[ YES == \Y\E\S ]]
+++++ config.ocn[22]export ODA_INCUPD_NHOURS=6.0
+++++ config.ocn[22]ODA_INCUPD_NHOURS=6.0
+++++ config.ocn[27]MOM6_INTERP_ICS='{{ MOM6_INTERP_ICS }}'
+++++ config.ocn[28][[ {{ MOM6_INTERP_ICS }} == \Y\E\S ]]
+++++ config.ocn[34]echo 'END: config.ocn'
END: config.ocn
++++ config.ufs[406]export cplflx=.true.
++++ config.ufs[406]cplflx=.true.
++++ config.ufs[407]model_list=atm.ocean
++++ config.ufs[408]nthreads_mom6=1
++++ config.ufs[409]case "${mom6_res}" in
++++ config.ufs[411]ntasks_mom6=8
++++ config.ufs[412]OCNTIM=3600
++++ config.ufs[413]NX_GLB=72
++++ config.ufs[414]NY_GLB=35
++++ config.ufs[415]DT_DYNAM_MOM6=3600
++++ config.ufs[416]DT_THERM_MOM6=3600
++++ config.ufs[417]FRUNOFF=
++++ config.ufs[418]CHLCLIM=seawifs_1998-2006_smoothed_2X.nc
++++ config.ufs[419]MOM6_RESTART_SETTING=r
++++ config.ufs[420]MOM6_RIVER_RUNOFF=False
++++ config.ufs[421]case ${RUN} in
++++ config.ufs[425]MOM6_DIAG_MISVAL=0.0
++++ config.ufs[431]eps_imesh=4.0e-1
++++ config.ufs[432]MOM6_DIAG_COORD_DEF_Z_FILE=oceanda_zgrid_25L.nc
++++ config.ufs[433]MOM6_ALLOW_LANDMASK_CHANGES=False
++++ config.ufs[434]TOPOEDITS=
++++ config.ufs[529]export nthreads_mom6 ntasks_mom6
++++ config.ufs[530]export OCNTIM
++++ config.ufs[531]export NX_GLB NY_GLB
++++ config.ufs[532]export DT_DYNAM_MOM6 DT_THERM_MOM6
++++ config.ufs[533]export FRUNOFF
++++ config.ufs[534]export CHLCLIM
++++ config.ufs[535]export TOPOEDITS
++++ config.ufs[536]export MOM6_RIVER_RUNOFF
++++ config.ufs[537]export MOM6_RESTART_SETTING
++++ config.ufs[538]export eps_imesh
++++ config.ufs[539]export MOM6_DIAG_COORD_DEF_Z_FILE
++++ config.ufs[540]export MOM6_DIAG_MISVAL
++++ config.ufs[541]export MOM6_ALLOW_LANDMASK_CHANGES
++++ config.ufs[545][[ false == \f\a\l\s\e ]]
++++ config.ufs[546]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.ice
+++++ config.ice[3]echo 'BEGIN: config.ice'
BEGIN: config.ice
+++++ config.ice[6]export min_seaice=1.0e-6
+++++ config.ice[6]min_seaice=1.0e-6
+++++ config.ice[7]export use_cice_alb=.true.
+++++ config.ice[7]use_cice_alb=.true.
+++++ config.ice[9]export MESH_ICE=mesh.mx500.nc
+++++ config.ice[9]MESH_ICE=mesh.mx500.nc
+++++ config.ice[11]export CICE_GRID=grid_cice_NEMS_mx500.nc
+++++ config.ice[11]CICE_GRID=grid_cice_NEMS_mx500.nc
+++++ config.ice[12]export CICE_MASK=kmtu_cice_NEMS_mx500.nc
+++++ config.ice[12]CICE_MASK=kmtu_cice_NEMS_mx500.nc
+++++ config.ice[14]echo 'END: config.ice'
END: config.ice
++++ config.ufs[547]export cplice=.true.
++++ config.ufs[547]cplice=.true.
++++ config.ufs[548]model_list=atm.ocean.ice
++++ config.ufs[550][[ false == \t\r\u\e ]]
++++ config.ufs[555]nthreads_cice6=1
++++ config.ufs[556]case "${cice6_res}" in
++++ config.ufs[558]ntasks_cice6=4
++++ config.ufs[559]cice6_processor_shape=slenderX1
++++ config.ufs[580]export nthreads_cice6 ntasks_cice6
++++ config.ufs[581]export cice6_processor_shape
++++ config.ufs[585][[ true == \f\a\l\s\e ]]
++++ config.ufs[629][[ true == \f\a\l\s\e ]]
++++ config.ufs[638]case "${model_list}" in
++++ config.ufs[649]default_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[669]export ufs_configure_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[669]ufs_configure_template=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN
++++ config.ufs[670]unset model_list default_template
++++ config.ufs[673]export 'WW3_RSTFLDS= '
++++ config.ufs[673]WW3_RSTFLDS=' '
++++ config.ufs[675][[ ! -r /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/ufs.configure.s2s.IN ]]
++++ config.ufs[680]echo 'END: config.ufs'
END: config.ufs
+++ config.efcs[30]. /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources efcs
++++ config.resources[10](( 1 != 1 ))
++++ config.resources[34]step=efcs
++++ config.resources[36]echo 'BEGIN: config.resources'
BEGIN: config.resources
++++ config.resources[38]case ${machine} in
++++ config.resources[46]max_tasks_per_node=40
++++ config.resources[48]mem_node_max=96GB
++++ config.resources[106]export max_tasks_per_node
++++ config.resources[108]case ${step} in
++++ config.resources[794]export is_exclusive=True
++++ config.resources[794]is_exclusive=True
++++ config.resources[798][[ YES == \Y\E\S ]]
++++ config.resources[799]export UFS_THREADS=1
++++ config.resources[799]UFS_THREADS=1
++++ config.resources[815](( ntiles > 6 ))
++++ config.resources[823][[ YES == \Y\E\S ]]
++++ config.resources[824](( FV3THREADS = nthreads_fv3 ))
++++ config.resources[825](( FV3PETS = ntasks_fv3 * nthreads_fv3 ))
++++ config.resources[830]echo 'FV3 using (nthreads, PETS) = (1, 12)'
FV3 using (nthreads, PETS) = (1, 12)
++++ config.resources[833]QUILTPETS=0
++++ config.resources[833]QUILTTHREADS=0
++++ config.resources[834][[ .true. == \.\t\r\u\e\. ]]
++++ config.resources[835][[ YES == \Y\E\S ]]
++++ config.resources[836](( QUILTTHREADS = nthreads_fv3 ))
++++ config.resources[837](( QUILTPETS = ntasks_quilt * nthreads_fv3 ))
++++ config.resources[842](( WRTTASK_PER_GROUP = WRTTASK_PER_GROUP_PER_THREAD ))
++++ config.resources[843]export WRTTASK_PER_GROUP
++++ config.resources[845]echo 'QUILT using (nthreads, PETS) = (1, 6)'
QUILT using (nthreads, PETS) = (1, 6)
++++ config.resources[848]ATMTHREADS=1
++++ config.resources[849](( ATMPETS = FV3PETS + QUILTPETS ))
++++ config.resources[850]export ATMPETS ATMTHREADS
++++ config.resources[851]echo 'FV3ATM using (nthreads, PETS) = (1, 18)'
FV3ATM using (nthreads, PETS) = (1, 18)
++++ config.resources[854]NTASKS_TOT=18
++++ config.resources[861]MEDTHREADS=1
++++ config.resources[862]MEDPETS=12
++++ config.resources[863](( 12 > 300 ))
++++ config.resources[864]export MEDPETS MEDTHREADS
++++ config.resources[865]echo 'MEDIATOR using (threads, PETS) = (1, 12)'
MEDIATOR using (threads, PETS) = (1, 12)
++++ config.resources[868]CHMPETS=0
++++ config.resources[868]CHMTHREADS=0
++++ config.resources[869][[ NO == \Y\E\S ]]
++++ config.resources[876]export CHMPETS CHMTHREADS
++++ config.resources[879]WAVPETS=0
++++ config.resources[879]WAVTHREADS=0
++++ config.resources[880][[ NO == \Y\E\S ]]
++++ config.resources[891]export WAVPETS WAVTHREADS
++++ config.resources[894]OCNPETS=0
++++ config.resources[894]OCNTHREADS=0
++++ config.resources[895][[ YES == \Y\E\S ]]
++++ config.resources[896][[ YES == \Y\E\S ]]
++++ config.resources[897](( OCNTHREADS = nthreads_mom6 ))
++++ config.resources[898](( OCNPETS = ntasks_mom6 * nthreads_mom6 ))
++++ config.resources[903]echo 'MOM6 using (threads, PETS) = (1, 8)'
MOM6 using (threads, PETS) = (1, 8)
++++ config.resources[904](( NTASKS_TOT = NTASKS_TOT + OCNPETS ))
++++ config.resources[906]export OCNPETS OCNTHREADS
++++ config.resources[909]ICEPETS=0
++++ config.resources[909]ICETHREADS=0
++++ config.resources[910][[ YES == \Y\E\S ]]
++++ config.resources[911][[ YES == \Y\E\S ]]
++++ config.resources[912](( ICETHREADS = nthreads_cice6 ))
++++ config.resources[913](( ICEPETS = ntasks_cice6 * nthreads_cice6 ))
++++ config.resources[918]echo 'CICE6 using (threads, PETS) = (1, 4)'
CICE6 using (threads, PETS) = (1, 4)
++++ config.resources[919](( NTASKS_TOT = NTASKS_TOT + ICEPETS ))
++++ config.resources[921]export ICEPETS ICETHREADS
++++ config.resources[923]echo 'Total PETS for enkfgdas = 30'
Total PETS for enkfgdas = 30
++++ config.resources[925]declare -x ntasks=30
++++ config.resources[926]declare -x threads_per_task=1
++++ config.resources[927]tasks_per_node=40
++++ config.resources[930][[ enkfgdas == gdas ]]
++++ config.resources[947][[ enkfgdas == enkfgfs ]]
++++ config.resources[947][[ enkfgdas == enkfgdas ]]
++++ config.resources[948]case "${CASE_ENS}" in
++++ config.resources[950]declare -x walltime=00:20:00
++++ config.resources[975]unset NTASKS_TOT
++++ config.resources[1400][[ -f /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources.HERA ]]
++++ config.resources[1401]source /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_285cc940/config.resources.HERA
+++++ config.resources.HERA[5]case ${step} in
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=threads_per_task_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export threads_per_task
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=ntasks_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export ntasks
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=tasks_per_node_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export tasks_per_node
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=NTASKS_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n '' ]]
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=memory_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n '' ]]
++++ config.resources[1405]for resource_var in threads_per_task ntasks tasks_per_node NTASKS memory walltime
++++ config.resources[1406]run_resource_var=walltime_enkfgdas
++++ config.resources[1407][[ -n '' ]]
++++ config.resources[1409][[ -n 0 ]]
++++ config.resources[1410]export walltime
++++ config.resources[1414]echo 'END: config.resources'
END: config.resources
+++ config.efcs[33]export FHOUT=1
+++ config.efcs[33]FHOUT=1
+++ config.efcs[34][[ enkfgdas == \e\n\k\f\g\f\s ]]
+++ config.efcs[39]export FHMIN=3
+++ config.efcs[39]FHMIN=3
+++ config.efcs[40]export FHMAX=9
+++ config.efcs[40]FHMAX=9
+++ config.efcs[41][[ enkfgdas == \e\n\k\f\g\f\s ]]
+++ config.efcs[46]export OUTPUT_FILETYPE_ATM=netcdf
+++ config.efcs[46]OUTPUT_FILETYPE_ATM=netcdf
+++ config.efcs[47]export OUTPUT_FILETYPE_SFC=netcdf
+++ config.efcs[47]OUTPUT_FILETYPE_SFC=netcdf
+++ config.efcs[50]export WRITE_DOPOST=.false.
+++ config.efcs[50]WRITE_DOPOST=.false.
+++ config.efcs[53]export DO_SKEB=YES
+++ config.efcs[53]DO_SKEB=YES
+++ config.efcs[54]export SKEB=0.3
+++ config.efcs[54]SKEB=0.3
+++ config.efcs[55]export SKEB_TAU=21600.
+++ config.efcs[55]SKEB_TAU=21600.
+++ config.efcs[56]export SKEB_LSCALE=250000.
+++ config.efcs[56]SKEB_LSCALE=250000.
+++ config.efcs[57]export SKEBNORM=0
+++ config.efcs[57]SKEBNORM=0
+++ config.efcs[58]export SKEB_NPASS=30
+++ config.efcs[58]SKEB_NPASS=30
+++ config.efcs[59]export SKEB_VDOF=5
+++ config.efcs[59]SKEB_VDOF=5
+++ config.efcs[60]export DO_SHUM=YES
+++ config.efcs[60]DO_SHUM=YES
+++ config.efcs[61]export SHUM=0.005
+++ config.efcs[61]SHUM=0.005
+++ config.efcs[62]export SHUM_TAU=21600.
+++ config.efcs[62]SHUM_TAU=21600.
+++ config.efcs[63]export SHUM_LSCALE=500000.
+++ config.efcs[63]SHUM_LSCALE=500000.
+++ config.efcs[64]export DO_SPPT=YES
+++ config.efcs[64]DO_SPPT=YES
+++ config.efcs[65]export SPPT=0.5
+++ config.efcs[65]SPPT=0.5
+++ config.efcs[66]export SPPT_TAU=21600.
+++ config.efcs[66]SPPT_TAU=21600.
+++ config.efcs[67]export SPPT_LSCALE=500000.
+++ config.efcs[67]SPPT_LSCALE=500000.
+++ config.efcs[68]export SPPT_LOGIT=.true.
+++ config.efcs[68]SPPT_LOGIT=.true.
+++ config.efcs[69]export SPPT_SFCLIMIT=.true.
+++ config.efcs[69]SPPT_SFCLIMIT=.true.
+++ config.efcs[71][[ .true. == \.\t\r\u\e\. ]]
+++ config.efcs[71][[ gaussian_grid == \g\a\u\s\s\i\a\n\_\g\r\i\d ]]
+++ config.efcs[72]export DIAG_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/diag_table_da
+++ config.efcs[72]DIAG_TABLE=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/fv3/diag_table_da
+++ config.efcs[82]export FHSWR=3600.
+++ config.efcs[82]FHSWR=3600.
+++ config.efcs[83]export FHLWR=3600.
+++ config.efcs[83]FHLWR=3600.
+++ config.efcs[84]export IEMS=1
+++ config.efcs[84]IEMS=1
+++ config.efcs[85]export ISOL=2
+++ config.efcs[85]ISOL=2
+++ config.efcs[86]export ICO2=2
+++ config.efcs[86]ICO2=2
+++ config.efcs[87]export dspheat=.true.
+++ config.efcs[87]dspheat=.true.
+++ config.efcs[88]export shal_cnv=.true.
+++ config.efcs[88]shal_cnv=.true.
+++ config.efcs[89]export FHZERO=6
+++ config.efcs[89]FHZERO=6
+++ config.efcs[92][[ YES == \Y\E\S ]]
+++ config.efcs[93]export PREFIX_ATMINC=r
+++ config.efcs[93]PREFIX_ATMINC=r
+++ config.efcs[97]export restart_interval=3
+++ config.efcs[97]restart_interval=3
+++ config.efcs[98][[ enkfgdas == \e\n\k\f\g\f\s ]]
+++ config.efcs[102]echo 'END: config.efcs'
END: config.efcs
++ jjob_header.sh[106]true
++ jjob_header.sh[107]export err=0
++ jjob_header.sh[107]err=0
++ jjob_header.sh[108][[ 0 -ne 0 ]]
++ jjob_header.sh[117]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/env/HERA.env efcs
+++ HERA.env[3][[ 1 -ne 1 ]]
+++ HERA.env[10]step=efcs
+++ HERA.env[12]export 'launcher=srun -l --export=ALL --hint=nomultithread'
+++ HERA.env[12]launcher='srun -l --export=ALL --hint=nomultithread'
+++ HERA.env[13]export 'mpmd_opt=--multi-prog --output=mpmd.%j.%t.out'
+++ HERA.env[13]mpmd_opt='--multi-prog --output=mpmd.%j.%t.out'
+++ HERA.env[24]export OMP_STACKSIZE=2048000
+++ HERA.env[24]OMP_STACKSIZE=2048000
+++ HERA.env[25]export NTHSTACK=1024000000
+++ HERA.env[25]NTHSTACK=1024000000
+++ HERA.env[29][[ -n 11536745 ]]
+++ HERA.env[30]ulimit -s unlimited
+++ HERA.env[31]ulimit -a
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 379938
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) 94208000
open files (-n) 131072
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 379938
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
+++ HERA.env[36][[ -n 30 ]]
+++ HERA.env[36][[ -n 40 ]]
+++ HERA.env[36][[ -n 40 ]]
+++ HERA.env[37]max_threads_per_task=1
+++ HERA.env[38]NTHREADSmax=1
+++ HERA.env[39]NTHREADS1=1
+++ HERA.env[40][[ 1 -gt 1 ]]
+++ HERA.env[43][[ 1 -gt 1 ]]
+++ HERA.env[46]APRUN_default='srun -l --export=ALL --hint=nomultithread -n 30'
+++ HERA.env[52][[ efcs = \p\r\e\p ]]
+++ HERA.env[52][[ efcs = \p\r\e\p\b\u\f\r ]]
+++ HERA.env[59][[ efcs = \p\r\e\p\_\e\m\i\s\s\i\o\n\s ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\i\n\i\t ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\p\r\e\p ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\p\o\s\t\s\b\s ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\p\o\s\t\b\n\d\p\n\t ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\p\o\s\t\b\n\d\p\n\t\b\l\l ]]
+++ HERA.env[63][[ efcs = \w\a\v\e\p\o\s\t\p\n\t ]]
+++ HERA.env[70][[ efcs = \a\t\m\a\n\l\v\a\r ]]
+++ HERA.env[75][[ efcs = \a\t\m\e\n\s\a\n\l\o\b\s ]]
+++ HERA.env[80][[ efcs = \a\t\m\e\n\s\a\n\l\s\o\l ]]
+++ HERA.env[85][[ efcs = \a\t\m\e\n\s\a\n\l\l\e\t\k\f ]]
+++ HERA.env[90][[ efcs = \a\t\m\e\n\s\a\n\l\f\v\3\i\n\c ]]
+++ HERA.env[95][[ efcs = \a\e\r\o\a\n\l\v\a\r ]]
+++ HERA.env[102][[ efcs = \a\e\r\o\a\n\l\g\e\n\b ]]
+++ HERA.env[107][[ efcs = \a\t\m\a\n\l\f\v\3\i\n\c ]]
+++ HERA.env[112][[ efcs = \a\n\l\s\t\a\t ]]
+++ HERA.env[117][[ efcs = \p\r\e\p\o\b\s\a\e\r\o ]]
+++ HERA.env[122][[ efcs = \s\n\o\w\a\n\l ]]
+++ HERA.env[131][[ efcs = \e\s\n\o\w\a\n\l ]]
+++ HERA.env[140][[ efcs = \m\a\r\i\n\e\b\m\a\t ]]
+++ HERA.env[145][[ efcs = \m\a\r\i\n\e\a\n\l\v\a\r ]]
+++ HERA.env[150][[ efcs = \m\a\r\i\n\e\a\n\l\c\h\k\p\t ]]
+++ HERA.env[157][[ efcs = \o\c\n\a\n\a\l\e\c\e\n ]]
+++ HERA.env[162][[ efcs = \m\a\r\i\n\e\a\n\l\l\e\t\k\f ]]
+++ HERA.env[167][[ efcs = \e\c\e\n\_\f\v\3\j\e\d\i ]]
+++ HERA.env[173][[ efcs = \a\n\a\l\c\a\l\c\_\f\v\3\j\e\d\i ]]
+++ HERA.env[178][[ efcs = \a\n\a\l ]]
+++ HERA.env[178][[ efcs = \a\n\a\l\c\a\l\c ]]
+++ HERA.env[207][[ efcs = \o\f\f\l\i\n\e\a\n\l ]]
+++ HERA.env[221][[ efcs = \s\f\c\a\n\l ]]
+++ HERA.env[230][[ efcs = \e\o\b\s ]]
+++ HERA.env[242][[ efcs = \e\u\p\d ]]
+++ HERA.env[251][[ efcs = \f\c\s\t ]]
+++ HERA.env[251][[ efcs = \e\f\c\s ]]
+++ HERA.env[253](( nnodes = (ntasks+tasks_per_node-1)/tasks_per_node ))
+++ HERA.env[254](( ufs_ntasks = nnodes*tasks_per_node ))
+++ HERA.env[256]export 'APRUN_UFS=srun -l --export=ALL --hint=nomultithread -n 40'
+++ HERA.env[256]APRUN_UFS='srun -l --export=ALL --hint=nomultithread -n 40'
+++ HERA.env[257]unset nnodes ufs_ntasks
++ jjob_header.sh[117]true
++ jjob_header.sh[118]export err=0
++ jjob_header.sh[118]err=0
++ jjob_header.sh[119][[ 0 -ne 0 ]]
+ JGLOBAL_FORECAST[14]export DATArestart=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart
+ JGLOBAL_FORECAST[14]DATArestart=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart
+ JGLOBAL_FORECAST[15][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart ]]
+ JGLOBAL_FORECAST[16]export DATAoutput=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/output
+ JGLOBAL_FORECAST[16]DATAoutput=/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/output
+ JGLOBAL_FORECAST[17][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/output ]]
+ JGLOBAL_FORECAST[25]rCDUMP=enkfgdas
+ JGLOBAL_FORECAST[26]rCDUMP=enkfgdas
+ JGLOBAL_FORECAST[27]export rCDUMP=enkfgdas
+ JGLOBAL_FORECAST[27]rCDUMP=enkfgdas
++ JGLOBAL_FORECAST[31]date --utc -d '20210324 18 - 6 hours' +%Y%m%d%H
+ JGLOBAL_FORECAST[31]GDATE=2021032412
+ JGLOBAL_FORECAST[32]declare -rx GDATE
+ JGLOBAL_FORECAST[34]declare -rx gPDY=20210324
+ JGLOBAL_FORECAST[35]declare -rx gcyc=12
+ JGLOBAL_FORECAST[38]YMD=20210324
+ JGLOBAL_FORECAST[38]HH=18
+ JGLOBAL_FORECAST[38]declare_from_tmpl -rx COMIN_ATMOS_INPUT:COM_ATMOS_INPUT_TMPL COMOUT_CONF:COM_CONF_TMPL COMOUT_ATMOS_RESTART:COM_ATMOS_RESTART_TMPL COMIN_ATMOS_RESTART:COM_ATMOS_RESTART_TMPL COMOUT_ATMOS_HISTORY:COM_ATMOS_HISTORY_TMPL COMOUT_ATMOS_MASTER:COM_ATMOS_MASTER_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_ATMOS_INPUT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/input
declare_from_tmpl :: COMOUT_CONF=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/conf
declare_from_tmpl :: COMOUT_ATMOS_RESTART=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/restart
declare_from_tmpl :: COMIN_ATMOS_RESTART=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/restart
declare_from_tmpl :: COMOUT_ATMOS_HISTORY=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/history
declare_from_tmpl :: COMOUT_ATMOS_MASTER=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/master
+ JGLOBAL_FORECAST[46]RUN=enkfgdas
+ JGLOBAL_FORECAST[46]YMD=20210324
+ JGLOBAL_FORECAST[46]HH=12
+ JGLOBAL_FORECAST[46]declare_from_tmpl -rx COMIN_ATMOS_RESTART_PREV:COM_ATMOS_RESTART_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_ATMOS_RESTART_PREV=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart
+ JGLOBAL_FORECAST[50][[ enkfgdas =~ gcafs ]]
+ JGLOBAL_FORECAST[50][[ enkfgdas =~ gcdas ]]
+ JGLOBAL_FORECAST[55]YMD=20210324
+ JGLOBAL_FORECAST[55]HH=18
+ JGLOBAL_FORECAST[55]declare_from_tmpl -rx COMIN_ATMOS_ANALYSIS:COM_ATMOS_ANALYSIS_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_ATMOS_ANALYSIS=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/analysis/atmos
+ JGLOBAL_FORECAST[59][[ NO == \Y\E\S ]]
+ JGLOBAL_FORECAST[68][[ YES == \Y\E\S ]]
+ JGLOBAL_FORECAST[69]YMD=20210324
+ JGLOBAL_FORECAST[69]HH=18
+ JGLOBAL_FORECAST[69]declare_from_tmpl -rx COMIN_OCEAN_ANALYSIS:COM_OCEAN_ANALYSIS_TMPL COMIN_OCEAN_INPUT:COM_OCEAN_INPUT_TMPL COMOUT_MED_RESTART:COM_MED_RESTART_TMPL COMOUT_OCEAN_RESTART:COM_OCEAN_RESTART_TMPL COMOUT_OCEAN_HISTORY:COM_OCEAN_HISTORY_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_OCEAN_ANALYSIS=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/analysis/ocean
declare_from_tmpl :: COMIN_OCEAN_INPUT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/input
declare_from_tmpl :: COMOUT_MED_RESTART=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/med/restart
declare_from_tmpl :: COMOUT_OCEAN_RESTART=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/restart
declare_from_tmpl :: COMOUT_OCEAN_HISTORY=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/history
+ JGLOBAL_FORECAST[75]RUN=enkfgdas
+ JGLOBAL_FORECAST[75]YMD=20210324
+ JGLOBAL_FORECAST[75]HH=12
+ JGLOBAL_FORECAST[75]declare_from_tmpl -rx COMIN_OCEAN_RESTART_PREV:COM_OCEAN_RESTART_TMPL COMIN_MED_RESTART_PREV:COM_MED_RESTART_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_OCEAN_RESTART_PREV=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/ocean/restart
declare_from_tmpl :: COMIN_MED_RESTART_PREV=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/med/restart
+ JGLOBAL_FORECAST[80][[ YES == \Y\E\S ]]
+ JGLOBAL_FORECAST[81]YMD=20210324
+ JGLOBAL_FORECAST[81]HH=18
+ JGLOBAL_FORECAST[81]declare_from_tmpl -rx COMIN_ICE_INPUT:COM_ICE_INPUT_TMPL COMIN_ICE_ANALYSIS:COM_ICE_ANALYSIS_TMPL COMOUT_ICE_RESTART:COM_ICE_RESTART_TMPL COMOUT_ICE_HISTORY:COM_ICE_HISTORY_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_ICE_INPUT=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/input
declare_from_tmpl :: COMIN_ICE_ANALYSIS=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/analysis/ice
declare_from_tmpl :: COMOUT_ICE_RESTART=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/restart
declare_from_tmpl :: COMOUT_ICE_HISTORY=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/history
+ JGLOBAL_FORECAST[86]RUN=enkfgdas
+ JGLOBAL_FORECAST[86]YMD=20210324
+ JGLOBAL_FORECAST[86]HH=12
+ JGLOBAL_FORECAST[86]declare_from_tmpl -rx COMIN_ICE_RESTART_PREV:COM_ICE_RESTART_TMPL
+ bash_utils.sh[39][[ NO == \N\O ]]
+ bash_utils.sh[39]set +x
declare_from_tmpl :: COMIN_ICE_RESTART_PREV=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/ice/restart
+ JGLOBAL_FORECAST[90][[ NO == \Y\E\S ]]
+ JGLOBAL_FORECAST[101]/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/scripts/exglobal_forecast.sh
+ bash[8]'[' -z '' ']'
+ bash[9]case "$-" in
+ bash[12]__lmod_vx=x
+ bash[16]'[' -n x ']'
+ bash[16]set +x
Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for this output (/apps/lmod/lmod/init/bash)
Shell debugging restarted
+ bash[184]unset __lmod_vx
+ exglobal_forecast.sh[81]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/forecast_predet.sh
+ exglobal_forecast.sh[82]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/forecast_det.sh
+ exglobal_forecast.sh[83]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/forecast_postdet.sh
+ exglobal_forecast.sh[84]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/parsing_ufs_configure.sh
+ exglobal_forecast.sh[86]source /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/atparse.bash
+ exglobal_forecast.sh[89]cpl=.true.
+ exglobal_forecast.sh[90]cplflx=.true.
+ exglobal_forecast.sh[91]cplwav=.false.
+ exglobal_forecast.sh[92]cplchm=.false.
+ exglobal_forecast.sh[93]cplice=.true.
+ exglobal_forecast.sh[95]OCNTIM=3600
+ exglobal_forecast.sh[96]DELTIM=900
+ exglobal_forecast.sh[97]ICETIM=900
+ exglobal_forecast.sh[99]CPL_SLOW=3600
+ exglobal_forecast.sh[100]CPL_FAST=900
+ exglobal_forecast.sh[102]echo 'MAIN: Loading common variables before determination of run type'
MAIN: Loading common variables before determination of run type
+ exglobal_forecast.sh[103]common_predet
+ forecast_predet.sh[92]echo 'SUB common_predet: Defining variables for shared through model components'
SUB common_predet: Defining variables for shared through model components
+ forecast_predet.sh[94]RUN=enkfgdas
+ forecast_predet.sh[95]rCDUMP=enkfgdas
+ forecast_predet.sh[97]CDATE=2021032418
+ forecast_predet.sh[98]SDATE=2021032418
+ forecast_predet.sh[99]ENSMEM=001
+ forecast_predet.sh[100]MEMBER=1
+ forecast_predet.sh[103]half_window=3
+ forecast_predet.sh[104]current_cycle=2021032418
++ forecast_predet.sh[105]date --utc -d '20210324 18 - 6 hours' +%Y%m%d%H
+ forecast_predet.sh[105]previous_cycle=2021032412
++ forecast_predet.sh[106]date --utc -d '20210324 18 + 6 hours' +%Y%m%d%H
+ forecast_predet.sh[106]next_cycle=2021032500
++ forecast_predet.sh[107]date --utc -d '20210324 18 - 3 hours' +%Y%m%d%H
+ forecast_predet.sh[107]current_cycle_begin=2021032415
++ forecast_predet.sh[108]date --utc -d '20210324 18 + 3 hours' +%Y%m%d%H
+ forecast_predet.sh[108]current_cycle_end=2021032421
++ forecast_predet.sh[109]date --utc -d '20210325 00 - 3 hours' +%Y%m%d%H
+ forecast_predet.sh[109]next_cycle_begin=2021032421
++ forecast_predet.sh[110]date --utc -d '20210324 18 + 9 hours' +%Y%m%d%H
+ forecast_predet.sh[110]forecast_end_cycle=2021032503
+ forecast_predet.sh[113][[ YES == \Y\E\S ]]
+ forecast_predet.sh[114]model_start_date_current_cycle=2021032415
+ forecast_predet.sh[115]model_start_date_next_cycle=2021032421
+ forecast_predet.sh[130]FHMIN=3
+ forecast_predet.sh[131]FHMAX=9
+ forecast_predet.sh[132]FHOUT=1
+ forecast_predet.sh[133]FHMAX_HF=0
+ forecast_predet.sh[134]FHOUT_HF=0
+ forecast_predet.sh[136][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/conf ]]
+ forecast_predet.sh[138]cd /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
+ forecast_predet.sh[138]true
+ forecast_predet.sh[139]err=0
+ forecast_predet.sh[140][[ 0 -ne 0 ]]
+ forecast_predet.sh[146][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT ]]
+ forecast_predet.sh[146]mkdir -p /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT
+ exglobal_forecast.sh[105]echo 'MAIN: Loading variables before determination of run type'
MAIN: Loading variables before determination of run type
+ exglobal_forecast.sh[106]FV3_predet
+ forecast_predet.sh[152]echo 'SUB FV3_predet: Defining variables for FV3'
SUB FV3_predet: Defining variables for FV3
+ forecast_predet.sh[154][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/history ]]
+ forecast_predet.sh[155][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/master ]]
+ forecast_predet.sh[156][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/restart ]]
+ forecast_predet.sh[157][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/FV3_RESTART ]]
+ forecast_predet.sh[158]/bin/ln -sf /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/FV3_RESTART /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/RESTART
+ forecast_predet.sh[160]FHZERO=6
+ forecast_predet.sh[161]FHCYC=1
+ forecast_predet.sh[162]restart_interval=3
+ forecast_predet.sh[165](( restart_interval == 0 ))
+ forecast_predet.sh[170]mapfile -t FV3_RESTART_FH
++ forecast_predet.sh[170]seq 3 3 9
+ forecast_predet.sh[172]local nrestarts=3
+ forecast_predet.sh[173](( FV3_RESTART_FH[nrestarts-1] != FHMAX ))
+ forecast_predet.sh[180]FV3_OUTPUT_FH=
+ forecast_predet.sh[181]local fhr=3
+ forecast_predet.sh[182](( FHOUT_HF > 0 && FHMAX_HF > 0 ))
++ forecast_predet.sh[186]seq -s ' ' 3 1 9
+ forecast_predet.sh[186]FV3_OUTPUT_FH=' 3 4 5 6 7 8 9'
+ forecast_predet.sh[191][[ NO == \Y\E\S ]]
+ forecast_predet.sh[214]FV3_OUTPUT_FH_NML=' 3 4 5 6 7 8 9'
+ forecast_predet.sh[217][[ 0 -eq 1 ]]
+ forecast_predet.sh[222]PREFIX_ATMINC=r
+ forecast_predet.sh[225]IAUFHRS=3,6,9
+ forecast_predet.sh[226]IAU_DELTHRS=6
+ forecast_predet.sh[231]res=48
+ forecast_predet.sh[232]resp=49
+ forecast_predet.sh[233]npx=49
+ forecast_predet.sh[234]npy=49
+ forecast_predet.sh[235]npz=127
+ forecast_predet.sh[236]io_layout=1,1
+ forecast_predet.sh[240]JCAP_CASE=94
+ forecast_predet.sh[241]LONB_CASE=192
+ forecast_predet.sh[242]LATB_CASE=96
+ forecast_predet.sh[244]JCAP=94
+ forecast_predet.sh[245]LONB=192
+ forecast_predet.sh[246]LATB=96
+ forecast_predet.sh[248]LONB_IMO=192
+ forecast_predet.sh[249]LATB_JMO=96
+ forecast_predet.sh[259]NST_MODEL=2
+ forecast_predet.sh[260]NST_SPINUP=0
+ forecast_predet.sh[261]NST_RESV=0
+ forecast_predet.sh[262]ZSEA1=0
+ forecast_predet.sh[263]ZSEA2=0
+ forecast_predet.sh[264]nstf_name=2,0,0,0,0
+ forecast_predet.sh[265]nst_anl=.true.
+ forecast_predet.sh[271]blocksize=32
+ forecast_predet.sh[274]filtered_terrain=.true.
+ forecast_predet.sh[275]gfs_dwinds=.true.
+ forecast_predet.sh[278]no_dycore=.false.
+ forecast_predet.sh[279]dycore_only=.false.
+ forecast_predet.sh[280]chksum_debug=.false.
+ forecast_predet.sh[281]print_freq=6
+ forecast_predet.sh[287]na_init=1
+ forecast_predet.sh[289]local suite_file=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/sorc/ufs_model.fd/FV3/ccpp/suites/suite_FV3_GFS_v17_coupled_p8_ugwpv1.xml
+ forecast_predet.sh[290][[ ! -f /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/sorc/ufs_model.fd/FV3/ccpp/suites/suite_FV3_GFS_v17_coupled_p8_ugwpv1.xml ]]
+ forecast_predet.sh[296]local num_noahmpdrv
++ forecast_predet.sh[297]grep -c noahmpdrv /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/sorc/ufs_model.fd/FV3/ccpp/suites/suite_FV3_GFS_v17_coupled_p8_ugwpv1.xml
+ forecast_predet.sh[297]num_noahmpdrv=1
+ forecast_predet.sh[298](( num_noahmpdrv > 0 ))
+ forecast_predet.sh[299]lsm=2
+ forecast_predet.sh[300]lheatstrg=.false.
+ forecast_predet.sh[301]landice=.false.
+ forecast_predet.sh[302]iopt_dveg=4
+ forecast_predet.sh[303]iopt_crs=2
+ forecast_predet.sh[304]iopt_btr=1
+ forecast_predet.sh[305]iopt_run=1
+ forecast_predet.sh[306]iopt_sfc=3
+ forecast_predet.sh[307]iopt_frz=1
+ forecast_predet.sh[308]iopt_inf=1
+ forecast_predet.sh[309]iopt_rad=3
+ forecast_predet.sh[310]iopt_alb=1
+ forecast_predet.sh[311]iopt_snf=4
+ forecast_predet.sh[312]iopt_tbot=2
+ forecast_predet.sh[313]iopt_stc=3
+ forecast_predet.sh[314]IALB=2
+ forecast_predet.sh[315]IEMS=1
+ forecast_predet.sh[336][[ nh == \n\h ]]
+ forecast_predet.sh[337]hydrostatic=.false.
+ forecast_predet.sh[338]phys_hydrostatic=.false.
+ forecast_predet.sh[339]use_hydro_pressure=.false.
+ forecast_predet.sh[340]make_nh=.true.
+ forecast_predet.sh[341]pass_full_omega_to_physics_in_non_hydrostatic_mode=.true.
+ forecast_predet.sh[350]consv_te=1.
+ forecast_predet.sh[351][[ NO == \Y\E\S ]]
+ forecast_predet.sh[356]consv_te=1.
+ forecast_predet.sh[357]k_split=1
+ forecast_predet.sh[361]n_split=4
+ forecast_predet.sh[363][[ non- == \m\o\n\o ]]
+ forecast_predet.sh[380]d_con=1.
+ forecast_predet.sh[381]do_vort_damp=.true.
+ forecast_predet.sh[382][[ nh == \n\h ]]
+ forecast_predet.sh[383]hord_mt=5
+ forecast_predet.sh[384]hord_xx=5
+ forecast_predet.sh[385]hord_dp=-5
+ forecast_predet.sh[393][[ non- != \m\o\n\o ]]
+ forecast_predet.sh[393][[ nh == \n\h ]]
+ forecast_predet.sh[394]vtdm4=0.02
+ forecast_predet.sh[400]nggps_ic=.true.
+ forecast_predet.sh[401]ncep_ic=.false.
+ forecast_predet.sh[402]external_ic=.true.
+ forecast_predet.sh[403]mountain=.false.
+ forecast_predet.sh[404]warm_start=.false.
+ forecast_predet.sh[405]read_increment=.false.
+ forecast_predet.sh[406]res_latlon_dynamics='""'
+ forecast_predet.sh[407]increment_file_on_native_grid=.false.
+ forecast_predet.sh[410]do_skeb=.false.
+ forecast_predet.sh[411]do_shum=.false.
+ forecast_predet.sh[412]do_sppt=.false.
+ forecast_predet.sh[413]do_ca=.false.
+ forecast_predet.sh[414]ISEED=0
+ forecast_predet.sh[415]local imem=1
+ forecast_predet.sh[416]local base_seed=20210324180100
+ forecast_predet.sh[418][[ YES == \Y\E\S ]]
+ forecast_predet.sh[419]do_skeb=.true.
+ forecast_predet.sh[420]ISEED_SKEB=20210324180101
+ forecast_predet.sh[423][[ YES == \Y\E\S ]]
+ forecast_predet.sh[424]do_shum=.true.
+ forecast_predet.sh[425]ISEED_SHUM=20210324180102
+ forecast_predet.sh[428][[ YES == \Y\E\S ]]
+ forecast_predet.sh[429]do_sppt=.true.
+ forecast_predet.sh[430]ISEED_SPPT=20210324180103,20210324180104,20210324180105,20210324180106,20210324180107
+ forecast_predet.sh[433][[ YES == \Y\E\S ]]
+ forecast_predet.sh[434]do_ca=.true.
+ forecast_predet.sh[435]ISEED_CA=355578201
+ forecast_predet.sh[438][[ NO == \Y\E\S ]]
+ forecast_predet.sh[451]FNGLAC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_glacier.2x2.grb
+ forecast_predet.sh[452]FNMXIC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_maxice.2x2.grb
+ forecast_predet.sh[453]FNTSFC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/RTGSST.1982.2012.monthly.clim.grb
+ forecast_predet.sh[454]FNSNOC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_snoclim.1.875.grb
+ forecast_predet.sh[455]FNZORC=igbp
+ forecast_predet.sh[456]FNAISC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/IMS-NIC.blended.ice.monthly.clim.grb
+ forecast_predet.sh[457]FNALBC2=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.facsf.tileX.nc
+ forecast_predet.sh[458]FNTG3C=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.substrate_temperature.tileX.nc
+ forecast_predet.sh[459]FNVEGC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc
+ forecast_predet.sh[460]FNMSKH=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_slmask.t1534.3072.1536.grb
+ forecast_predet.sh[461]FNVMNC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc
+ forecast_predet.sh[462]FNVMXC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_greenness.tileX.nc
+ forecast_predet.sh[463]FNSLPC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.slope_type.tileX.nc
+ forecast_predet.sh[464]FNALBC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.snowfree_albedo.tileX.nc
+ forecast_predet.sh[465]FNVETC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.vegetation_type.tileX.nc
+ forecast_predet.sh[466]FNSOTC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.soil_type.tileX.nc
+ forecast_predet.sh[467]FNSOCC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.soil_color.tileX.nc
+ forecast_predet.sh[468]FNABSC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/sfc/C48.mx500.maximum_snow_albedo.tileX.nc
+ forecast_predet.sh[469]FNSMCC=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_soilmgldas.statsgo.t94.192.96.grb
+ forecast_predet.sh[472][[ ! -f /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_soilmgldas.statsgo.t94.192.96.grb ]]
+ forecast_predet.sh[477][[ .true. == \.\f\a\l\s\e\. ]]
+ forecast_predet.sh[480]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_mosaic.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_mosaic.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_mosaic.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_mosaic.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[484]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/ugwp_limb_tau.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/ugwp_limb_tau.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/ugwp_limb_tau.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/ugwp_limb_tau.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[487]local tt
+ forecast_predet.sh[488](( tt = 1 ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[489]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48.mx500_oro_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[490]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/orog/C48/C48_grid.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/C48_grid.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[491]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ls.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ls.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[492]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/ugwd/C48/C48_oro_data_ss.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/oro_data_ss.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[488](( tt++ ))
+ forecast_predet.sh[488](( tt <= ntiles ))
+ forecast_predet.sh[494][[ NO == \Y\E\S ]]
+ forecast_predet.sh[503]local noahmptablefile=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/noahmptable.tbl
+ forecast_predet.sh[504]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/noahmptable.tbl /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/noahmptable.tbl
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/parm/ufs/noahmptable.tbl /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/noahmptable.tbl
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[507](( imp_physics == 8 ))
+ forecast_predet.sh[508]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/CCN_ACTIVATE.BIN /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CCN_ACTIVATE.BIN
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/CCN_ACTIVATE.BIN /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CCN_ACTIVATE.BIN
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[509]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/freezeH2O.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/freezeH2O.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/freezeH2O.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/freezeH2O.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[510]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/qr_acr_qgV2.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/qr_acr_qgV2.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/qr_acr_qgV2.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/qr_acr_qgV2.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[511]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/qr_acr_qsV2.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/qr_acr_qsV2.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/qr_acr_qsV2.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/qr_acr_qsV2.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[514][[ YES == \Y\E\S ]]
+ forecast_predet.sh[515][[ McCormack == \M\c\C\o\r\m\a\c\k\-\e\m\p\i\r\i\c\a\l\-\s\h\-\o\z\h ]]
+ forecast_predet.sh[518]O3FORC=ozprdlos_2015_new_sbuvO3_tclm15_nuchem.f77
+ forecast_predet.sh[523]H2OFORC=global_h2o_pltc.f77
+ forecast_predet.sh[524]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/ozprdlos_2015_new_sbuvO3_tclm15_nuchem.f77 /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/global_o3prdlos.f77
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/ozprdlos_2015_new_sbuvO3_tclm15_nuchem.f77 /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/global_o3prdlos.f77
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[525]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_h2o_pltc.f77 /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/global_h2oprdlos.f77
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_h2o_pltc.f77 /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/global_h2oprdlos.f77
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[529]ISOL=2
+ forecast_predet.sh[531]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_solarconstant_noaa_an.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/solarconstant_noaa_an.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_solarconstant_noaa_an.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/solarconstant_noaa_an.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[532]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_sfc_emissivity_idx.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/sfc_emissivity_idx.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_sfc_emissivity_idx.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/sfc_emissivity_idx.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[535]IAER=1011
+ forecast_predet.sh[538](( IAER == 1011 ))
+ forecast_predet.sh[539]local month mm
+ forecast_predet.sh[540](( month = 1 ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 1
+ forecast_predet.sh[541]mm=01
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m01.nc aeroclim.m01.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m01.nc aeroclim.m01.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 2
+ forecast_predet.sh[541]mm=02
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m02.nc aeroclim.m02.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m02.nc aeroclim.m02.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 3
+ forecast_predet.sh[541]mm=03
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m03.nc aeroclim.m03.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m03.nc aeroclim.m03.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 4
+ forecast_predet.sh[541]mm=04
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m04.nc aeroclim.m04.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m04.nc aeroclim.m04.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 5
+ forecast_predet.sh[541]mm=05
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m05.nc aeroclim.m05.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m05.nc aeroclim.m05.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 6
+ forecast_predet.sh[541]mm=06
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m06.nc aeroclim.m06.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m06.nc aeroclim.m06.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 7
+ forecast_predet.sh[541]mm=07
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m07.nc aeroclim.m07.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m07.nc aeroclim.m07.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 8
+ forecast_predet.sh[541]mm=08
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m08.nc aeroclim.m08.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m08.nc aeroclim.m08.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 9
+ forecast_predet.sh[541]mm=09
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m09.nc aeroclim.m09.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m09.nc aeroclim.m09.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 10
+ forecast_predet.sh[541]mm=10
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m10.nc aeroclim.m10.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m10.nc aeroclim.m10.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 11
+ forecast_predet.sh[541]mm=11
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m11.nc aeroclim.m11.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m11.nc aeroclim.m11.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
++ forecast_predet.sh[541]printf %02d 12
+ forecast_predet.sh[541]mm=12
+ forecast_predet.sh[542]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m12.nc aeroclim.m12.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/aer/merra2.aerclim.2014-2023.m12.nc aeroclim.m12.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[540](( month++ ))
+ forecast_predet.sh[540](( month <=12 ))
+ forecast_predet.sh[546]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_climaeropac_global.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/aerosol.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_climaeropac_global.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/aerosol.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[547](( IAER > 0 ))
+ forecast_predet.sh[548]local file
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1850-1859.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1850-1859.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1850-1859.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1850-1859.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1850-1859.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1860-1869.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1860-1869.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1860-1869.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1860-1869.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1860-1869.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1870-1879.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1870-1879.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1870-1879.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1870-1879.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1870-1879.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1880-1889.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1880-1889.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1880-1889.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1880-1889.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1880-1889.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1890-1899.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1890-1899.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1890-1899.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1890-1899.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1890-1899.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1900-1909.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1900-1909.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1900-1909.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1900-1909.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1900-1909.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1910-1919.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1910-1919.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1910-1919.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1910-1919.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1910-1919.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1920-1929.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1920-1929.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1920-1929.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1920-1929.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1920-1929.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1930-1939.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1930-1939.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1930-1939.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1930-1939.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1930-1939.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1940-1949.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1940-1949.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1940-1949.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1940-1949.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1940-1949.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1950-1959.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1950-1959.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1950-1959.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1950-1959.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1950-1959.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1960-1969.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1960-1969.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1960-1969.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1960-1969.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1960-1969.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1970-1979.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1970-1979.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1970-1979.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1970-1979.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1970-1979.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1980-1989.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1980-1989.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1980-1989.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1980-1989.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1980-1989.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[549]for file in "${FIXgfs}/am/global_volcanic_aerosols"*
++ forecast_predet.sh[550]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/volcanic_aerosols_1990-1999.txt
+ forecast_predet.sh[550]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1990-1999.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1990-1999.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_volcanic_aerosols_1990-1999.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/volcanic_aerosols_1990-1999.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[554]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_BC.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_BC.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_BC.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_BC.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[555]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_OC.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_OC.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_OC.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_OC.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[556]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_DU.v15_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_DU.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_DU.v15_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_DU.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[557]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_SS.v3_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_SS.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_SS.v3_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_SS.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[558]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_SU.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_SU.dat
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/lut/optics_SU.v1_3.dat /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/optics_SU.dat
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[561]ICO2=2
+ forecast_predet.sh[563]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_co2historicaldata_glob.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_glob.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/global_co2historicaldata_glob.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_glob.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[564]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/co2monthlycyc.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2monthlycyc.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/co2monthlycyc.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2monthlycyc.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[567]local co2dir
+ forecast_predet.sh[568]co2dir=fix_co2_proj
+ forecast_predet.sh[569][[ '' == \Y\E\S ]]
+ forecast_predet.sh[572](( ICO2 > 0 ))
+ forecast_predet.sh[573]local file
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2009.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2009.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2009.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2009.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2009.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2010.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2010.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2010.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2010.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2010.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2011.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2011.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2011.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2011.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2011.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2012.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2012.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2012.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2012.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2012.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2013.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2013.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2013.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2013.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2013.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2014.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2014.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2014.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2014.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2014.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2015.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2015.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2015.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2015.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2015.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2016.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2016.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2016.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2016.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2016.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2017.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2017.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2017.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2017.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2017.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2018.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2018.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2018.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2018.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2018.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2019.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2019.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2019.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2019.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2019.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2020.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2020.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2020.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2020.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2020.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2021.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2021.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2021.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2021.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2021.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2022.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2022.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2022.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2022.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2022.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2023.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2023.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2023.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2023.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2023.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2024.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2024.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2024.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2024.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2024.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[574]for file in "${FIXgfs}/am/${co2dir}/global_co2historicaldata"*
++ forecast_predet.sh[575]basename /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/co2historicaldata_2025.txt
+ forecast_predet.sh[575]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2025.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2025.txt
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/am/fix_co2_proj/global_co2historicaldata_2025.txt /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/co2historicaldata_2025.txt
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[580][[ .false. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[107][[ .true. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[108]CMEPS_predet
+ forecast_predet.sh[738]echo 'SUB CMEPS_predet: CMEPS before run type determination'
SUB CMEPS_predet: CMEPS before run type determination
+ forecast_predet.sh[740][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/med/restart ]]
+ forecast_predet.sh[742][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CMEPS_RESTART ]]
+ forecast_predet.sh[743]/bin/ln -sf /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CMEPS_RESTART /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CMEPS_RESTART
+ exglobal_forecast.sh[110][[ .true. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[111]MOM6_predet
+ forecast_predet.sh[693]echo 'SUB MOM6_predet: MOM6 before run type determination'
SUB MOM6_predet: MOM6 before run type determination
+ forecast_predet.sh[695][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/history ]]
+ forecast_predet.sh[696][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/restart ]]
+ forecast_predet.sh[697][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ocean/input ]]
+ forecast_predet.sh[699][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/MOM6_OUTPUT ]]
+ forecast_predet.sh[699]mkdir -p /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/MOM6_OUTPUT
+ forecast_predet.sh[700][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/MOM6_RESTART ]]
+ forecast_predet.sh[701]/bin/ln -sf /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/MOM6_RESTART /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/MOM6_RESTART
++ forecast_predet.sh[705]seq -s ' ' 3 3 9
+ forecast_predet.sh[705]MOM6_OUTPUT_FH='3 6 9'
+ forecast_predet.sh[709]local imem=1
+ forecast_predet.sh[710]local base_seed=20210324180100
+ forecast_predet.sh[712][[ NO == \Y\E\S ]]
+ forecast_predet.sh[716][[ NO == \Y\E\S ]]
+ forecast_predet.sh[721]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/MOM_override /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/hycom1_25.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/layer_coord25.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_hgrid.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_mask.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_mosaic.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_topog.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/oceanda_zgrid_25L.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/MOM_override /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/hycom1_25.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/layer_coord25.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_hgrid.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_mask.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_mosaic.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/ocean_topog.nc /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/mom6/500/oceanda_zgrid_25L.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[724]local spec_file
+ forecast_predet.sh[725]spec_file=/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl/aC48o500/grid_spec.nc
+ forecast_predet.sh[727][[ -s /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl/aC48o500/grid_spec.nc ]]
+ forecast_predet.sh[728]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl/aC48o500/grid_spec.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cpl/aC48o500/grid_spec.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/
+ cpreq[4]'[' 0 -ne 0 ']'
+ exglobal_forecast.sh[113][[ .false. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[116][[ .true. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[117]CICE_predet
+ forecast_predet.sh[669]echo 'SUB CICE_predet: CICE before run type determination'
SUB CICE_predet: CICE before run type determination
+ forecast_predet.sh[671][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/history ]]
+ forecast_predet.sh[672][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/restart ]]
+ forecast_predet.sh[673][[ ! -d /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/ice/input ]]
+ forecast_predet.sh[675][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CICE_OUTPUT ]]
+ forecast_predet.sh[675]mkdir -p /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CICE_OUTPUT
+ forecast_predet.sh[676][[ ! -d /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CICE_RESTART ]]
+ forecast_predet.sh[677]/bin/ln -sf /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CICE_RESTART /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/CICE_RESTART
+ forecast_predet.sh[682]mapfile -t CICE_OUTPUT_FH
++ forecast_predet.sh[682]seq 3 3 9
+ forecast_predet.sh[685]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/grid_cice_NEMS_mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/grid_cice_NEMS_mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[686]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/kmtu_cice_NEMS_mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/kmtu_cice_NEMS_mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_predet.sh[687]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/mesh.mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/fix/cice/500/mesh.mx500.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/
+ cpreq[4]'[' 0 -ne 0 ']'
+ exglobal_forecast.sh[119][[ .false. == \.\t\r\u\e\. ]]
+ exglobal_forecast.sh[122]echo 'MAIN: Variables before determination of run type loaded'
MAIN: Variables before determination of run type loaded
+ exglobal_forecast.sh[124]echo 'MAIN: Determining run type'
MAIN: Determining run type
+ exglobal_forecast.sh[125]UFS_det
+ forecast_det.sh[6]echo 'SUB UFS_det: Run type determination for UFS'
SUB UFS_det: Run type determination for UFS
+ forecast_det.sh[9][[ -f /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.coupler.res ]]
+ forecast_det.sh[10]warm_start=.true.
+ forecast_det.sh[14][[ .true. == \.\f\a\l\s\e\. ]]
+ forecast_det.sh[34]RERUN=NO
+ forecast_det.sh[37][[ enkfgdas =~ gdas ]]
+ forecast_det.sh[38]echo 'RERUN is not available for RUN='\''enkfgdas'\'''
RERUN is not available for RUN='enkfgdas'
+ forecast_det.sh[39]return 0
+ exglobal_forecast.sh[126]echo 'MAIN: run type determined'
MAIN: run type determined
+ exglobal_forecast.sh[128]echo 'MAIN: Post-determination set up of run type'
MAIN: Post-determination set up of run type
+ exglobal_forecast.sh[129]FV3_postdet
+ forecast_postdet.sh[6]echo 'SUB FV3_postdet: Entering for RUN = enkfgdas'
SUB FV3_postdet: Entering for RUN = enkfgdas
+ forecast_postdet.sh[8]echo 'warm_start = .true.'
warm_start = .true.
+ forecast_postdet.sh[9]echo 'RERUN = NO'
RERUN = NO
+ forecast_postdet.sh[14][[ .true. == \.\f\a\l\s\e\. ]]
+ forecast_postdet.sh[26][[ .true. == \.\t\r\u\e\. ]]
+ forecast_postdet.sh[29]local restart_date restart_dir
+ forecast_postdet.sh[30][[ NO == \Y\E\S ]]
+ forecast_postdet.sh[34]restart_date=2021032415
+ forecast_postdet.sh[35]restart_dir=/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart
+ forecast_postdet.sh[39]local file_list
++ forecast_postdet.sh[40]FV3_restarts
++ forecast_predet.sh[58]local fv3_restart_files tile_files
++ forecast_predet.sh[59]fv3_restart_files=(coupler.res fv_core.res.nc)
++ forecast_predet.sh[60]tile_files=(fv_core.res fv_srf_wnd.res fv_tracer.res phy_data sfc_data)
++ forecast_predet.sh[61][[ YES == \Y\E\S ]]
++ forecast_predet.sh[62]tile_files+=(ca_data)
++ forecast_predet.sh[64]local nn tt
++ forecast_predet.sh[65](( nn = 1 ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[66]for tt in "${tile_files[@]}"
++ forecast_predet.sh[67]fv3_restart_files+=("${tt}.tile${nn}.nc")
++ forecast_predet.sh[65](( nn++ ))
++ forecast_predet.sh[65](( nn <= ntiles ))
++ forecast_predet.sh[71]IFS=,
++ forecast_predet.sh[71]echo 'coupler.res fv_core.res.nc fv_core.res.tile1.nc fv_srf_wnd.res.tile1.nc fv_tracer.res.tile1.nc phy_data.tile1.nc sfc_data.tile1.nc ca_data.tile1.nc fv_core.res.tile2.nc fv_srf_wnd.res.tile2.nc fv_tracer.res.tile2.nc phy_data.tile2.nc sfc_data.tile2.nc ca_data.tile2.nc fv_core.res.tile3.nc fv_srf_wnd.res.tile3.nc fv_tracer.res.tile3.nc phy_data.tile3.nc sfc_data.tile3.nc ca_data.tile3.nc fv_core.res.tile4.nc fv_srf_wnd.res.tile4.nc fv_tracer.res.tile4.nc phy_data.tile4.nc sfc_data.tile4.nc ca_data.tile4.nc fv_core.res.tile5.nc fv_srf_wnd.res.tile5.nc fv_tracer.res.tile5.nc phy_data.tile5.nc sfc_data.tile5.nc ca_data.tile5.nc fv_core.res.tile6.nc fv_srf_wnd.res.tile6.nc fv_tracer.res.tile6.nc phy_data.tile6.nc sfc_data.tile6.nc ca_data.tile6.nc'
+ forecast_postdet.sh[40]file_list='coupler.res fv_core.res.nc fv_core.res.tile1.nc fv_srf_wnd.res.tile1.nc fv_tracer.res.tile1.nc phy_data.tile1.nc sfc_data.tile1.nc ca_data.tile1.nc fv_core.res.tile2.nc fv_srf_wnd.res.tile2.nc fv_tracer.res.tile2.nc phy_data.tile2.nc sfc_data.tile2.nc ca_data.tile2.nc fv_core.res.tile3.nc fv_srf_wnd.res.tile3.nc fv_tracer.res.tile3.nc phy_data.tile3.nc sfc_data.tile3.nc ca_data.tile3.nc fv_core.res.tile4.nc fv_srf_wnd.res.tile4.nc fv_tracer.res.tile4.nc phy_data.tile4.nc sfc_data.tile4.nc ca_data.tile4.nc fv_core.res.tile5.nc fv_srf_wnd.res.tile5.nc fv_tracer.res.tile5.nc phy_data.tile5.nc sfc_data.tile5.nc ca_data.tile5.nc fv_core.res.tile6.nc fv_srf_wnd.res.tile6.nc fv_tracer.res.tile6.nc phy_data.tile6.nc sfc_data.tile6.nc ca_data.tile6.nc'
+ forecast_postdet.sh[41]echo 'Copying FV3 restarts for '\''RUN=enkfgdas'\'' at '\''2021032415'\'' from '\''/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart'\'''
Copying FV3 restarts for 'RUN=enkfgdas' at '2021032415' from '/scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart'
+ forecast_postdet.sh[42]local fv3_file restart_file
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.coupler.res
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.coupler.res /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/coupler.res
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.coupler.res /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/coupler.res
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile1.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile1.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile1.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile1.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile2.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile2.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile2.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile2.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile3.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile3.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile3.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile3.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile4.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile4.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile4.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile4.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile5.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile5.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile5.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile5.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_core.res.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_core.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_core.res.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_srf_wnd.res.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_srf_wnd.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_srf_wnd.res.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.fv_tracer.res.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.fv_tracer.res.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/fv_tracer.res.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.phy_data.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.phy_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/phy_data.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.sfc_data.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.sfc_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/sfc_data.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[43]for fv3_file in ${file_list}
+ forecast_postdet.sh[44]restart_file=20210324.150000.ca_data.tile6.nc
+ forecast_postdet.sh[45]cpreq /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile6.nc
+ cpreq[3]cp /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/12/mem001/model/atmos/restart/20210324.150000.ca_data.tile6.nc /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745/INPUT/ca_data.tile6.nc
+ cpreq[4]'[' 0 -ne 0 ']'
+ forecast_postdet.sh[48][[ NO == \Y\E\S ]]
+ forecast_postdet.sh[61]local nn
+ forecast_postdet.sh[62](( nn = 1 ))
+ forecast_postdet.sh[62](( nn <= ntiles ))
+ forecast_postdet.sh[63][[ -f /scratch1/NCEPDEV/global/glopara/CI/3745/RUNTESTS/COMROOT/C48mx500_hybAOWCDA_285cc940/enkfgdas.20210324/18/mem001/model/atmos/restart/20210324.150000.sfcanl_data.tile1.nc ]]
/scratch1/NCEPDEV/global/glopara/CI/3745/global-workflow/ush/forecast_postdet.sh: line 68: COMIN_TRACER_RESTART: unbound variable
+ JGLOBAL_FORECAST[102]export err=1
+ JGLOBAL_FORECAST[102]err=1
+ JGLOBAL_FORECAST[103][[ 1 -ne 0 ]]
+ JGLOBAL_FORECAST[104]err_exit
+ preamble.sh[109]set +eux
-------------------------------------------------------------
-- FATAL ERROR: Job fcst.3242745 failed RETURN CODE 1
-- ABNORMAL EXIT at Mon Jun 2 21:12:57 UTC 2025 on h18c37
-------------------------------------------------------------
Currently Loaded Modules:
1) contrib 45) sp/2.5.0
2) intel/2022.1.2 46) ip/4.3.0
3) stack-intel/2021.5.0 47) grib-util/1.3.0
4) impi/2022.1.2 48) g2tmpl/1.13.0
5) stack-intel-oneapi-mpi/2021.5.1 49) gsi-ncdiag/1.1.2
6) gettext/0.19.8.1 50) crtm-fix/2.4.0.1_emc
7) libxcrypt/4.4.35 51) git-lfs/2.10.0
8) zlib/1.2.13 52) crtm/2.4.0.1
9) sqlite/3.43.2 53) openblas/0.3.24
10) util-linux-uuid/2.38.1 54) py-setuptools/63.4.3
11) python/3.11.6 55) py-numpy/1.23.4
12) hpss/hpss 56) bufr/11.7.0
13) gempak/7.17.0 57) gmake/3.82
14) ncl/6.6.2 58) wgrib2/2.0.8
15) libjpeg/2.1.0 59) py-f90nml/1.4.3
16) jasper/2.0.32 60) py-cftime/1.0.3.4
17) libpng/1.6.37 61) py-netcdf4/1.5.8
18) openjpeg/2.3.1 62) libyaml/0.2.5
19) eccodes/2.32.0 63) py-pyyaml/6.0
20) fftw/3.3.10 64) py-markupsafe/2.1.3
21) nghttp2/1.57.0 65) py-jinja2/3.1.2
22) curl/8.4.0 66) py-bottleneck/1.3.7
23) proj/9.2.1 67) py-numexpr/2.8.4
24) udunits/2.2.28 68) py-et-xmlfile/1.0.1
25) cdo/2.2.0 69) py-openpyxl/3.1.2
26) R/3.6.1 70) py-pytz/2023.3
27) perl/5.38.0 71) py-pyxlsb/1.0.10
28) pkg-config/0.27.1 72) py-xlrd/2.0.1
29) hdf5/1.14.0 73) py-xlsxwriter/3.1.7
30) snappy/1.1.10 74) py-xlwt/1.3.0
31) zstd/1.5.2 75) py-pandas/1.5.3
32) c-blosc/1.21.5 76) py-six/1.16.0
33) netcdf-c/4.9.2 77) py-python-dateutil/2.8.2
34) netcdf-fortran/4.6.1 78) g2c/1.8.0
35) parallel-netcdf/1.12.2 79) netcdf-cxx4/4.3.1
36) parallelio/2.5.10 80) met/9.1.3
37) esmf/8.6.0 81) metplus/3.1.1
38) antlr/2.7.7 82) py-packaging/23.1
39) gsl/2.7.1 83) py-xarray/2023.7.0
40) nco/5.0.6 84) prepobs/1.1.0
41) bacio/2.4.1 85) fit2obs/1.1.7
42) w3emc/2.10.0 86) imagemagick/7.1.1-11
43) prod_util/2.1.1 87) module_base.hera
44) g2/3.4.5
Job fcst.3242745 failed RETURN CODE 1
/scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/fcst.3242745
total 9179379
-rw-rw-r--+ 1 role.glopara stmp 0 Jun 2 21:11 ncepdate
lrwxrwxrwx 1 role.glopara stmp 139 Jun 2 21:12 RESTART -> /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/FV3_RESTART
-rw-r--r--+ 1 role.glopara stmp 4868 Jun 2 21:12 ugwp_limb_tau.nc
-rw-r--r--+ 1 role.glopara stmp 69015 Jun 2 21:12 noahmptable.tbl
-rw-r--r--+ 1 role.glopara stmp 254944848 Jun 2 21:12 freezeH2O.dat
-rw-r--r--+ 1 role.glopara stmp 35288 Jun 2 21:12 CCN_ACTIVATE.BIN
-rw-r--r--+ 1 role.glopara stmp 33118944 Jun 2 21:12 qr_acr_qsV2.dat
-rw-r--r--+ 1 role.glopara stmp 68077680 Jun 2 21:12 qr_acr_qgV2.dat
-rw-r--r--+ 1 role.glopara stmp 7973 Jun 2 21:12 solarconstant_noaa_an.txt
-rw-r--r--+ 1 role.glopara stmp 65679 Jun 2 21:12 sfc_emissivity_idx.txt
-rw-r--r--+ 1 role.glopara stmp 1114844 Jun 2 21:12 global_o3prdlos.f77
-rw-r--r--+ 1 role.glopara stmp 778256 Jun 2 21:12 global_h2oprdlos.f77
-rw-r--r--+ 1 role.glopara stmp 757348864 Jun 2 21:12 aeroclim.m01.nc
-rw-r--r--+ 1 role.glopara stmp 757124972 Jun 2 21:12 aeroclim.m02.nc
-rw-r--r--+ 1 role.glopara stmp 757169773 Jun 2 21:12 aeroclim.m03.nc
-rw-r--r--+ 1 role.glopara stmp 750928667 Jun 2 21:12 aeroclim.m04.nc
-rw-r--r--+ 1 role.glopara stmp 748772000 Jun 2 21:12 aeroclim.m05.nc
-rw-r--r--+ 1 role.glopara stmp 748567804 Jun 2 21:12 aeroclim.m06.nc
-rw-r--r--+ 1 role.glopara stmp 752464507 Jun 2 21:12 aeroclim.m07.nc
-rw-r--r--+ 1 role.glopara stmp 754662038 Jun 2 21:12 aeroclim.m08.nc
-rw-r--r--+ 1 role.glopara stmp 766344330 Jun 2 21:12 aeroclim.m09.nc
-rw-r--r--+ 1 role.glopara stmp 758850678 Jun 2 21:12 aeroclim.m10.nc
-rw-r--r--+ 1 role.glopara stmp 757331378 Jun 2 21:12 aeroclim.m11.nc
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1860-1869.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1850-1859.txt
-rw-r--r--+ 1 role.glopara stmp 3135393 Jun 2 21:12 aerosol.dat
-rw-r--r--+ 1 role.glopara stmp 756858549 Jun 2 21:12 aeroclim.m12.nc
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1920-1929.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1910-1919.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1900-1909.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1890-1899.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1880-1889.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1870-1879.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1970-1979.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1960-1969.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1950-1959.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1940-1949.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1930-1939.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1990-1999.txt
-rw-r--r--+ 1 role.glopara stmp 2689 Jun 2 21:12 volcanic_aerosols_1980-1989.txt
-rw-r--r--+ 1 role.glopara stmp 101749 Jun 2 21:12 optics_SU.dat
-rw-r--r--+ 1 role.glopara stmp 502753 Jun 2 21:12 optics_SS.dat
-rw-r--r--+ 1 role.glopara stmp 202000 Jun 2 21:12 optics_OC.dat
-rw-r--r--+ 1 role.glopara stmp 461637 Jun 2 21:12 optics_DU.dat
-rw-r--r--+ 1 role.glopara stmp 202000 Jun 2 21:12 optics_BC.dat
-rw-r--r--+ 1 role.glopara stmp 27302 Jun 2 21:12 co2monthlycyc.txt
-rw-r--r--+ 1 role.glopara stmp 9037 Jun 2 21:12 co2historicaldata_glob.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2011.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2010.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2009.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2017.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2016.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2015.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2014.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2013.txt
-rw-r--r--+ 1 role.glopara stmp 24629 Jun 2 21:12 co2historicaldata_2012.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2023.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2022.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2021.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2020.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2019.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2018.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2025.txt
-rw-r--r--+ 1 role.glopara stmp 24484 Jun 2 21:12 co2historicaldata_2024.txt
lrwxrwxrwx 1 role.glopara stmp 140 Jun 2 21:12 MOM6_RESTART -> /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/MOM6_RESTART
drwxrwsr-x+ 2 role.glopara stmp 4096 Jun 2 21:12 MOM6_OUTPUT
lrwxrwxrwx 1 role.glopara stmp 141 Jun 2 21:12 CMEPS_RESTART -> /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CMEPS_RESTART
-rw-r--r--+ 1 role.glopara stmp 154762 Jun 2 21:12 mesh.mx500.nc
-rw-r--r--+ 1 role.glopara stmp 10800 Jun 2 21:12 kmtu_cice_NEMS_mx500.nc
-rw-r--r--+ 1 role.glopara stmp 111908 Jun 2 21:12 grid_cice_NEMS_mx500.nc
lrwxrwxrwx 1 role.glopara stmp 140 Jun 2 21:12 CICE_RESTART -> /scratch1/NCEPDEV/stmp2/role.glopara/RUNDIRS/C48mx500_hybAOWCDA_285cc940/enkfgdas.2021032418/enkfgdasefcs001.2021032418/restart/CICE_RESTART
drwxrwsr-x+ 2 role.glopara stmp 4096 Jun 2 21:12 CICE_OUTPUT
drwxrwsr-x+ 2 role.glopara stmp 4096 Jun 2 21:12 INPUT
cat: OUTPUT.3243393: No such file or directory
slurmstepd: error: *** JOB 11536745 ON h18c37 CANCELLED AT 2025-06-02T21:12:57 ***
_______________________________________________________________
Start Epilog on node h18c37 for job 11536745 :: Mon Jun 2 21:13:00 UTC 2025
Job 11536745 finished for user role.glopara in partition hera with exit code 0:0
_______________________________________________________________
End Epilogue Mon Jun 2 21:13:00 UTC 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment