noaa-psl / land-da_update Goto Github PK

It appears that the JEDI log files are swamping the lustre file system on azure. The solution is to put the log files to /dev/null

At the moment we are only set up to assimilate SMAP obs for preprocessed SMAP IODA files. We want to be able to assimilate SMAP obs for any dates, not just those with preprocessed files.

This issue involves the creation of a new SMAP_proc repo where we will process the SMAP obs, and an update to do_landDA.sh to call the SMAP obs processing routine.

The workflow runs crashed when the observation data were not available. I conducted the gts snow DA test from t00z 10/01/2019 to t00z 10/03/2019, and intentionally removed the gts data at t06z 10/01/2019. When I conducted the offline workflow runs, it crashed at the t06z cycle with the following error messages:

srun: error: h16c52: tasks 0-5: Exited with exit code 1
srun: launch/slurm: _step_signal: Terminating StepId=35083794.2

Exception:      Reason: H5Fopen failed
        compat: HDF5_Version_Range: [V110, Latest (1.12.0)]
        filename:       GTS_2019100106.nc
        mode:   ioda::Engines::BackendOpenModes::Read_Only
        source_column:  0
        source_filename:        /scratch2/NCEPDEV/land/data/jedi/fv3-bundle/src/ioda/src/engines/ioda/src/ioda/Engines/HH/HH.cpp
        source_function:        ioda::Group ioda::Engines::HH::openFile(const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> &, ioda::Engines::BackendOpenModes, std::pair<ioda::Engines::HH::HDF5_Version, ioda::Engines::HH::HDF5_Version>)
        source_line:    167

Exception: oops::LocalEnsembleDA<FV3JEDI, UFO and IODA observations> terminating...

Some changes are required to fix the problem.
@ClaraDraper-NOAA If you agree, I can proceed to propose some changes. Please let me know if you have any suggestions. Thanks.

if . is not in $PATH, the script fails.
solution is to use

source ./land_mods_hera

and

./makelinks.sh

also probably a good idea to add

source $MODULESHOME/init/sh

at the top