erdc / rapidpy

RAPIDpy is a python interface for RAPID that assists to prepare inputs, runs the RAPID program, and provides post-processing utilities.

RAPIDpy

Documentation: http://rapidpy.readthedocs.io/en/latest

RAPIDpy is a python interface for RAPID that assists to prepare inputs, runs the RAPID program, and provides post-processing utilities. More information about installation and the input parameters for RAPID can be found at http://rapid-hub.org.

The source code for RAPID is located at https://github.com/c-h-david/rapid/.

Credit

• The development of RAPIDpy was funded by ERDC.
• The pre-processing GIS tools and the inflow tools in RAPIDpy are based on the ESRI RAPID Toolbox (https://github.com/Esri/python-toolbox-for-rapid).

How the Inflow and GIS tools work:

Snow, Alan D., Scott D. Christensen, Nathan R. Swain, E. James Nelson, Daniel P. Ames, Norman L. Jones, Deng Ding, Nawajish S. Noman, Cedric H. David, Florian Pappenberger, and Ervin Zsoter, 2016. A High-Resolution National-Scale Hydrologic Forecast System from a Global Ensemble Land Surface Model. Journal of the American Water Resources Association (JAWRA) 1-15, DOI: 10.1111/1752-1688.12434 https://onlinelibrary.wiley.com/doi/full/10.1111/1752-1688.12434

Snow, Alan Dee, "A New Global Forecasting Model to Produce High-Resolution Stream Forecasts" (2015). All Theses and Dissertations. Paper 5272. http://scholarsarchive.byu.edu/etd/5272

Publications using RAPID and RAPIDpy:

Tavakoly, A. A., A. D. Snow, C. H. David, M. L. Follum, D. R. Maidment, and Z.-L. Yang, (2016) "Continental-Scale River Flow Modeling of the Mississippi River Basin Using High-Resolution NHDPlus Dataset", Journal of the American Water Resources Association (JAWRA) 1-22. DOI: 10.1111/1752-1688.12456

Datasets produced using RAPID and RAPIDpy:

Ahmad A Tavakoly. (2017). RAPID input files corresponding to the Mississippi River Basin using the NHDPlus v2 Dataset [Data set]. Zenodo. http://doi.org/10.5281/zenodo.322886 |Mississippi Dataset DOI|

.. |Mississippi Dataset DOI| image:: https://zenodo.org/badge/DOI/10.5281/zenodo.322886.svg :target: https://doi.org/10.5281/zenodo.322886

Other tools to prepare input for RAPID

• For ESRI users: https://github.com/Esri/python-toolbox-for-rapid
• Modified version of the ESRI RAPID Toolbox: https://github.com/erdc/python-toolbox-for-rapid
• For the NHDPlus dataset: https://github.com/c-h-david/RRR

rapidpy's Issues

Add OSX Travis-CI build tests

.idea

.idea folder inadvertently added.

1. Delete them
2. Add to .gitignore

Add WRF Weight Table Generation

Fix weight table generation error

There are some instances when a GEOSS exception is thrown and the weight table generation fails. @sdc50 is looking into it.

Add readthedocs documentation

Conda Installation

I cannot install RAPIDpy using conda. Here is what I'm getting:

I'm using a 32bit machine and makes me wonder if RAPIDpy is only available in conda for 64bit.

Set generate_initialization_file=True in run_lsm_rapid_process method but nothing generates

I was running a set of FLDAS land surface model outputs for several HydroSHEDS drainage basins using the run_lsm_rapid_process method.

After completing several RAPID runs, one of the initializations file was not generated by the code. This leads to the namelist pointing to the previously processed watershed and an error interrupting processing.

Update Qinit file to use NetCDF

See: c-h-david/rapid#4

Is RAPID reading m3 file correctly?

Change installation instructions to ensure that mpiexec is installed

I got the following error:

File "/usr/local/lib/python2.7/dist-packages/RAPIDpy/rapid.py", line 375, in run
stdout=PIPE, stderr=PIPE, shell=False)
File "/usr/lib/python2.7/subprocess.py", line 710, in init
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
Write failed: Broken pipe

After some digging in I realized that on our compute blades we didn't have mpiexec installed.

I installed mpiexec by running: apt-get install openmpi-bin

Generate Seasonal Average file

As suggested by @sdc50, a smaller file to have on the compute server would be the seasonal initialization file with 365 days of seasonal averages from 35 years of historical data.

Leap year issues with CMIP5 data

When ending a time period on a leap year, an index error occurs. For example, doing RAPIDpy for 1971-1972 crashes, because 1972 is a leap year. But if you do RAPIDpy for 1971-1973, it works fine.

Also, on some installations (problem on my Linux desktop, but not on the HPC install), generating the m3 file for a multi-year time period has an error related to leap years. A problem in the m3 file data occurs every four years, and the number of days is only 365 times the number of years, instead of some years having 366 days.

HydroStats

Look into using: https://github.com/erdc-cm/hydro-stats for return period generation.

Runoff data from ISBA-SURFEX model

We use a ISBA-SURFEX model with grid 4/4 km. We want to use the output in grid for runoff for input in RAPID. What should be the file structure to use it in RAPIDpy?