This repository contains example Jupyter notebooks demonstrating how to use the XDMoD Data Analytics Framework via the xdmod-data
package.
The latest version of this xdmod-notebooks
repository can be downloaded from the releases page โ under "Assets," click one of the "Source code" links.
Follow the instructions below to set up your system to run the notebooks in JupyterLab either through Anaconda or Docker.
- Install Anaconda following these instructions.
- Open Anaconda Navigator following these instructions.
- Launch JupyterLab (NOT Jupyter Notebook).
- Install Docker following these instructions.
- Run a new Docker container named
xdmod-notebooks
on port8888
based on Jupyter's latest SciPy Docker image by running this command:docker run -p8888:8888 --name xdmod-notebooks jupyter/scipy-notebook:latest
- Copy-paste the URL listed on your terminal / command prompt that starts with
http://127.0.0.1
into a web browser to take you to JupyterLab. - Note: Subsequent runs of the Docker container should use this command instead of
docker run
:docker start -i xdmod-notebooks
- Once you have JupyterLab open, you can upload and run the notebooks from your copy of this repository by clicking the Upload button (
). If you are not familiar with Jupyter notebooks, the "Help" tab may provide useful information.
- The notebooks can be run independently and in any order; however, you may find this order to be the most helpful when starting out:
- XDMoD-Data-First-Example.ipynb
- XDMoD-Data-Raw-Data-Example.ipynb
- XDMoD-Data-Machine-Learning-Example.ipynb
An example R Markdown file is available here.
We welcome your feedback and feature requests for the XDMoD Data Analytics Framework via email: [email protected].
For support, please see this page. If you email for support, please include the following:
xdmod-data
version number, obtained by running this code in a Jupyter cell:from xdmod_data import __version__ print(__version__)
- Operating system version.
- Anaconda or Docker version.
- JupyterLab version.
- Name of the notebook you are using.
- Version number of the notebook listed at the top and bottom of the notebook.
- A description of the problem you are experiencing.
- Detailed steps to reproduce the problem.
We welcome your contributions of new notebooks or edits to existing notebooks that can be shared with others to demonstrate use of the XDMoD Data Analytics Framework. Contributions can be made via GitHub Pull Requests to this repository.
The notebooks in this repository are released under the GNU Lesser General Public License ("LGPL") Version 3.0. See the LICENSE file for details.
When referencing the Data Analytics Framework for XDMoD, please cite the following publication:
Weeden, A., White, J.P., DeLeon, R.L., Rathsam, R., Simakov, N.A., Saeli, C., and Furlani, T.R. The Data Analytics Framework for XDMoD. SN COMPUT. SCI. 5, 462 (2024). https://doi.org/10.1007/s42979-024-02789-2
When referencing XDMoD, please cite the following publication:
Jeffrey T. Palmer, Steven M. Gallo, Thomas R. Furlani, Matthew D. Jones, Robert L. DeLeon, Joseph P. White, Nikolay Simakov, Abani K. Patra, Jeanette Sperhac, Thomas Yearke, Ryan Rathsam, Martins Innus, Cynthia D. Cornelius, James C. Browne, William L. Barth, Richard T. Evans, "Open XDMoD: A Tool for the Comprehensive Management of High-Performance Computing Resources", Computing in Science & Engineering, Vol 17, Issue 4, 2015, pp. 52-62. DOI:10.1109/MCSE.2015.68