GithubHelp home page GithubHelp logo

helmholtz-analytics / heat Goto Github PK

View Code? Open in Web Editor NEW
192.0 10.0 54.0 19.36 MB

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

Home Page: https://heat.readthedocs.io/

License: MIT License

Python 94.31% Dockerfile 0.02% Jupyter Notebook 5.54% Shell 0.13%
gpu tensors distributed machine-learning mpi numpy python pytorch array-api data-analytics

heat's People

Contributors

asrani1 avatar ben-bou avatar bhagemeier avatar cdebus avatar claudiacomito avatar coquelin77 avatar dependabot[bot] avatar dhruv454000 avatar fosterfeld avatar github-actions[bot] avatar inzlinger avatar juanpedroghm avatar krajsek avatar lehr-fa avatar lenablind avatar lscheib avatar lucaspataro avatar markus-goetz avatar mrfh92 avatar mtar avatar mystic-slice avatar neosunhan avatar pre-commit-ci[bot] avatar rainman110 avatar sai-suraj-27 avatar sebimarkgraf avatar shahpratham avatar simon-schmitz avatar step-security-bot avatar theslimvreal avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

heat's Issues

ht.randn(): unit test expects pytorch to detect malformed input

The unit test that checks whether ht.randn throws a ValueError depends on the fact that pytorch
shall detect malformed input. Unfortunately, this is not the case for my pytorch installation (trying to print the resulting tensor, however, results in an infinite loop, such that we can be sure that pytorch does not magically know how to handle negative dimensions ... )

For completeness the pytest output:

        with self.assertRaises(ValueError):
>           ht.randn(-1, 3, dtype=ht.float64)
E           AssertionError: ValueError not raised

heat/core/tests/test_tensor.py:278: AssertionError

There seems to be already some all_ints variable available in ht.randn, which could be augmented to also check for positive arguments?

Provide a array() tensor factory function

Similar to numpy, it would be nice to have a array factory function to create tensors from local data.
Major implementation challenge is how to deal with imbalanced data distributions/initial passed arrays. Do we need to balance the data?

Add optional netCDF support

  • Allow rudimentary netCDF support akin to what the HDF5 layer can already do
  • Offer a possibility to write netCDF files

Fix coverage report

Apparently, our coverage report is not generated again on every build. It seems like the 'coverage' executable is not among the cached contents for build, but the Python library is.

ht.floor: fix docstring to properly render math

Everytime I edit edit tensor.py and run pytest, pytest prints a warning that the docstring of ht.floor contains an unknown escape sequence \lfloor. Mysteriously, this warning does not show up in the second run of pytest, which might explain why this was not caught in CI yet.

Introduce possibility to allocate tensors on different devices

Possible design:

  • An allocation parameter for all factory functions
import heat as ht
a = ht.zeros((10,2,), device='gpu<:id>')
  • .cpu() and .gpu() methods for the tensor class that allow adhoc switching between devices
  • global default device toggle, using a function call and/or a context manager
import heat as ht
ht.device('gpu<:id>')

#alternative
with ht.gpu(<':id'>):
    ht.zeros()

Fix project description on PyPI

PyPI requires both a description and long_description to be set, with the former being used for listing a project among others and the latter for the detailed project page.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.