GithubHelp home page GithubHelp logo

eleutherai / deeperspeed Goto Github PK

View Code? Open in Web Editor NEW

This project forked from microsoft/deepspeed

159.0 4.0 45.0 182.61 MB

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Home Page: https://www.deepspeed.ai/

License: Apache License 2.0

Python 68.92% Shell 0.40% C++ 20.58% Cuda 9.61% Dockerfile 0.13% C 0.36% Batchfile 0.01%

deeperspeed's Introduction

License MIT

DeeperSpeed

DeeperSpeed is a fork of Microsoft's Deepspeed library that is tailor-made for the GPT-NeoX by EleutherAI.

Prior to 3/9/2023, DeeperSpeed was based on an old version of DeepSpeed (0.3.15). In order to migrate to the latest upstream DeepSpeed version while allowing users to access the old versions of GPT-NeoX and DeeperSpeed, we have introduced two versioned releases for both libraries:

deeperspeed's People

Contributors

adammoody avatar aphedges avatar arashb avatar awan-10 avatar chunyang-wen avatar cli99 avatar cmikeh2 avatar conglongli avatar delock avatar dependabot[bot] avatar digger-yu avatar eltonzheng avatar guoyejun avatar heyangqin avatar inkcherry avatar jeffra avatar jomayeri avatar lekurile avatar loadams avatar manuelciosici avatar molly-smith avatar mrwyattii avatar quentin-anthony avatar rezayazdaniaminabadi avatar rraminen avatar samadejacobs avatar samyam avatar stas00 avatar tjruwase avatar tohtana avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar

Forkers

benwaldner neuroidss eghbalhosseini annos-ibm soulmaestro igor0 stellaathena jesseasamoa drunkcoding linyxus zhuzilin degerli aeroscripts jv3b richhankins dmeister daleang otheruniversum augmentcode dakinggg xinhjbrant mooreliving777 mlrichter mofitn3577 ozmode sunhonghua1 siva3v bentherien leaves-zwx new5558 lorrinwww hills-code taegyeongeo zhaoting a663e-36z1120 cerebrasresearch gaah thegreatunknown74 oskarvanderwal segyges b-zwarg dayofthepenguin ineil77 strke vaibtan

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.