GithubHelp home page GithubHelp logo

lukashedegaard / continual-transformers Goto Github PK

View Code? Open in Web Editor NEW
26.0 26.0 3.0 7.9 MB

Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]

License: Apache License 2.0

Makefile 0.04% Python 1.22% Jupyter Notebook 98.74%

continual-transformers's Introduction

๐Ÿ‘‹ Hi, I'm Lukas Hedegaard

PostDoc at Aarhus University, Denmark researching Deep Learning, network acceleration and Transfer Learning applied to Computer Vision and Natural Language Processing. Recent works include:

Apart from doing ML research projects (like real-time Human Activity Recognition using CoX3D โ˜๏ธ), I like to package code up nicely and open-source whenever it may be of value. Open-source libraries include:

  • Continual Inference [๐Ÿ, C++] downloads - Building blocks for Continual Inference Networks in PyTorch.
  • Ride [๐Ÿ] downloads - Training wheels, side rails, and helicopter parent for your Deep Learning projects in PyTorch.
  • OpenDR [๐Ÿ, C++] downloads - A modular, open and non-proprietary toolkit for core robotic functionalities by harnessing deep learning.
  • DatasetOps [๐Ÿ] downloads - Fluent dataset operations, compatible with your favorite libraries.
  • PyTorch Benchmark [๐Ÿ] downloads - Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption.
  • Co-Rider [๐Ÿ] downloads - Tiny configuration library tailored for the Ride ecosystem.
  • Supers [๐Ÿ] downloads - Call a function in all superclasses using supers(self).foo(42).
  • react-native-svg-pan-zoom [JS] downloads - Pan-zoom via two-finger "Google Maps"-style pinch and drag gestures.
  • redux-maybe [JS] downloads - Nodejs Package for attaching callback functions to redux messages.
  • redux-blabber [JS] downloads - Redux store enhancer for synchronizing states and actions across store instances.

Find me ๐ŸŒ

continual-transformers's People

Contributors

lukashedegaard avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

continual-transformers's Issues

import error

hello! I have installed "continual-inferenceโ€œ but I got this error๏ผŒ I think it may be because the version of "continual-inferenceโ€œ is incorrect. Could you please tell me the correct installed version of "continual-inferenceโ€œ?

from continual.module import CallMode
ImportError: cannot import name 'CallMode'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.