Comments (6)
@SeanNaren or @rohitgr7, mind having a look? 🦦
from lightning-transformers.
Hi @turian, do you mean Can you demonstrate how to fine-tune a pre-trained model on new data?
Because I think unlabeled data
mean the data used for pre-training (i.e without labels, performing the task of MLM, or related). Hi @Borda, I think, I would like to do an example/documentation (if it doesn't exist) for fine-tuning the model using lightning transformer.
from lightning-transformers.
Hi @Borda, I think, I would like to do an example/documentation (if it doesn't exist) for fine-tuning the model using lightning transformer.
That would be great!
from lightning-transformers.
Thanks for the heads up. Hi, @turian, can you provide me the instance where you would like to see an example or the domain you are talking about? Because, the usage of the library (on different task) are given in the readme section.
from lightning-transformers.
@turian @uakarsh how are you doing? 🦦
from lightning-transformers.
Hi @Borda, I am doing good. I was not able to make much of progress, since I am not sure, what is the exact thing, which needs to be solved. Because, if fine-tuning is concerned, I guess there are examples on readme and docs of lightning transformers.
from lightning-transformers.
Related Issues (20)
- Running inference on GPU HOT 3
- DeepSpeed integration broken: Tensors must be CUDA and dense HOT 3
- Support for `pytorch_lightning.Trainer.predict` HOT 1
- Ignore padding tokens when using Translation Task + `padding='max_length'` HOT 6
- What do you guys think about having this in a method called set model? HOT 2
- Shuffle support HOT 2
- HFSaveCheckpoint does not work with deepspeed HOT 5
- LightningCLI compatibility and Type["AutoModel"] HOT 4
- TextClassificationTransformer should log torchmetrics object instead of computed Tensors HOT 1
- How to fix ModuleNotFoundError: No module named 'habana_frameworks.torch' HOT 1
- pip installation issues HOT 4
- Deepspeed sharding and load from checkpoint with custom lightning module - setup() not called during checkpoint loading HOT 2
- Jointly train Question Answering and Multiple Choice HOT 1
- language model load from checkpoint error HOT 1
- Shuffling support
- `TransformerDataModule.setup()` run more than once unnecessarily
- Lightning 1.8 breaks lightning-transformers HOT 1
- Ver0.2.4 compatibility PL v1.8 HOT 6
- HF compatibility issue HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lightning-transformers.