Comments (7)
Thanks for pointing this out! I wasn't aware of the other usage when I first wrote the paper. Hopefully the context will make it clear.
It doesn't. This is just confusing. Change the name.
from lora.
Thanks for pointing this out! I wasn't aware of the other usage when I first wrote the paper. Hopefully the context will make it clear.
context will make it clear, but it will still be a confusion because search-engines would mix the results. please consider using different name in the long term
from lora.
An anecdote from a LLM researcher: I had never heard of the LoRa Alliance prior to seeing this issue and have never been in a convo where there has been confusion.
I think the bigger issue is that far too much time has passed for a rebranding to be successful. I'm not sure if your attention was brought to LoRA recently due to it's use to finetune models like GPT-J cheaply, but this paper was released on June 17, 2021 and has hundreds of citations and many hundreds of users. I don't think that rebranding it is going to be feasible at this point.
from lora.
这都能吵起来. 我觉得不用改.
from lora.
Thanks for pointing this out! I wasn't aware of the other usage when I first wrote the paper. Hopefully the context will make it clear.
from lora.
Thanks for your perspectives! Name clashes like this suck.
It's been two years since we made our work public, and numerous people have used or extended it. I don't think I have the power to change how our community uses the name at this point.
I added a link to LoRa Alliance at the top of the README. Please let me know what else I can do to help.
from lora.
Sorry, as I learned about it in hacker news, I thought this was recent.
But my message was just for information.
from lora.
Related Issues (20)
- how to improve the memory ability of lora fine tuning? HOT 1
- models are the same after loading lora parameters using peft library
- Is it necessary to add `model = model.merge_and_unload()` when training a new LoRA adapter?
- How to adjust LoRA into nn.ConvTranspose2d? HOT 2
- Cannot implement LoRA on a custom model containing transformer encoder from pytorch
- _conv_forward() error
- Dynamic Lora Selection In Runtime❓ HOT 1
- Reproduce Lora results is close but not accurate HOT 3
- Guidance Needed on Continuing Training with a New Dataset via LoRA
- After joining Lora, the first few layers show a gradient of 0
- lora-dim == lora-r ?
- LORA on T5 model
- [Question about multi-gpu training] HOT 2
- question for scale!
- Parameter count on GPT-2 medium HOT 1
- Where is the LoRA matrices saved?
- Questions about running the cola dataset script HOT 1
- Questions about replicating NLU experiments
- NLU experiments error HOT 1
- How are the pretrained weigts set to be fixed during training? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lora.