Comments (1)
shams2023
commented on September 22, 2024
我使用 Salesforce/blip2-opt-2.7b 模型（在 RTX 3070 8Gb 上）和 blip2 进行图像字幕。
有时，生成的文本包含不相关或无根据的知识产权，例如响应简单的菠萝图像的“菠萝壁纸 iphone 6”。它偶尔也会包含电视节目的名称，即使它们不相关。此外，当图像是通用智能手机时，它通常会生成“iPhone”。
我怎样才能避免这个问题？生成的文本中存在知识产权是非常不受欢迎的。
Hi, brother, have you solved your problem? I also encountered the same problem. For things that are not in my image, he also generates text descriptions, which is very annoying for me. May I ask how to solve him? Or can we communicate to solve it?
Wishing you a thriving academic career
from lavis.
Related Issues (20)
- which checkpoint to use in first stage pretrain
- Why would you overload the load_state_dict() function in blip2_vicuna_xinstruct.py?
- Reproducing InstructBLIP on Flickr30K HOT 1
- Evaluation issues encountered while fine-tuning blip2
- Differences between pretrain stage2 and finetuning for BLIP2 COCO Captioning
- KeyError: "Name 'captioning' already registered for <class 'lavis.tasks.captioning.CaptionTask'>." How to fix this error?
- AttributeError: 'NoneType' object has no attribute 'from_pretrained'
- The Lavis downloaded using pip in Colab lacks the vicuna 7b or 13b related file for Instructblip.
- error: casting &T to &mut T is undefined behavior, even if the reference is unused, consider instead using an UnsafeCell --> tokenizers-lib/src/models/bpe/trainer.rs:526:47 HOT 1
- what is the meaning of db
- 您好，在运行instructblip的run_damo时候遇到如下问题，但是并未找到设置repo_type的地方
- about instructBlip run scripts file HOT 1
- I have created a multimodal large model technology exchange group,welcome to join us
- blip3-ocr and blip3-grounding links are not working HOT 3
- Hello~ When will the dataset blip3-grounding-50m be released? Found 404 error of the link: https://huggingface.co/datasets/Salesforce/blip3-grounding-50m HOT 1
- Several issues regarding the BLIP3 code HOT 5
- Request for Example: Fine-tuning BLIP-3 on an Interleaved Text-Image Dataset HOT 2
- How to download pretrained_ckpt="/path/to/the/base/model.pt" ? HOT 2
- Multiple process hang by `torch.distributed.barrier()`
- In the second pre-training stage of BLIP2 (i.e., generative learning stage), isn't it true that only Q-Former's image transformer module is involved in the training, while Q-Former's text transformer module is not?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lavis.