Comments (9)
The pipeline running error will only throw exceptions but won't hang, so we need to check the cause of the hang
from examples.
https://towhee.io/data-source/csv-reader Here are some examples related to processing CSV and Batch
from examples.
You can use pstack
or strace
to see where the program is hanging
from examples.
i find the function drop_emtpy in the Early version,but i don't know how to use it in the latest version,how to use it with pipe
from examples.
If an error occurs during execution, it will raise an exception. If you want to ignore the exception, you just need to catch it
try:
# run pipeline
except:
pass
from examples.
Sorry, let me rephrase my question. I currently have a CSV file with URLs of images and their corresponding text descriptions. I would to extract features from both the images and text, then merge, and finally store them in a database. However, I am facing a few issues. Firstly, when reading the URLs, some of them may be failure. How can I implement handling to continue the program execution? Secondly, how can I perform batch processing? Are there any relevant examples available?
from examples.
thanks a lot!I've solved the hanging problem。BUT there is another questions,when i use batch, the Processing is not speeding up,can batch use with gpu ,is there any example
from examples.
You can use the debug interface to see where the performance bottleneck is, https://towhee.readthedocs.io/en/latest/debug/usage.html#usage
from examples.
The slowness could be caused by the image downloading and decoding.
from examples.
Related Issues (20)
- RuntimeError: Node-video-copy-detection/temporal-network-7 runs failed, error msg: module 'numpy' has no attribute 'bool'. HOT 3
- text_image_search demo clip_op.train error HOT 1
- Error: CollectionNotExists for example text-to-text search HOT 3
- Collection returns empty in question answering engine. HOT 3
- Use clip to load local model HOT 1
- MilvusException: <MilvusException: (code=2, message=Fail connecting to server on 127.0.0.1:19530. Timeout)> HOT 2
- 以图搜图如何使用自己的模型 HOT 8
- How to free GPU memory HOT 1
- RuntimeError: Loading operator with error:Load operator failed HOT 5
- how to ensure that the model is only loaded once when extracting feature vectors HOT 1
- TypeError: 'torch._C.Node' object is not subscriptable HOT 2
- huggingface_hub.utils._errors.LocalEntryNotFoundError ... HOT 4
- 数据存放失败 HOT 6
- dpr模型无法下载
- convert_video2gif function error
- Gradio界面出来无响应
- Repair two small pits for 1_build_text_image_search_engine.ipynb
- Problem with Running sample NLP Text Search application
- 1_build_image_search_engine更改metric_type为COSINE后,检索时出错【expected=COSINE, actual=L2】 HOT 4
- Error in embeddings pipe HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from examples.