Comments (3)
Hi there - this is most likely due to verification of library version against the newest release which happens at first import.
Maybe you see something like that in logs:
[06/20/24 10:31:39] WARNING Your inference package version 0.11.2 is out of date! Please __init__.py:35
upgrade to version 0.12.1 of inference for the latest
features and bug fixes by running `pip install --upgrade
inference`.
To prevent version check set DISABLE_VERSION_CHECK=True
There may also be the case that we require plenty of dependent libraries and the library is big itself. We have docker image with inference server that can be hosted in AWS lambda, from our experience it works well, without timeouts as u described - so maybe that's an option to consider. If u could provide more details about deployment you created I am happy to help investigating the issue.
from inference.
We've removed the library and replaced it with a call to the API so we're ok now thank you.
The inference-sdk version was 0.11.2
so yes it could have been the version check adding to the time. I'm not sure. I don't remember seeing that message otherwise I would have followed it so perhaps it was just getting swallowed by the logs somehow.
I'll close this now as it's no longer an active issue for us. Thank you for you help and response though. Much appreciated! :)
from inference.
👍
from inference.
Related Issues (20)
- Workflows `clip` block to return classes list
- Improved error messages in inference package
- 🌟 Usage Tracking HOT 1
- 🌟 Premium/Enterprise Blocks
- 🌟 Version Control
- Supervision visualization blocks
- Was not able to run YOLOWorld with inference v0.13.0 HOT 2
- Deleting image tags HOT 3
- Is support for ROCMExecutionProvider planned? HOT 3
- Bug: Abnormal Confidence Scores in YOLO-World Inference Due to New Version Bug HOT 19
- Compatiblity issue with latest onnxruntime HOT 5
- Bug: Abnormal Installation of inference-gpu[yolo-world] and inference[yolo-world] HOT 8
- Inference cannot find the IP associated with a system
- Failed to build zxing-cpp HOT 11
- Add REDETR (Real Time Object Detection Transformer) Model HOT 3
- no module named distutils HOT 3
- Set timeouts on requests made internally by the `inference` HOT 1
- Empty `sv.Detections` in workflows lack metadata
- Improve API structure + put non-async handlers properly
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inference.