Comments (1)
@bilgeyucel I investigated this issue, and the proper solution seems to be using https://github.com/huggingface/text-generation-inference/tree/main/clients/python#inference-api-usage call and the approach:
from text_generation.inference_api import deployed_models
print(deployed_models())
to see what models are deployed in the free tier. We can do this in the warm_up method only once. If the model specified by the user is not on the list, we'll raise an exception explaining exactly that. Of course, we'll do this only when free-tier is used i.e when url param is None. cc @anakin87
from haystack.
Related Issues (20)
- Rethink TGI Generators HOT 1
- Add LostInTheMiddleRanker usage example
- Revamp Haystack README.md
- Branch-off 2.0.x
- To be able to pass custom arguments to a custom File Converter method HOT 3
- latest openai embedding support is not working and still assuming the model name is from hugging face HOT 3
- Review integration markdown files HOT 1
- `MetaFieldRanker` - the `weight` parameter passed in the `run` method is not taken into account
- docs: create guide to choose Embedders
- Use `Secret` in `ExtractiveReader` for passing authentication secrets
- Unexpected HuggingFaceTEITextEmbedder behaviour HOT 1
- Automate release notes being pushed
- Add support to gpt-3.5-turbo-0125 OpenAI model HOT 2
- `reno` might fail generating release notes file when using some encoding HOT 3
- claude-3-sonnet-20240229 is not supported HOT 4
- Rethink testing strategy for HF-based components
- 'str' object has no attribute 'resolve_value'
- update deepset/haystack:base-main docker image to fix CVE-2023-52425 HOT 1
- init param overrides run param for metafieldranker
- DSPy Integration
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from haystack.