Comments (4)
Copying the progress on this from STORY of this issue:
Upstream PRs:
from caikit-tgis-serving.
Add the SR and Inference Service to caikit-tgis-serving repo
Does that even belong there? caikit standalone does not use tgis at all
Build the image and share the image here
I guess the only step required for that is adding CI to build the image, the upstream version should be ok. Regarding CI, do we want to use openshift or gha?
from caikit-tgis-serving.
Build definition PR submitted here openshift/release#46224
from caikit-tgis-serving.
Even if not planned, example manifests have been merged here: #186
from caikit-tgis-serving.
Related Issues (20)
- Add more ServingRuntime examples HOT 3
- [Bug] TGIS container fails to run on a FIPS cluster HOT 4
- Serving the Prompt-tuned models with Caikit-TGIS
- TGIS standalone SR and ISVC HOT 2
- GRPC endpoint not responding properly after the InferenceService reports as `Loaded` HOT 5
- Caikit + TGIS returns empty answer when using HTTP calls HOT 5
- Service mesh resources are not completely removed
- Serveless resources are not completely removed
- add readiness probe on TGIS container (caikit+tgis) HOT 10
- Cakit+TGIS combined image/SR HOT 1
- model_id is mandatory for model queries but it can have any values HOT 6
- Review OpenShift CI flows
- Update the caikit dependencies HOT 1
- Synchronization issue when the model is just launched HOT 3
- Investigate the use of dev containers as mechanism for supporting development on Apple silicon
- Consider Sail Operator for Istio with Service Mesh being merged back upstream Istio
- probes: investigate if it's possible to check if the model is loaded
- DeprecationWarning: FutureWarning: Using `TRANSFORMERS_CACHE` is deprecated and will be removed in v5 of Transformers. Use `HF_HOME` instead.
- [RFE] Add openai text generation API compatibility layer in kserve/TGIS HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from caikit-tgis-serving.