opendatahub-io / caikit-nlp Goto Github PK

Tags haven't been synced since Sep 2023

Description

Upstream updated an important library version so it needs to be synced with upstream.

Discussion

This dependency of caikit-nlp is out of date now, the branch no longer exists. Upstream already updated this part so it needs to be synced

[HG PR](huggingface/peft: huggingface/peft#400)

Acceptance Criteria

• Unit tests cover new/changed code
• Examples build against new/changed code
• READMEs are updated
• Type of semantic version change is identified

ODH-model-controller already monitors InferenceService and ServingRuntime resources to create routes.
The goal of this spike is to:

• extend the controller also to reconcile InferenceService/ServingRuntime resources with a custom annotation experimental.serving.kserve.io/deploymentMode CAIKit
• when this happens, take the image to deploy from the ServingRuntime spec and when the InferenceService is created, create a Deployment with caikit-tgis image https://quay.io/repository/opendatahub/caikit-tgis-serving?tab=tags
• and with an init-container that download and save the model

This is just to replicate what we can already do with Kserve, the next step/ticket is to deploy caikit-nlp and TGIS with two different deployments