Comments (1)
Yes, but the documentation (and issues) needs updating.
The interface that supports this is StreamingChatClient
@FunctionalInterface
public interface StreamingChatClient {
Flux<ChatResponse> generateStream(Prompt prompt);
}
There are implementations for
- OpenAI
- Azure OpenAI
- AWS Bedrock Antropic
- AWS Bedrock Cohere
- AWS Bedrock Llama2
- AWS Bedrock Titan
- Ollama
I've created an issue to add docs for these.
We need to look into the other model providers we support to see which support streaming and then create issues for each of them. Created this issue to track that.
from spring-ai.
Related Issues (20)
- PDFReader Test `doesNotContains` -> `contain` and Replace `Collectors.joining()` to `String.join()`
- Add comment in OpenAiImageModel and modify RetryTemplate access level in OpenAiChatModel
- Index 0 out of bounds for length 0 exception in BedrockAnthropic3ChatModel HOT 1
- Refactor FunctionCallbackContext to FucntionCallBackResolver interface
- Streaming chat client does not seem to work out of the box for Azure OpenAI, but, does for Bedrock Anthropic3 HOT 10
- Redis Vector Search is returning only 10 results
- [BUG]The request body format for the ZhiPuAiEmbeddingModel.call method is incorrect HOT 1
- OpenAI - improve error messages when there is a connection error HOT 1
- 什么时候可以集成vllM? HOT 2
- Native image compilation issue with spring-ai-tika-document-reader dependency
- Milvus Vector store does not allow more than 2048 embedding dimensions
- PGVECTOR INDEX is created at each application startup
- Add support for custom WebClient.Builder in org.springframework.ai.openai.api.OpenAiApi
- Bedrock Titan Embeddings - Malformed input request / 2 validation errors HOT 1
- Generate complex Json schemas with BeanOutputConverter
- MilvusVectorStore need support milvus sdk 'withPartitionName' method when insert or delete
- VectorStoreChatMemoryAdvisor is not working correctly with PGvector
- Why is there no entry for webclient to set up http proxy? I don’t want to set up a proxy for the entire service. 😭
- AWS Bedrock models tools support HOT 1
- Feature Request: Support for Invoking HTTP-based APIs via OpenAPI Spec
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spring-ai.