Comments (4)
I have added an example which will make some things more clear: #769
from llamasharp.
The example is now in the master. Thank you @zsogitbe
from llamasharp.
That example uses the OpenAI feature AutoInvokeKernelFunctions, which is not available in LLamaSharp. AutoInvokeKernelFunctions triggers a mechanism to call kernel plugins/functions "automatically". Where automatically means that the chat model indicates to call a function. For this you need a specialized model.
You can make all of this work without the OpenAI part "manually" as follows, you define the kernel functions and you ask the chat model to indicate the user's intention and then call the Kernel function. This is what is actually happening internally in the OpenAI implementation, so you can do the same.
But, this is all a bit outdated because there is a new way called Handlebars plan calling. You can ask a model to create a plan and then execute the plan which may contain a whole process with several plugins and functions.
All of this is state of the art today and relatively complex and you will need some time to understand it...
from llamasharp.
@zsogitbe I just would like to thank you for taking the time for the detailed explanation as well as the provided sample.
I hope others will find this as useful as I have.
from llamasharp.
Related Issues (20)
- [Feature]: AuthorRole can custom role labels be supported ?
- SEHException on Tokenize model. HOT 5
- Cannot figure out how to switch backend to OpenCL HOT 3
- [Feature]: Support JSON Schema from llama.cpp HOT 3
- [BUG]: Bad Typo in LLama/Extensions/IContextParamsExtensions.cs ? HOT 2
- [Feature]: Support for Gemma2 HOT 5
- [BUG]: NETSDK1152 Found multiple publish output files with the same relative path HOT 4
- [BUG]: The native library cannot be correctly loaded on Mac M1 HOT 1
- New Development Binaries System HOT 14
- Async implementation of LLamaExecutors HOT 2
- How to handle `CUDA error: out of memory`? HOT 1
- Method not found: 'Double Microsoft.KernelMemory.AI.TextGenerationOptions.get_TopP()'. HOT 8
- [BUG]: When the number of GpuLayerCount is more than 5, no data is returned or the speed is very slow HOT 2
- [BUG]: LLamaSharp.Backend not added as reference HOT 3
- [BUG]: Tokenization in 0.14.0 adds spaces HOT 4
- [BUG]: ChatSession unnecessarily prevents arbitrary conversation interleaving
- Strange Behaviors in Executors
- [BUG]: Method 'GetTokens' in type 'LLamaSharp.KernelMemory.LLamaSharpTextEmbeddingGenerator' from assembly 'LLamaSharp.KernelMemory, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null' does not have an implementation. HOT 8
- [BUG]: App crashes with CUDA error in ggml-cuda.cu:1503
- [BUG]: llama_encode has no implementation HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llamasharp.