Comments (5)
This issue should be related to LLamaSharp, maybe you can raise issue to that repo.
I haven't encountered this situation.
from botsharp.
OK, thanks. I was worried it was some kind of default. The bot shouldn't be responding in Chinese. You're suggesting this is an error in the LlamaSharp library?
This is the console output from the call
...................................................................................................
llama_new_context_with_model: n_ctx = 1024
llama_new_context_with_model: freq_base = 1000000.0
llama_new_context_with_model: freq_scale = 1
llama_new_context_with_model: KV self size = 512.00 MiB, K (f16): 256.00 MiB, V (f16): 256.00 MiB
llama_build_graph: non-view tensors processed: 676/676
llama_new_context_with_model: compute buffer total size = 93.32 MiB
llama_new_context_with_model: n_ctx = 1024
llama_new_context_with_model: freq_base = 1000000.0
llama_new_context_with_model: freq_scale = 1
llama_new_context_with_model: KV self size = 512.00 MiB, K (f16): 256.00 MiB, V (f16): 256.00 MiB
llama_build_graph: non-view tensors processed: 676/676
llama_new_context_with_model: compute buffer total size = 93.32 MiB
??,???????????"??,?????",????????
user:Loaded LlmProvider azure-openai settings with 2 models.
Loaded LlmProvider llama-sharp settings with 1 models.
Sending [test-agent] assistant: ??,???????????"??,?????",????????
Token Usage: 0 prompt + 0 completion = 0 total tokens (146.46s). One-Way cost: £0.0000, accumulated cost: £0.0000. [codellama-7b.Q5_K_M.gguf]
??,???????????"??,?????",???????? is what comes back in the response as
你好,我是小芭。您可以对我说“小芭,帮我做什么”,我会尽力帮助您。
Because of the following line
Token Usage: 0 prompt + 0 completion = 0 total tokens (146.46s). One-Way cost: £0.0000, accumulated cost: £0.0000.
I was making the assumption that the response was not being generated by the model but a returnable from something else. The channel invoked by the agent is "openapi" (testing via the api so this is correct), and for some reason the llm provider for azure-openai is also being loaded. Am I correct in assuming this should be restricted to Llama only?
The model has also been tested using the LlamaSharp examples and responds, as intended, in English. It seems to me that the solution has some kind of overriding agent or functionality active. The bot refers to itself as Xiaoba, and when asking "what can you do for me" in response to the initial reply, it retunrs a list of actions such as "weather" and "news".
from botsharp.
If you're able to, can you run it in debug mode and go deeper to figure out what is happing?
from botsharp.
Stepping through each line, there is nothing I can see to indicate any error, and nothing immediate which seems to be configured that would specify Chinese for output language.
Do you have an example agent, configured to use Llama I could use to test and compare?
Using the default AI Assistant agent in the solution also returns Chinese only. This time, however, it calls itself Little Mango
你好,我是小芒果。您可以问我一些关于医疗保健的问题。
Hello, I am Little Mango. You can ask me questions about health care.
from botsharp.
@kiebor Any clue you've found?
from botsharp.
Related Issues (20)
- LlamaSharp Backend Cuda not being used HOT 1
- Add a regex expression validation for required fields.
- Update Conversation title dynamically
- Update the conversation status as closed HOT 2
- Add filters to GetConversations function
- Unify the function calling for all LLM in JSON Schema HOT 1
- Using the Web Speech API
- LLM Load balance
- Web Driver is failing to do basic things HOT 2
- PizzaBot runs to failed HOT 2
- Does BotSharp include a client-side integration framework? HOT 1
- Redirect Agent
- Azure.RequestFailedException HOT 1
- compilation errors HOT 6
- pizza bot with llama-2-7b-chat rout error
- Allow user to change Avatar
- Hugging Face Integration
- Support PDF file to upload
- Prompt log enhancement
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from botsharp.