GithubHelp home page GithubHelp logo

Newly Created Agent Speaks Chinese about botsharp HOT 5 OPEN

 avatar commented on June 8, 2024
Newly Created Agent Speaks Chinese

from botsharp.

Comments (5)

Oceania2018 avatar Oceania2018 commented on June 8, 2024

This issue should be related to LLamaSharp, maybe you can raise issue to that repo.
I haven't encountered this situation.

from botsharp.

 avatar commented on June 8, 2024

OK, thanks. I was worried it was some kind of default. The bot shouldn't be responding in Chinese. You're suggesting this is an error in the LlamaSharp library?

This is the console output from the call

...................................................................................................
llama_new_context_with_model: n_ctx      = 1024
llama_new_context_with_model: freq_base  = 1000000.0
llama_new_context_with_model: freq_scale = 1
llama_new_context_with_model: KV self size  =  512.00 MiB, K (f16):  256.00 MiB, V (f16):  256.00 MiB
llama_build_graph: non-view tensors processed: 676/676
llama_new_context_with_model: compute buffer total size = 93.32 MiB
llama_new_context_with_model: n_ctx      = 1024
llama_new_context_with_model: freq_base  = 1000000.0
llama_new_context_with_model: freq_scale = 1
llama_new_context_with_model: KV self size  =  512.00 MiB, K (f16):  256.00 MiB, V (f16):  256.00 MiB
llama_build_graph: non-view tensors processed: 676/676
llama_new_context_with_model: compute buffer total size = 93.32 MiB
??,???????????"??,?????",????????
user:Loaded LlmProvider azure-openai settings with 2 models.
Loaded LlmProvider llama-sharp settings with 1 models.
Sending [test-agent] assistant: ??,???????????"??,?????",????????
Token Usage: 0 prompt + 0 completion = 0 total tokens (146.46s). One-Way cost: £0.0000, accumulated cost: £0.0000. [codellama-7b.Q5_K_M.gguf]

??,???????????"??,?????",???????? is what comes back in the response as

你好,我是小芭。您可以对我说“小芭,帮我做什么”,我会尽力帮助您。

Because of the following line

Token Usage: 0 prompt + 0 completion = 0 total tokens (146.46s). One-Way cost: £0.0000, accumulated cost: £0.0000. 

I was making the assumption that the response was not being generated by the model but a returnable from something else. The channel invoked by the agent is "openapi" (testing via the api so this is correct), and for some reason the llm provider for azure-openai is also being loaded. Am I correct in assuming this should be restricted to Llama only?

The model has also been tested using the LlamaSharp examples and responds, as intended, in English. It seems to me that the solution has some kind of overriding agent or functionality active. The bot refers to itself as Xiaoba, and when asking "what can you do for me" in response to the initial reply, it retunrs a list of actions such as "weather" and "news".

from botsharp.

Oceania2018 avatar Oceania2018 commented on June 8, 2024

If you're able to, can you run it in debug mode and go deeper to figure out what is happing?

from botsharp.

 avatar commented on June 8, 2024

Stepping through each line, there is nothing I can see to indicate any error, and nothing immediate which seems to be configured that would specify Chinese for output language.

Do you have an example agent, configured to use Llama I could use to test and compare?

Using the default AI Assistant agent in the solution also returns Chinese only. This time, however, it calls itself Little Mango

你好,我是小芒果。您可以问我一些关于医疗保健的问题。

Hello, I am Little Mango. You can ask me questions about health care.

from botsharp.

Oceania2018 avatar Oceania2018 commented on June 8, 2024

@kiebor Any clue you've found?

from botsharp.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.