rahulsushilsharma / huggingface-chat

hugging face chat api for JS 🤗

Hello, World! 👋

I'm a coding enthusiast on a mission to create tech magic! 🚀

• 🔭 Currently crafting amazing projects with LLM tech and vector databases.
• 🌱 Forever learning and exploring the coding universe.
• 👯 Open to collaborations that bring ideas to life.
• 🤔 Looking to help fellow coders in need.
• 💬 Ask me anything tech-related!

⚡ Fun fact: Coding + Coffee = My superpowers! ☕💻

Thanks for stopping by, let's code some magic and build cool stuff together! ✨✨

📫 Reach me:

huggingface-chat's Issues

chat context is not preserved

The chat context of the request for a chat id is not being preserved

Remove axios dependency

add conversion presistance

Adding tools

tools are now avaliable in web ui

adding automated testing

Adding agents

Agents are now avilable in web ui

fix doc pipeline

Package stopped working?

Describe the bug
Package stopped working on June 5. everything was working fine until then. Getting remote conversations works as does everything besides the actual chat is not posting to a conversation. The following code in chat.ts is returning an empty JSON object in response:

    const response = await fetch(
      "https://huggingface.co/chat/conversation/" +
        this.currentConversionID +
        "",
      {
        headers: {
          ...this.headers,
          "content-type": "application/json",
          cookie: this.cookie,
          Referer:
            "https://huggingface.co/chat/conversation/" +
            this.currentConversionID +
            "",
        },
        body: JSON.stringify(data),
        method: "POST",
      }
    );

Desktop (please complete the following information):

• Chrome

option to get raw stream from huggigng face

Add a new option to get raw stream response from huggigng face

update current active models

fix code autocomplete for interfaces

the auto complete is not working in the cause of returned object of a function

Passing cookie path in ChatBot class is not working

response of api is changed update parser accordingly

adding support for older versions of node <18.x

How to use?

I am using in node.js with this code

import("huggingface-chat").then(module => {
const { Login, ChatBot } = module;
const EMAIL = "email";
const PASSWD = "password";
const cachePath = "./login_cache/";

async function main() {
    try {
        const signin = new Login(EMAIL, PASSWD);
        const res = await signin.login(cachePath); // default path is ./login_cache/
        const chat = new ChatBot(res); // res is cookies which is required for subsequent aip calls
        const data = await chat.chat("who am i"); // Default model is "meta-llama/Llama-2-70b-chat-hf"
        
        // Create a reader for the stream
        let reader = data.stream.getReader();

        // Continuously read from the stream until it's done
        while (true) {
            const { done, value } = await reader.read();
            if (done) break; // The streaming has ended.
            console.log(value); // Log each chunk of data from the stream
        }
    } catch (error) {
        console.error("An error occurred:", error);
    }
}

main();

});

It is just generating new chats and nothing else.

login cookies are not valid

update the models

Add option for deleting conversations

There is currently no way to delete conversations previously on my account. It would be great to have the option to delete all conversations, and/or to delete one at a time

Parsing issues

Sometimes errors occur when simply streaming

Example:

Error parsing JSON: {"type":"stream","token":"\n"}
{"type":"stream","token":"*"}
{"type":"stream","token":" "}

set default model max_new_tokens to 1024

some models are not working with the current default max_new_tokens : 2048

Do Perplexity

Is your feature request related to a problem? Please describe.
Make one for perplexity

Describe the solution you'd like
They are fast

Describe alternatives you've considered
chat.lmsys.org

Additional context
collab?

Adding auto cache usage if avilable on login

Add conversion saving in local.

update current active models

document the methods/features