aravinda89 / ask-anything Goto Github PK

View Code? Open in Web Editor NEW

ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

License: MIT License

Shell 0.04% Python 99.96%

ask-anything's Introduction

Ask-Anything

中文 README

Currently, Ask-Anything is a simple yet interesting tool for chatting with video. Our team is trying to build a smart and robust chatbot that can understand video.

We are also working on a updated version, stay tuned! ⭐️

🎥 Online Demo [click here]

intro.mp4

🔥 Updates

2023/04/25 Watch videos longer than one minute with chatGPT
- VideoChat_LongVideo: Update langchain and whisper to the latest version.
2023/04/21 Chat with MOSS
- video_chat_with_MOSS: Explicit communication with MOSS.
2023/04/20: Chat with StableLM
- video_chat_with_StableLM: Explicit communication with StableLM.
2023/04/19: Code release & Online Demo
- VideoChat: Explicit communication with ChatGPT. Sensitive with time. demo is avaliable!
- MiniGPT-4 for video: Implicit communication with Vicuna. Not sensitive with time. (Simple extension of MiniGPT-4, which will be improved in the future.)

💬 Example

cxk_online.mp4

🔨 Getting Started

Build video chat with:

⏳ Ongoing

Our team constantly studies general video understanding and long-term video reasoning:

Strong video foundation model.
Video-text dataset and video reasoning benchmark.
Video-language system with LLMs.
Artificial Intelligence Generated Content (AIGC) for Video.
...

We are hiring researchers, engineers and interns in General Vision Group, Shanghai AI Lab. If you are interested in working with us, please contact Yi Wang ([email protected]).

Recommend Projects