{"repo":"OpenGVLab/Ask-Anything","free":true,"listed":false,"github":"https://github.com/OpenGVLab/Ask-Anything","clone":"git clone https://github.com/OpenGVLab/Ask-Anything.git","description":"[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.","language":"Python","stars":3345,"topics":["captioning-videos","chatgpt","gradio","langchain","video-question-answering","video-understanding","stablelm","chat","video","big-model"],"license":"MIT","category":"ai-agents","readme_excerpt":"🦜 VideoChat Family: Ask-Anything [VideoChat-7B-8Bit] End2End ChatBOT for video and image. [InternVideo2-Chat-8B-HD] 中文 README 及 中文交流群 Paper ⭐️: We are also working on a updated version, stay tuned! :fire: Updates - 2026/07/17 : 🚀🚀 We release VideoChat3, a fully open, efficient 4B Video MLLM for general, long-form, and streaming video understanding. VideoChat3 improves 18/19 offline and 10/11 streaming metrics over Qwen3-VL-4B. We release the model weights, code, training recipes, and complete datasets. Check out our paper and homepage! - 2025/01/18 : We release videochat-flash and videochat-tpo to extend MLLMs' capabilities on both long and accurate video understanding. videochat-flash sets new records in mutiple video benchmarks (for both short and long videos), improving code usability by leveaging LLaVA and others. videochat-tpo exploits classical vision task annotations (e.g. tracking) to optimize MLLMs in a DPO manner, enhancing MLLMs' performance and enabling capabilities in tracking, segmentation, and more. - 2024/06/25 : We release the branch of videochat2 using vllm , speed up the inference of videochat2. - 2024/06/19 : 🎉🎉 Our VideoChat2 achieves the best performances among the open-sourced VideoLLMs on MLVU, a multi-task long video understanding benchmark. - 2024/06/13 : Fix some bug and give testing scripts/ - :warning: We replace some repeated ( 30) QAs in MVBench, which may only affect the results by 0.5%. - :loudspeaker: We give the scripts for testing EgoS","default_branch":null,"files":null,"tree":[],"storefront":"/r/OpenGVLab","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/OpenGVLab/Ask-Anything/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}