{"repo":"om-ai-lab/OmAgent","free":true,"listed":false,"github":"https://github.com/om-ai-lab/OmAgent","clone":"git clone https://github.com/om-ai-lab/OmAgent.git","description":"[EMNLP-2024] Build multimodal language agents for fast prototype and production","language":"Python","stars":2664,"topics":["large-language-models","multimodal-agent","vision-and-language","agent","workflow","smart-hardware","chatbot","gpt4","language-agent","llm"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"🌟 Build Multimodal Language Agents with Ease 🌟 📖 Introduction OmAgent is python library for building multimodal language agents with ease. We try to keep the library simple without too much overhead like other agent framework. - We wrap the complex engineering (worker orchestration, task queue, node optimization, etc.) behind the scene and only leave you with a super-easy-to-use interface to define your agent. - We further enable useful abstractions for reusable agent components, so you can build complex agents aggregating from those basic components. - We also provides features required for multimodal agents, such as native support for VLM models, video processing, and mobile device connection to make it easy for developers and researchers building agents that can reason over not only text, but image, video and audio inputs. 🔑 Key Features - A flexible agent architecture that provides graph-based workflow orchestration engine and various memory type enabling contextual reasoning. - Native multimodal interaction support include VLM models, real-time API, computer vision models, mobile connection and etc. - A suite of state-of-the-art unimodal and multimodal agent algorithms that goes beyond simple LLM reasoning, e.g. ReAct, CoT, SC-Cot etc. - Supports local deployment of models. You can deploy your own models locally by using OllamaOllama or LocalAI. - Fully distributed architecture, supports custom scaling. Also supports Lite mode, eliminating the need for middleware dep","default_branch":null,"files":null,"tree":[],"storefront":"/r/om-ai-lab","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/om-ai-lab/OmAgent/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}