{"repo":"adithya-s-k/omniparse","free":true,"listed":false,"github":"https://github.com/adithya-s-k/omniparse","clone":"git clone https://github.com/adithya-s-k/omniparse.git","description":"Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks","language":"Python","stars":7811,"topics":["ingestion-api","ocr","omniparser","parse-server","parser-library","vision-transformer","web-crawler","whisper-api"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"OmniParse [!IMPORTANT] OmniParse is a platform that ingests and parses any unstructured data into structured, actionable data optimized for GenAI (LLM) applications. Whether you are working with documents, tables, images, videos, audio files, or web pages, OmniParse prepares your data to be clean, structured, and ready for AI applications such as RAG, fine-tuning, and more Try it out Intro https://github.com/adithya-s-k/omniparse/assets/27956426/457d8b5b-9573-44da-8bcf-616000651a13 Features ✅ Completely local, no external APIs \\ ✅ Fits in a T4 GPU \\ ✅ Supports 20 file types \\ ✅ Convert documents, multimedia, and web pages to high-quality structured markdown \\ ✅ Table extraction, image extraction/captioning, audio/video transcription, web page crawling \\ ✅ Easily deployable using Docker and Skypilot \\ ✅ Colab friendly \\ ✅ Interative UI powered by Gradio Why OmniParse ? It's challenging to process data as it comes in different shapes and sizes. OmniParse aims to be an ingestion/parsing platform where you can ingest any type of data, such as documents, images, audio, video, and web content, and get the most structured and actionable output that is GenAI (LLM) friendly. Installation [!IMPORTANT] The server only works on Linux-based systems. This is due to certain dependencies and system-specific configurations that are not compatible with Windows or macOS. Create a Virtual Environment: Install Dependencies: 🛳️ Docker To use OmniParse with Docker, execute the following commands: ","default_branch":null,"files":null,"tree":[],"storefront":"/r/adithya-s-k","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/adithya-s-k/omniparse/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}