{"repo":"emcf/thepipe","free":true,"listed":false,"github":"https://github.com/emcf/thepipe","clone":"git clone https://github.com/emcf/thepipe.git","description":"Get clean data from tricky documents, powered by vision-language models ⚡","language":"Python","stars":1525,"topics":["multimodal","pdf","vision-transformer","large-language-models","web","scrapers","document","openai","python","scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"thepi.pe Extract clean data from tricky documents ⚡ thepi.pe is a package that can scrape clean markdown, multimodal media, and structured data from complex documents. It uses vision-language models (VLMs) under the hood for superior output quality, and works out-of-the-box with any LLM, VLM, or vector database. It can extract well-formatted data from a wide range of sources, including PDFs, URLs, Word docs, Powerpoints, Python notebooks, videos, audio, and more. Features 🌟 - Scrape clean markdown, tables, and images from any document - Scrape text, images, video, and audio from any file or URL - Works out-of-the-box with vision-language models, vector databases, and RAG frameworks - AI-native file-type detection, layout analysis, and structured data extraction - Accepts a wide range of sources, including PDFs, URLs, Word docs, Powerpoints, Python notebooks, GitHub repos, videos, audio, and more Get started in 5 minutes 🚀 Thepipe can be installed via the command line: The default install only pulls in CPU-friendly dependencies so it is suitable for constrained environments and CI systems. GPU-enabled libraries such as PyTorch and Triton are left as optional extras. Optional extras The package exposes a set of extras so you can opt-in to heavier dependencies on demand: Extra Installs When to use it -------------------------- ----------------------------------------- ----------------------------------------------------- thepipe-api[audio] openai-whisper Local audio/video tran","default_branch":null,"files":null,"tree":[],"storefront":"/r/emcf","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/emcf/thepipe/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}