{"repo":"vakharwalad23/mark-minion","free":true,"listed":false,"github":"https://github.com/vakharwalad23/mark-minion","clone":"git clone https://github.com/vakharwalad23/mark-minion.git","description":"The Ultimate Web Content Extraction & Conversion Tool for AI/LLM Applications. Convert almost any web content into clean Markdown with intelligent AI processing.","language":"TypeScript","stars":12,"topics":["typescript","ai-powered","cloudflare-worker","content-extraction","document-processing","markdown-conversion","puppeteer","tweets-extraction","web-scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Mark Minion The Ultimate Web Content Extraction & Conversion Tool for AI/LLM Applications Convert any web content into clean, structured Markdown format with advanced bot protection and intelligent AI processing --- 🙏 A humble request I am currently on the free plan of Cloudflare Workers, so there is a daily limit on browser rendering, which means it might not work for website URLs all the time. You can deploy your own Markminion easily. Everything else will work all the time. ✨ Features 🌐 Universal Content Support - Web Pages : Convert any webpage to clean Markdown with advanced readability extraction - Documents : Extract text from PDFs, DOCX, DOC, TXT, MD, HTML, and XLSX files - Videos : Extract metadata, descriptions, and transcripts from YouTube, Vimeo, and other platforms - Social Media : Parse Twitter/X tweets with full metadata and engagement metrics - Google Docs : Direct extraction from Google Docs, Sheets, and Presentations 🤖 AI-Powered Processing - Smart Content Filtering : AI-powered removal of ads, navigation, and irrelevant content - Chunked Processing : Intelligent text chunking for large documents - Content Optimization : Tailored output for LLM consumption 🛡️ Advanced Bot Protection (Still Work In Progress) - Stealth Browsing : Advanced bot detection bypass with randomized user agents - Human-like Behavior : Simulated human browsing patterns and delays - Multiple Retry Logic : Robust navigation with intelligent fallbacks 🚀 Performance & Reliability - In","default_branch":null,"files":null,"tree":[],"storefront":"/r/vakharwalad23","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vakharwalad23/mark-minion/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}