{"repo":"PhialsBasement/LibreCrawl","free":true,"listed":false,"github":"https://github.com/PhialsBasement/LibreCrawl","clone":"git clone https://github.com/PhialsBasement/LibreCrawl.git","description":"Free desktop SEO crawler - open source alternative to Screaming Frog and similar tools. Crawl websites, analyze links, extract SEO data, and export results without subscription fees. Fully customizable and extensible!","language":"Python","stars":856,"topics":["desktop-app","flask","free","open-source","python","seo","seo-analysis","web-crawler","website-auditing"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"LibreCrawl A web-based multi-tenant crawler for SEO analysis and website auditing. 🌐 Website : librecrawl.com Demo no longer available cause people thought it was a prod environ, it isnt, it was a demo to get a taste before installing API Documentation: https://librecrawl.com/api/docs/ Browse plugins other people have built, or share your own, at the Plugin Workshop . LibreCrawl will always be free and open source. If it's replacing your $259/year Screaming Frog license, deepcrawl license or sitebulb license, buy me a coffee. What it does LibreCrawl crawls websites and gives you detailed information about pages, links, SEO elements, and performance. It's built as a web application using Python Flask with a modern web interface supporting multiple concurrent users. Features - 🚀 Multi-tenancy - Multiple users can crawl simultaneously with isolated sessions - 🎨 Custom CSS styling - Personalize the UI with your own CSS themes - 💾 Browser localStorage persistence - Settings saved per browser - 🔄 JavaScript rendering for dynamic content (React, Vue, Angular, etc.) - 📊 SEO analysis - Extract titles, meta descriptions, headings, etc. - 🔗 Link analysis - Track internal and external links with detailed relationship mapping - 📈 PageSpeed Insights integration - Analyze Core Web Vitals - 💾 Multiple export formats - CSV, JSON, or XML - 🔍 Issue detection - Automated SEO issue identification - ⚡ Real-time crawling progress with live statistics Getting started Quick Start (Automatic","default_branch":null,"files":null,"tree":[],"storefront":"/r/PhialsBasement","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/PhialsBasement/LibreCrawl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}