{"repo":"Ilias1988/Universal-News-Scraper","free":true,"listed":false,"github":"https://github.com/Ilias1988/Universal-News-Scraper","clone":"git clone https://github.com/Ilias1988/Universal-News-Scraper.git","description":"A robust CLI news scraper and aggregator. Features topic auto-discovery (via Bing RSS), anti-blocking logic, keyword/date filtering, and JSON/CSV export. Built with Python & Rich.","language":"Python","stars":15,"topics":["automation","beautifulsoup","cli-tool","news-aggregator","open-source","osint","python","rich-library","rss-reader","web-scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"🌍 Universal News Scraper v4.1 A powerful, terminal-based news aggregator that supports RSS feeds , Web Scraping , and Topic Auto-Discovery via Bing News RSS. --- ✨ Key Features Feature Description --------- ------------- 🕵️ Auto-Discovery Find news on ANY topic (Crypto, Sports, Politics, AI) without knowing the URL 📂 Preset Categories 6 built-in categories with 30+ international news sources 🛡️ Anti-Blocking Random User-Agent rotation to bypass restrictions 💾 Multi-Format Export Save results as CSV, JSON, HTML, or ALL formats 🎨 HTML Reports Beautiful dark-themed HTML reports with article cards 🔇 Noise Filter Automatically filters out generic Bing category entries 🔗 Real URL Extraction Extracts actual article URLs from Bing redirects 📅 Date Filtering Only get articles from a specific date onwards 🔑 Keyword Filtering Filter articles by multiple keywords 🔄 Settings Memory Remembers your last configuration for quick re-runs --- 🆕 What's New in v4.1 - 🌐 HTML Export - Beautiful dark-themed HTML reports - 🔇 Enhanced Noise Filter - Filters generic Bing entries (Top stories, Entertainment, etc.) - 🔗 Real URL Extraction - Extracts actual article URLs from Bing redirects - 📰 Real Source Detection - Shows the actual news source instead of \"Bing\" - 📤 4 Export Options - CSV, JSON, HTML, or All formats --- 📂 Preset Categories Category Sources ---------- --------- 📰 International News BBC, CNN, Reuters, Al Jazeera, The Guardian, NPR ⚽ Sports ESPN, BBC Sport, Sky Sports, Bl","default_branch":null,"files":null,"tree":[],"storefront":"/r/Ilias1988","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Ilias1988/Universal-News-Scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}