{"repo":"lowweihong/crypto_exchange_news_crawler","free":true,"listed":false,"github":"https://github.com/lowweihong/crypto_exchange_news_crawler","clone":"git clone https://github.com/lowweihong/crypto_exchange_news_crawler.git","description":"A crypto announcement crawlers which support multiple crypto exchanges","language":"Python","stars":25,"topics":["crypto-news","annoucement","binance","bingx","blockchain","bot","bybit","cryptocurrency","exchange","fintech"],"license":null,"category":"blockchain-web3","readme_excerpt":"Crypto Exchange News Crawler 🚀 A powerful and easy-to-use Python package for scraping cryptocurrency exchange announcements from major exchanges. 🎯 Features - Multi-Exchange Support : Scrape from 12 major crypto exchanges - Multiple Output Formats : JSON, CSV, and XML support - Structured Data : Clean, standardized output format - Rate Limiting : Built-in delays to respect exchange servers - Extensible : Easy to add new exchanges 📦 Installation Options Option 1: Direct Usage Option 2: Install from PyPI Supported Exchanges Exchange Status ----------- -------- Bybit ✅ Binance ✅ OKX ✅ Bitget ✅ BingX ✅ Kraken ✅ Bitfinex ✅ XT ✅ Crypto.com ✅ MEXC ✅ Deepcoin ✅ Kucoin ✅ Upbit ✅ 📊 Output Format Each scraped announcement includes: ⚙️ Configuration Key settings in settings.py : - MAX PAGE : Maximum number of pages to crawl (default: 2) - DOWNLOAD DELAY : Delay between requests in seconds (default: 3) - CONCURRENT REQUESTS : Number of concurrent requests (default: 8) - USER AGENT : List of user agents for rotation - PROXY LIST : Fill the list with your proxy list and remember also to open uncomment the DOWNLOADER MIDDLEWARES part to use the proxy middleware - PLAYWRIGHT LAUNCH OPTIONS : Browser configuration for Playwright spiders Custom Settings You can override settings from the command line: 🔧 Technical Requirements - Python 3.7+ - Scrapy 2.11.0+ - Playwright (for Bitget spider) - Chromium browser (automatically installed with Playwright) 🌐 Exchange URLs Direct links to announce","default_branch":null,"files":null,"tree":[],"storefront":"/r/lowweihong","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lowweihong/crypto_exchange_news_crawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}