{"repo":"dorisoy/Scrapling","free":true,"listed":false,"github":"https://github.com/dorisoy/Scrapling","clone":"git clone https://github.com/dorisoy/Scrapling.git","description":"一个自适应Web Scraping框架，能处理从单个请求到大规模爬取的一切需求。 它的解析器能够从网站变化中学习，并在页面更新时自动重新定位您的元素。它的Fetcher能够开箱即用地绕过Cloudflare Turnstile等反机器人系统。它的Spider框架让您可以扩展到并发、多Session爬取，支持暂停/恢复和自动Proxy轮换——只需几行Python代码。一个库，零妥协。","language":"Python","stars":18,"topics":["scraper","scraping","scraping-python","scraping-tool"],"license":"BSD-3-Clause","category":"scrapers-browser-automation","readme_excerpt":"Effortless Web Scraping for the Modern Web العربيه Español Deutsch 简体中文 日本語 Русский Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl. Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation — all in a few lines of Python. One library, zero compromises. Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular users, there's something for everyone. Or scale up to full crawls Platinum Sponsors Do you want to be the first company to show up here? Click here Sponsors Do you want to show your ad here? Click here and choose the tier that suites you! --- Key Features Spiders — A Full Crawling Framework - 🕷️ Scrapy-like Spider API : Define spiders with start urls , async parse callbacks, and Request / Response objects. - ⚡ Concurrent Crawling : Configurable concurrency limits, per-domain throttling, and download delays. - 🔄 Multi-Session Support : Unified interface for HTTP requests, and stealthy headless browsers in a single spider — route requests to different sessions by ID. - 💾 Pause & Resume : Checkpoint-based crawl ","default_branch":null,"files":null,"tree":[],"storefront":"/r/dorisoy","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/dorisoy/Scrapling/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}