{"repo":"fozbek/scrawler","free":true,"listed":false,"github":"https://github.com/fozbek/scrawler","clone":"git clone https://github.com/fozbek/scrawler.git","description":"Simple, schema based scraping tool","language":"PHP","stars":12,"topics":["scrawler","scraper","scraper-engine","scraper-api"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Scrawler A modern, schema-based web scraping library for PHP with powerful transformers and a clean, intuitive syntax. Perfect for both manual use and API integration. Features - Intuitive Schema Syntax : Easy to write by hand and by AI - Built-in Transformers : 20+ transformers for data manipulation (trim, float, int, upper, lower, etc.) - Flexible Lists : Support for limit and offset - JSON-Friendly : Perfect for API usage - Type-Safe : Full PHPStan max level compliance - Clean Architecture : SOLID principles, no anti-patterns - Well-Tested : 47 tests, 107 assertions Installation Quick Start PHP 8.4 Compatibility If you're running PHP 8.4+, you may see deprecation warnings from vendor libraries (DiDom, Guzzle) related to implicitly nullable parameters. These are harmless but can clutter output. Use Bootstrap::init() to suppress these vendor-specific warnings: This only suppresses deprecation warnings from vendor code, keeping your own code's warnings intact. Schema Syntax Simple Text Extraction Attribute Extraction Extracting attributes from the current element (useful in lists): Transformers Apply transformations using pipe-separated transformer names: Available Transformers: Type Conversions: - int , float , bool , string String Operations: - trim , ltrim , rtrim - upper , lower , ucfirst , ucwords - strip tags URL/Path: - basename , dirname - urlencode , urldecode Parsing: - json - decode JSON strings - timestamp - convert dates to Unix timestamp Utility: - abs - absolut","default_branch":null,"files":null,"tree":[],"storefront":"/r/fozbek","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/fozbek/scrawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}