{"repo":"MontFerret/worker","free":true,"listed":false,"github":"https://github.com/MontFerret/worker","clone":"git clone https://github.com/MontFerret/worker.git","description":"Containerized Ferret worker","language":"Go","stars":15,"topics":["worker","chrome","ferret","go","crawler","scraping","dsl","scraping-websites","service","docker"],"license":"Apache-2.0","category":"scrapers-browser-automation","readme_excerpt":"Worker Worker is a simple HTTP server that accepts FQL (Ferret Query Language) queries, executes them and returns their results. What is Ferret? Ferret is a declarative web scraping query language that allows you to extract data from web pages using a SQL-like syntax. Worker provides a REST API interface to execute FQL queries remotely, making it easy to integrate web scraping capabilities into your applications. Common use cases: - Web scraping and data extraction from websites - Automated testing of web applications - Monitoring web pages for changes - Generating PDFs or screenshots from web pages - Collecting data for analytics and research OpenAPI v2 schema can be found here. Quick start Prerequisites - Docker (recommended) or Go 1.23+ for local installation - For local installation without Docker: Google Chrome or Chromium browser Running with Docker The Worker is shipped with dedicated Docker image that contains headless Google Chrome, so feel free to run queries using cdp driver: DockerHub: GitHub Container Registry: Local Installation Alternatively, if you want to use your own version of Chrome, you can run the Worker locally. Install from script: Build from source: Your First Query Once the Worker is running, you can send FQL queries via POST requests to http://localhost:8080/ : Simple data extraction: Web scraping with browser automation: Query with parameters: Visual Example System Resource Requirements - 2 CPU - 2 Gb of RAM Usage API Reference Endpoints POST / Exe","default_branch":null,"files":null,"tree":[],"storefront":"/r/MontFerret","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MontFerret/worker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}