{"repo":"Disane87/scrape-dojo","free":true,"listed":false,"github":"https://github.com/Disane87/scrape-dojo","clone":"git clone https://github.com/Disane87/scrape-dojo.git","description":"🥷 Master the art of web scraping with JSON-powered workflows Define scrapes declaratively · Template everything · Run and monitor in style","language":"TypeScript","stars":18,"topics":["angular","astro","dojo","json","modular","nestjs","scrape","webscrape","automation","browser-automation"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Scrape Dojo Declarative web scraping & browser automation with JSON workflows --- [!NOTE] 🤖 AI-Aided Development (AIAD) This project openly uses AI-assisted development (e.g. Claude Code) to accelerate workflows, improve code quality, and gain more development momentum. All AI-generated code is reviewed and approved by humans — this is not a vibe-coding project, but a deliberate effort to build a useful product while exploring the boundaries, benefits, and trade-offs of AI-aided development. --- 🥷 What is Scrape Dojo? Scrape Dojo is a self-hosted web scraping & browser automation platform. Instead of writing Puppeteer code for every site, you define workflows declaratively in JSON/JSONC — like Infrastructure-as-Code, but for scraping. Key capabilities: - ⚡ 25+ built-in actions — navigate, click, type, extract, loop, download, screenshot, and more - 🧩 Handlebars + JSONata — dynamic templates and powerful data transformations - ⏰ Cron scheduling — automate scrapes with cron, webhooks, or startup triggers - 🔐 Encrypted secrets — AES-256-CBC at-rest encryption for credentials - 📡 Real-time monitoring — SSE-powered live execution tracking in Angular UI - 🛡️ Auth (optional) — JWT, OIDC/SSO, MFA/TOTP, API keys - 🗄️ Multi-DB — SQLite (default), MySQL, PostgreSQL [!IMPORTANT] Scrape Dojo automates real browser interactions. Please respect website terms of service and applicable legal frameworks. Full documentation: scrape-dojo.com --- 🐳 Quick Start (Docker) Open http://localho","default_branch":null,"files":null,"tree":[],"storefront":"/r/Disane87","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Disane87/scrape-dojo/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}