{"repo":"ScrapeGraphAI/just-scrape","free":true,"listed":false,"github":"https://github.com/ScrapeGraphAI/just-scrape","clone":"git clone https://github.com/ScrapeGraphAI/just-scrape.git","description":"CLI for AI-powered web scraping, structured data extraction, web search, multi-page crawling, and scheduled page-change monitoring powered by the ScrapeGraph AI API. Turn any URL into markdown, HTML, screenshots, links, images, summaries, or brand assets; pull structured JSON with a prompt + schema; watch pages on a cron with webhook alert","language":"TypeScript","stars":48,"topics":["ai","ai-agents","browser-automation","cli","command-line-tool","data-extraction","developer-tools","json-schema","llm","markdown"],"license":"MIT","category":"cli-tools","readme_excerpt":"just-scrape Command-line interface for ScrapeGraphAI. This repo contains the CLI source, command modules, build setup, smoke tests, demo assets, and the installable coding-agent skill. Scope just-scrape wraps ScrapeGraphAI workflows behind a small terminal interface: - scrape gets a known URL as markdown, html, screenshot, links, images, summary, branding, or structured JSON - extract gets structured JSON from a known URL with a prompt and optional schema - search searches the web and can run extraction over results - crawl collects multiple pages from a bounded site section - monitor schedules recurring page checks and optional webhook notifications - history , credits , and validate cover operational API workflows The detailed agent-facing workflow lives in skills/just-scrape/SKILL.md. Stack - Runtime: Node.js =22 - Package manager used in this repo: Bun - Language: TypeScript, ESM - CLI framework: citty - Prompts/output: @clack/prompts , chalk - Environment loading: dotenv - ScrapeGraph client: scrapegraph-js - Build: tsup - Checks: TypeScript, Biome, Bun test Repository Layout Install Package: just-scrape on npm. Configuration Get an API key at scrapegraphai.com/dashboard. API key resolution order: 1. SGAI API KEY 2. .env 3. /.scrapegraphai/config.json 4. interactive prompt Environment variables: Variable Description Default --- --- --- SGAI API KEY ScrapeGraph API key none SGAI API URL Override API base URL https://v2-api.scrapegraphai.com SGAI TIMEOUT Request timeout in","default_branch":null,"files":null,"tree":[],"storefront":"/r/ScrapeGraphAI","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ScrapeGraphAI/just-scrape/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}