{"repo":"spidra-io/spidra-js","free":true,"listed":false,"github":"https://github.com/spidra-io/spidra-js","clone":"git clone https://github.com/spidra-io/spidra-js.git","description":"The official Node.js SDK for Spidra.","language":"TypeScript","stars":12,"topics":["ai-crawler","ai-scraping","llm","markdown","ai","crawler","data-extraction","scraping","web-data","web-data-extraction"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Spidra Node SDK The official Node.js SDK for Spidra that allows you to scrape pages, run browser actions, batch-process URLs, and crawl entire sites. All results come back as structured data ready to feed into your LLM pipelines or store directly. Installation To install the Spidra Node SDK, you can use npm: Get your API key at app.spidra.io under Settings API Keys . Quick start Table of contents - Spidra Node SDK - Installation - Quick start - Table of contents - Scraping - Basic scrape - Structured output with JSON schema - Structured output with Zod - Geo-targeted scraping - Authenticated pages - Browser actions - forEach: process every element on a page - inline mode - navigate mode - click mode - Pagination - Per-element actions - itemPrompt vs top-level prompt - Manual job control - Poll options - Batch scraping - Crawling - Watching jobs (streaming results) - Logs - Usage statistics - Retries and reliability - Error handling - Verifying webhooks - AI agent integration Scraping All scrape jobs run asynchronously. The run() method submits a job and polls until it finishes. If you need more control, use submit() and get() directly. Up to 3 URLs can be passed per request and they are processed in parallel. Basic scrape Structured output with JSON schema When you need a guaranteed shape, pass a schema . The API will enforce the structure and return null for any missing fields rather than hallucinating values. Define every field you want extracted — an untyped object with no","default_branch":null,"files":null,"tree":[],"storefront":"/r/spidra-io","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/spidra-io/spidra-js/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}