{"repo":"qinscode/SeekSpider","free":true,"listed":false,"github":"https://github.com/qinscode/SeekSpider","clone":"git clone https://github.com/qinscode/SeekSpider.git","description":"Seekspider: A Scrapy Project for Job Scraping","language":"Python","stars":43,"topics":["it","jobs","python","scrapy","seek","webapi","postgresql"],"license":null,"category":"databases-storage","readme_excerpt":"SeekSpider A Seek.com.au job scraper system built on the Plombery task scheduling framework, designed for automated collection of Australian IT job listings. Features - Multi-Region Support - Scrape jobs from Perth, Sydney, Melbourne, Brisbane, Adelaide, Canberra and more - Automated Scraping - Scheduled crawling of Seek.com.au IT job listings - AI Analysis - Automatic tech stack extraction and salary normalization using AI - Web UI - Visual task management interface powered by Plombery - Database Storage - PostgreSQL/Supabase data persistence - Multi-Pipeline Scheduling - Support for multiple data collection pipelines running in parallel Supported Regions Region Seek Location -------- --------------- Perth All Perth WA Sydney All Sydney NSW Melbourne All Melbourne VIC Brisbane All Brisbane QLD Gold Coast All Gold Coast QLD Adelaide All Adelaide SA Canberra All Canberra ACT Hobart All Hobart TAS Darwin All Darwin NT Project Structure Quick Start 1. Install Dependencies 2. Configure Environment Variables Copy .env.example to .env and fill in your configuration: 3. Run Access the Web UI at http://localhost:8000 . Seek Spider Pipeline Capabilities - Scrapes IT job listings from Seek.com.au across multiple Australian regions - Covers all IT subcategories (Development, Architecture, DevOps, Testing, etc.) - Automatically extracts job details (salary, location, job description, etc.) - AI post-processing: tech stack extraction, salary normalization - Region-aware job expiry trackin","default_branch":null,"files":null,"tree":[],"storefront":"/r/qinscode","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/qinscode/SeekSpider/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}