{"repo":"simonplmak-cloud/hkex-filing-scraper","free":true,"listed":false,"github":"https://github.com/simonplmak-cloud/hkex-filing-scraper","clone":"git clone https://github.com/simonplmak-cloud/hkex-filing-scraper.git","description":"Scrape and ingest HKEx (Hong Kong Stock Exchange) regulatory filings into SurrealDB with full-text extraction and graph linking.","language":"Python","stars":12,"topics":["financial-data","graph-database","hkex","hong-kong","python","scraper","surrealdb","regulatory-filings","data-pipeline","etl"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"HKEx Filing Scraper Open-source tool to scrape and ingest HKEx (Hong Kong Stock Exchange) regulatory filings into a SurrealDB database. It includes full-text extraction from PDF/HTML/Excel documents and optional graph linking between companies and filings. This tool uses the undocumented HKEx JSON API, which is significantly faster and more reliable than browser-based scraping. Features - Fast API Scraping : Directly uses the HKEx JSON API, no browser required. - Full Historical Data : Can scrape the entire history of filings from April 1999 to the present day. - Document Processing : Downloads filing documents (PDF, HTML, Excel) and extracts full text and structured tables. - Graph Linking : Optionally creates graph edges in SurrealDB between your existing company table and the filings they release ( has filing ), as well as edges for companies mentioned in filing titles ( references filing ). - Resilient & Parallel : Uses batching, parallel downloads, and recursive retries to handle large volumes of data and network interruptions. - Configurable & Modular : Easily configured via environment variables and structured as a modern Python package. Installation Clone the repository and install with pip : The [all] extras include PDF extraction (PyMuPDF, Camelot), Excel parsing (openpyxl), and environment variable loading (python-dotenv). For a minimal install without document processing: Configuration The scraper is configured using environment variables. Create a .env file in yo","default_branch":null,"files":null,"tree":[],"storefront":"/r/simonplmak-cloud","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/simonplmak-cloud/hkex-filing-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}