{"repo":"RiveChen/deribit-historical-data","free":true,"listed":false,"github":"https://github.com/RiveChen/deribit-historical-data","clone":"git clone https://github.com/RiveChen/deribit-historical-data.git","description":"Download all options/futures trading (transaction) history via Deribit history API.","language":"Python","stars":36,"topics":["data-fetching","deribit-api","deribit","market-data"],"license":"MIT","category":"trading","readme_excerpt":"Deribit Historical Data Fetcher A resumable async downloader for historical Futures and Options trades from the Deribit History API v2. Verification status: correctness regressions, complete expired BTC future/option instruments, one complete expired ETH future, and a two-point active BTC tail pass. Full currency/kind datasets and 90 GB peak RSS are not yet certified. Use checkpoint-aware validation before treating an export as complete. If it helps, stars are appreciated! ⭐ tl;dr Features - Checkpointed range download — uses trade seq -based chunking and final checkpoints so completeness can be checked explicitly - Bounded async fetch engine — uses asyncio , bounded queues, and a configurable rate cap (20 RPS by default) - Resumable — SQLite checkpoint database tracks progress, so partial downloads can be resumed - Signal-aware shutdown — handles SIGINT / SIGTERM and flushes safely persisted batches before returning - JSONL output — raw data saved as newline-delimited JSON, one trade per line - Parquet export — utility script to merge all JSONL files into a single compressed Parquet file (with dedup) - Data validation — streaming Parquet validation (per-instrument trade seq gap detection with a gap-distribution histogram, plus schema & time-range summary) without loading the full file into memory - Both currency & instrument kinds — supports BTC and ETH, Futures and Options Requirements - Python 3.10+ - uv (recommended) or pip Installation Configuration Two settings are read","default_branch":null,"files":null,"tree":[],"storefront":"/r/RiveChen","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/RiveChen/deribit-historical-data/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}