{"repo":"ranaroussi/pystore","free":true,"listed":false,"github":"https://github.com/ranaroussi/pystore","clone":"git clone https://github.com/ranaroussi/pystore.git","description":"Fast data store for Pandas time-series data","language":"Python","stars":612,"topics":["datastore","dask","parquet","pandas","timeseries","database","dataframe"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"PyStore - Fast data store for Pandas timeseries data PyStore is a simple (yet powerful) datastore for Pandas dataframes, and while it can store any Pandas object, it was designed with storing timeseries data in mind . It's built on top of Pandas, Numpy, Dask, and Parquet (via pyarrow), to provide an easy to use datastore for Python developers that can easily query millions of rows per second per client. New in 2025 Release (PR #77): - MultiIndex Support - Store and retrieve DataFrames with Pandas MultiIndex - Complex Data Types - Full support for Timedelta, Period, Interval, Categorical dtypes - Timezone-Aware Operations - Proper handling of timezone data with UTC storage - Async/Await Support - Non-blocking I/O operations for better performance - Data Validation Framework - Extensible validation rules for data integrity - Schema Evolution - Handle schema changes over time with flexible strategies - Transaction Support - Atomic operations with rollback capabilities - Performance Optimizations - Streaming operations and memory management Performance Enhancements (Phase 3 Release): - Streaming Operations - Memory-efficient append for datasets larger than RAM - Batch Processing - 5-10x faster parallel read/write operations - Intelligent Partitioning - Automatic time-based and size-based partitioning - Memory Management - 70-90% memory reduction with monitoring and optimization - Metadata Caching - 100x faster metadata access with TTL cache - Query Optimization - Column selection","default_branch":null,"files":null,"tree":[],"storefront":"/r/ranaroussi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ranaroussi/pystore/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}