{"repo":"vast-data/vastdb_sdk","free":true,"listed":false,"github":"https://github.com/vast-data/vastdb_sdk","clone":"git clone https://github.com/vast-data/vastdb_sdk.git","description":"Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.","language":"Python","stars":39,"topics":["arrow","database","olap","python","sdk"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"VAST DB Python SDK A Python SDK for seamless interaction with VAST Database and VAST Catalog. Enables powerful data operations including: - Schema and table management - Efficient data ingest and querying - Advanced filtering with predicate pushdown - Direct integration with PyArrow and DuckDB - File system querying through VAST Catalog For technical details about VAST Database architecture, see the whitepaper. Getting Started Requirements - Linux client with Python 3.10 - 3.13, and network access to the VAST Cluster - VAST Cluster release 5.0.0-sp10 or later - If your VAST Cluster is running an older release, please contact customer.support@vastdata.com. - Virtual IP pool configured with DNS service - S3 access & secret keys on the VAST cluster - Tabular identity policy with the proper permissions Installation See the Release Notes for the SDK. Quick Start Create schemas and tables, basic inserts, and selects: Note: the transaction must be remain open while the returned pyarrow.RecordBatchReader generator is being used. The list of supported data types can be found here. Features Select Performance The Table.select() method accepts a QueryConfig object that modifies how the select is fulfilled. The most important setting is the data endpoints parameter that, when set, will allow the SDK to parallelize the select across multiple CNodes. Without this, only the CNode specified in the connect() will service the select. If using DNS with either TTL=0 or multi-response per the Bes","default_branch":null,"files":null,"tree":[],"storefront":"/r/vast-data","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vast-data/vastdb_sdk/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}