{"repo":"developmentseed/obstore","free":true,"listed":false,"github":"https://github.com/developmentseed/obstore","clone":"git clone https://github.com/developmentseed/obstore.git","description":"The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.","language":"Python","stars":799,"topics":["azure","google-cloud-storage","object-store","python","rust","s3","cloudflare-r2","amazon-s3","azure-storage"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"obstore [![PyPI][pypi badge]][pypi link] [![Conda Version][conda version badge]][conda version] [![PyPI - Downloads][pypi-img]][pypi-link] [pypi badge]: https://badge.fury.io/py/obstore.svg [pypi link]: https://pypi.org/project/obstore/ [conda version badge]: https://img.shields.io/conda/vn/conda-forge/obstore.svg [conda version]: https://prefix.dev/channels/conda-forge/packages/obstore [pypi-img]: https://static.pepy.tech/badge/obstore/month [pypi-link]: https://pypi.org/project/obstore/ The simplest, highest-throughput [^1] Python interface to [Amazon S3][s3], [Google Cloud Storage][gcs], [Azure Storage][azure storage], & other S3-compliant APIs, powered by Rust. [s3]: https://aws.amazon.com/s3/ [gcs]: https://cloud.google.com/storage [azure storage]: https://learn.microsoft.com/en-us/azure/storage/common/storage-introduction - One interface for all backends with no required Python dependencies . - Sync and async API with full type hinting . - Streaming downloads with configurable chunking. - Streaming uploads from files or async or sync iterators. - Streaming list , with no need to paginate. - Automatic multipart uploads for large file objects. - Automatic credential refresh before expiration. - File-like object API and fsspec integration. - Optionally return list results in Apache Arrow format, which is faster and more memory-efficient than materializing Python dict s. - Zero-copy data exchange between Rust and Python via the buffer protocol. For Rust developers looking t","default_branch":null,"files":null,"tree":[],"storefront":"/r/developmentseed","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/developmentseed/obstore/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}