{"repo":"delta-incubator/delta-sharing-rs","free":true,"listed":false,"github":"https://github.com/delta-incubator/delta-sharing-rs","clone":"git clone https://github.com/delta-incubator/delta-sharing-rs.git","description":"A Minimalistic Rust Implementation of Delta Sharing Server.","language":"Rust","stars":97,"topics":["axum","data-engineering","delta-io","delta-lake","rust"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Delta Sharing Server ============================== delta-sharing-rs is a Rust-based Delta Sharing server that includes administration functionality. Unlike the reference implementation of a Delta Sharing server, which primarily focuses on the API specification and uses static file-based sharing information, delta-sharing-rs manages its sharing information through an API. Supported Platforms ============================== Amazon AWS Google GCP Microsoft Azure :---------------: :----------------: :---------------: :green square: :green square: :red square: Configure Credentials for Cloud Storage Backends ============================== 1. Amazon AWS To access the S3 Delta table backend, you need to create an IAM user with an Amazon S3 permissions policy. Once you've created the IAM user, you must configure the profile name and region to allow the Delta Sharing server to access the S3 bucket. The location of the credentials file is specified by the environment variable AWS SHARED CREDENTIALS FILE . If this variable is not set, the credentials file should be located at /.aws/credentials . delta-sharing-rs utilizes the Object Store crate with the aws-config feature, which requires the AWS PROFILE and AWS REGION environment variables if you use S3 Delta table backend. 2. Google GCP To access the GCS Delta table backend, you need to create a GCS service account. The location of the GCP service account private key JSON is specified by the environment variable GOOGLE APPLICATION CREDE","default_branch":null,"files":null,"tree":[],"storefront":"/r/delta-incubator","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/delta-incubator/delta-sharing-rs/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}