{"repo":"lakehq/sail","free":true,"listed":false,"github":"https://github.com/lakehq/sail","clone":"git clone https://github.com/lakehq/sail.git","description":"Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.","language":"Rust","stars":3305,"topics":["arrow","big-data","pyspark","rust","spark","sql","datafusion","python","artificial-intelligence","data-engineering"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Sail Sail is a drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads on a distributed, multimodal compute engine. - Compatible with the Spark Connect protocol, supporting the Spark SQL and DataFrame API with no code rewrites required. - 100% Rust-native with no JVM overhead, delivering memory safety, instant startup, and predictable performance. - 10× faster than Spark and 98% cheaper on infrastructure costs. See derived TPC-H benchmarks . - Proven on ClickBench , outperforming Spark, popular Spark accelerators, Databricks, and Snowflake. Documentation The documentation of the latest Sail version can be found here. Installation Quick Start Sail is available as a Python package on PyPI. You can install it along with PySpark in your Python environment. Advanced Use Cases You can install Sail from source to optimize performance for your specific hardware architecture. The detailed Installation Guide walks you through this process step-by-step. If you need to deploy Sail in production environments, the Deployment Guide provides comprehensive instructions for deploying Sail on Kubernetes clusters and other infrastructure configurations. Getting Started Starting the Sail Server Option 1: Command Line Interface. You can start the local Sail server using the sail command. Option 2: Python API. You can start the local Sail server using the Python API. Option 3: Kubernetes. You can deploy Sail on Kubernetes an","default_branch":null,"files":null,"tree":[],"storefront":"/r/lakehq","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lakehq/sail/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}