{"repo":"irfanghat/spark-connect-cpp","free":true,"listed":false,"github":"https://github.com/irfanghat/spark-connect-cpp","clone":"git clone https://github.com/irfanghat/spark-connect-cpp.git","description":"An Apache Spark Connect Client for C++.","language":"C++","stars":10,"topics":["apache-spark","spark-connect","cpp"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Spark Connect C++ Overview This repository provides a C++ client for Apache Spark via Spark Connect , enabling C++ applications to execute Spark SQL workloads against remote Spark clusters without requiring JVM dependencies. Spark Connect introduced a decoupled client–server architecture for Apache Spark, where client applications construct logical query plans that are executed remotely by a Spark server. This project delivers an idiomatic, high-performance C++ interface for building and submitting Spark queries, with efficient Apache Arrow–based columnar data exchange over gRPC. The library is intended for environments where: Native C++ integration is required High-throughput data movement is necessary Tight control over memory and system resources is important Existing performance-critical C++ systems need to integrate with Spark Status: Work in Progress --- Design Goals Native-first Spark integration for C++ ecosystems Efficient Arrow-based columnar data transfer Clear separation between client logic and remote Spark execution Compatibility with evolving Spark Connect protocols Compatibility with Spark versions 3.x.x - 4.x.x Predictable performance characteristics suitable for production systems Minimal runtime dependencies outside standard native infrastructure --- Use Cases Native Data Producers and High-Throughput Pipelines Enable high-performance C++ services to submit ingestion workloads and push structured datasets to Spark. Integration with Legacy, Industrial, and S","default_branch":null,"files":null,"tree":[],"storefront":"/r/irfanghat","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/irfanghat/spark-connect-cpp/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}