{"repo":"ClickHouse/spark-clickhouse-connector","free":true,"listed":false,"github":"https://github.com/ClickHouse/spark-clickhouse-connector","clone":"git clone https://github.com/ClickHouse/spark-clickhouse-connector.git","description":"Spark ClickHouse Connector build on DataSourceV2 API","language":"Scala","stars":217,"topics":["spark","clickhouse","datasourcev2","grpc","http","arrow"],"license":"Apache-2.0","category":"networking-infra","readme_excerpt":"Spark ClickHouse Connector === Build on Apache Spark DataSourceV2 API. Usage See the documentation for how to use this connector. Requirements - Java 8 or 17 - Scala 2.12 or 2.13 - Apache Spark 3.3, 3.4, 3.5, or 4.0 Notes: 1. As of 0.5.0, this connector switches from ClickHouse raw gRPC Client to ClickHouse Official Java Client, which brings HTTP protocol support, extends the range of supported versions of ClickHouse Server. 2. Since 0.6.0, HTTP becomes the default protocol. 3. Since 0.7.0, gRPC is deprecated and not recommended, it may be removed in the future. 4. Since 0.8.0, gRPC is removed. 5. Since 0.8.0, the project groupId is rename from com.github.housepower to com.clickhouse.spark , and the class xenon.clickhouse.ClickHouseCatalog is renamed to com.clickhouse.spark.ClickHouseCatalog Compatible Matrix Version Compatible Spark Versions ClickHouse JDBC version --------- --------------------------- ------------------------- main Spark 3.3, 3.4, 3.5, 4.0 0.9.4 0.8.1 Spark 3.3, 3.4, 3.5 0.6.3 0.7.3 Spark 3.3, 3.4 0.4.6 0.6.0 Spark 3.3 0.3.2-patch11 0.5.0 Spark 3.2, 3.3 0.3.2-patch11 0.4.0 Spark 3.2, 3.3 Not depend on 0.3.0 Spark 3.2, 3.3 Not depend on 0.2.1 Spark 3.2 Not depend on 0.1.2 Spark 3.2 Not depend on Build Build w/o test ./gradlew clean build -x test Test The project leverage Testcontainers and Docker Compose to do integration tests, you should install Docker and Docker Compose before running test, and check more details on Testcontainers document if you'd like t","default_branch":null,"files":null,"tree":[],"storefront":"/r/ClickHouse","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ClickHouse/spark-clickhouse-connector/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}