{"repo":"AbsaOSS/ABRiS","free":true,"listed":false,"github":"https://github.com/AbsaOSS/ABRiS","clone":"git clone https://github.com/AbsaOSS/ABRiS.git","description":"Avro SerDe for Apache Spark structured APIs.","language":"Scala","stars":242,"topics":["avro-schema","schema-registry","spark","kafka","avro"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"ABRiS - Avro Bridge for Spark - Pain free Spark/Avro integration. - Seamlessly integrate with Confluent platform, including Schema Registry with all available naming strategies and schema evolution. - Seamlessly convert your Avro records from anywhere (e.g. Kafka, Parquet, HDFS, etc) into Spark Rows. - Convert your Dataframes into Avro records without even specifying a schema. - Go back-and-forth Spark Avro (since Spark 2.4). Coordinates for Maven POM dependency Scala Abris :------: :-------: 2.11 2.12 2.13 Supported versions Abris Spark Scala :-----: :-------------: :-----: 6.2.0 - 6.x.x 3.2.1 - 3.5.x 2.12 / 2.13 6.0.0 - 6.1.1 3.2.0 2.12 / 2.13 5.0.0 - 5.x.x 3.0.x / 3.1.x 2.12 5.0.0 - 5.x.x 2.4.x 2.11 / 2.12 From version 6.0.0, ABRiS only supports Spark 3.2.x. ABRiS 5.0.x is still supported for older versions of Spark (see branch-5) Older Versions This is documentation for Abris version 6 . Documentation for older versions is located in corresponding branches: branch-5, branch-4, branch-3.2. Confluent Schema Registry Version Abris by default uses Confluent client version 6.2.0. Installation Abris needs spark-avro to run, make sure you include the spark-avro dependency when using Abris. The version of spark-avro and Spark should be identical. Example: submitting a Spark job: Example: using Abris in maven project: Example: using Abris in SBT project: Usage ABRiS API is in it's most basic form almost identical to Spark built-in support for Avro, but it provides additional funct","default_branch":null,"files":null,"tree":[],"storefront":"/r/AbsaOSS","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AbsaOSS/ABRiS/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}