{"repo":"data-tools/big-data-types","free":true,"listed":false,"github":"https://github.com/data-tools/big-data-types","clone":"git clone https://github.com/data-tools/big-data-types.git","description":"A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.","language":"Scala","stars":14,"topics":["bigquery","database-types","schemas","spark","bigquery-tables","typeclass","typeclass-derivation","typesafe","cassandra","scala"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Big Data Types A type-safe library to transform Case Classes into Database schemas and to convert implemented types into other types Documentation Check the Documentation website to learn more about how to use this library Available conversions: From \\ To Scala Types BigQuery Spark Cassandra Circe (JSON) :------------: :---------------------------------------------------------------------------------------------------------------------: :-----------: :------------------: :------------------: :------------------: :------------: Scala - :white check mark: :white check mark: :white check mark: BigQuery - :white check mark: :white check mark: Spark :white check mark: - :white check mark: Cassandra :white check mark: :white check mark: - Circe (JSON) :white check mark: :white check mark: :white check mark: - Versions for Scala , and are available in Maven Quick Start The library has different modules that can be imported separately - BigQuery - Spark - Cassandra - Circe (JSON) - Core - To get support for abstract SqlTypes, it is included in the others, so it is not needed if you are using one of the others In order to transform one type into another, both modules have to be imported. How it works The library internally uses a generic ADT (SqlType) that can store any schema representation, and from there, it can be converted into any other. Transformations are done through 2 different type-classes. Quick examples Case Classes to other types There are also extension methods that mak","default_branch":null,"files":null,"tree":[],"storefront":"/r/data-tools","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/data-tools/big-data-types/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}