{"repo":"nisshi-io/nisshi","free":true,"listed":false,"github":"https://github.com/nisshi-io/nisshi","clone":"git clone https://github.com/nisshi-io/nisshi.git","description":"Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake","language":"Rust","stars":1846,"topics":["built-with-rust","postgres","postgresql","s3","apache-iceberg","apache-kafka","apache-arrow","datafusion","parquet","delta-lake"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Nisshi (née Tansu) 🗃️ stateless Kafka-compatible broker with pluggable storage (PostgreSQL, SQLite, S3, memory)           What is Nisshi? [Nisshi][github-com-nisshi-io] (née Tansu) is a drop-in replacement for Apache Kafka with PostgreSQL, libSQL (SQLite), S3 or memory storage engines. Schema backed topics (Avro, JSON or Protocol buffers) can be written as Apache Iceberg or Delta Lake tables. Features: - Apache Kafka API compatible - Available with PostgreSQL, libSQL, S3 or memory storage engines - Topics validated by [JSON Schema][json-schema-org], Apache Avro or Protocol buffers can be written as Apache Iceberg or Delta Lake tables See examples using pyiceberg, examples using Apache Spark or 🆕 examples using Delta Lake. For data durability: - S3 is designed to exceed [99.999999999% (11 nines)][aws-s3-storage-classes] - PostgreSQL with [continuous archiving][continuous-archiving] streaming transaction logs files to an archive - The memory storage engine is designed for ephemeral non-production environments Nisshi is a single statically linked binary containing the following: - broker an Apache Kafka API compatible broker and schema registry - topic a CLI to create/delete Topics - cat a CLI to consume or produce Avro, JSON or Protobuf messages to a topic - proxy an Apache Kafka compatible proxy broker The broker subcommand is default if no other command is supplied. A broker can be started by simply running nisshi , all options have defaults. Nisshi","default_branch":null,"files":null,"tree":[],"storefront":"/r/nisshi-io","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nisshi-io/nisshi/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}