{"repo":"warpstreamlabs/bento","free":true,"listed":false,"github":"https://github.com/warpstreamlabs/bento","clone":"git clone https://github.com/warpstreamlabs/bento.git","description":"Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.","language":"Go","stars":2100,"topics":["benthos","bento","connect","connectors","kafka","processing","stream"],"license":null,"category":"data-pipelines","readme_excerpt":"[![godoc for warpstreamlabs/bento][godoc-badge]][godoc-url] [![Build Status][actions-badge]][actions-url] [![govulncheck][govulncheck-badge]][govulncheck-url] [![Docs site][website-badge]][website-url] Discord Slack Bento is a high performance and resilient stream processor, able to connect various [sources][inputs] and [sinks][outputs] in a range of brokering patterns and perform [hydration, enrichments, transformations and filters][processors] on payloads. It comes with a [powerful mapping language][bloblang-about], is easy to deploy and monitor, and ready to drop into your pipeline either as a static binary, docker image, or [serverless function][serverless], making it cloud native as heck. Bento is declarative, with stream pipelines defined in as few as a single config file, allowing you to specify connectors and a list of processing stages: Delivery Guarantees Delivery guarantees can be a dodgy subject. Bento processes and acknowledges messages using an in-process transaction model with no need for any disk persisted state, so when connecting to at-least-once sources and sinks it's able to guarantee at-least-once delivery even in the event of crashes, disk corruption, or other unexpected server faults. This behaviour is the default and free of caveats, which also makes deploying and scaling Bento much simpler. Supported Sources & Sinks AWS (DynamoDB, Kinesis, S3, SQS, SNS), Azure (Blob storage, Queue storage, Table storage), GCP (Pub/Sub, Cloud storage, Big query), Kafka","default_branch":null,"files":null,"tree":[],"storefront":"/r/warpstreamlabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/warpstreamlabs/bento/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}