{"repo":"unytics/airbyte_serverless","free":true,"listed":false,"github":"https://github.com/unytics/airbyte_serverless","clone":"git clone https://github.com/unytics/airbyte_serverless.git","description":"Airbyte made simple (no UI, no database, no cluster)","language":"Python","stars":196,"topics":["airbyte","bigquery","data-warehouse","elt","etl","data","data-analysis","data-engineering","pipeline"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Airbyte made simple --- 🔍️ What is AirbyteServerless? AirbyteServerless is a simple tool to manage Airbyte connectors , run them locally or deploy them in serverless mode. 💡 Why AirbyteServerless? Airbyte is a must-have in your data-stack with its catalog of open-source connectors to move your data from any source to your data-warehouse . To manage these connectors, Airbyte offers Airbyte-Open-Source-Platform which includes a server, workers, database, UI, orchestrator, connectors, secret manager, logs manager, etc. AirbyteServerless aims at offering a lightweight alternative to Airbyte-Open-Source-Platform to simplify connectors management. 📝 Comparing Airbyte-Open-Source-Platform & AirbyteServerless Airbyte-Open-Source-Platform AirbyteServerless -------- ------- Has a UI Has NO UI Connections configurations are managed by documented yaml files Has a database Has NO database - Configurations files are versioned in git - The destination stores the state (the checkpoint of where sync stops) and logs which can then be visualized with your preferred BI tool Has a transform layer Airbyte loads your data in a raw format but then enables you to perform basic transform such as replace, upsert, schema normalization Has NO transform layer - Data is appended in your destination in raw format. - airbyte serverless is dedicated to do one thing and do it well: Extract-Load . NOT Serverless - Can be deployed on a VM or Kubernetes Cluster. - The platform is made of tens of dependent cont","default_branch":null,"files":null,"tree":[],"storefront":"/r/unytics","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/unytics/airbyte_serverless/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}