{"repo":"bacalhau-project/bacalhau","free":true,"listed":false,"github":"https://github.com/bacalhau-project/bacalhau","clone":"git clone https://github.com/bacalhau-project/bacalhau.git","description":"Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.","language":"Go","stars":869,"topics":["p2p","distributed","iot","bioinformatics-pipeline","data-analysis","data-engineering","data-science","decentralized","video-processing","batch-processing"],"license":"Apache-2.0","category":"media-processing","readme_excerpt":"Globally Distributed Compute Orchestrator ⚡ Compute Over Data (CoD) What is Bacalhau? Bacalhau is an open-source distributed compute orchestration framework designed to bring compute to the data. Instead of moving large datasets around networks, Bacalhau makes it easy to execute jobs close to the data's location, drastically reducing latency and resource overhead. Why Bacalhau? - ⚡ Fast job processing : Jobs in Bacalhau are processed where the data was created and all jobs are parallel by default - 💰 Low cost : Reduce (or eliminate) ingress/egress costs since jobs are processed closer to the source - 🔒 Secure : Data scrubbing and security can happen before migration, with a granular, code-based permission model - 🚛 Large-scale data : Process petabytes of data efficiently without massive data transfers - 🏢 Data sovereignty : Process sensitive data within security boundaries without requiring it to leave your premises - 🤝 Cross-organizational computation : Allow specific vetted computations on protected datasets without exposing raw data Key Features 1. Single Binary Simplicity : Bacalhau is a single self-contained binary that functions as a client, orchestrator, and compute node—making it incredibly easy to set up and scale 2. Modular Architecture : Support for multiple execution engines (Docker, WebAssembly) and storage providers through clean interfaces 3. Orchestrator-Compute Model : A dedicated orchestrator coordinates job scheduling, while compute nodes run tasks 4. ","default_branch":null,"files":null,"tree":[],"storefront":"/r/bacalhau-project","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bacalhau-project/bacalhau/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}