{"repo":"zepto-labs/scherry","free":true,"listed":false,"github":"https://github.com/zepto-labs/scherry","clone":"git clone https://github.com/zepto-labs/scherry.git","description":"Split it. Ship it. Track it - Because every big job deserves a little scherry on top :cherries:","language":"Go","stars":96,"topics":["distributed-systems","golang","job-queue","job-scheduler","kafka","postgres","go"],"license":null,"category":"databases-storage","readme_excerpt":"Track every job. Manage every lifecycle. Better tracking and management of distributed job lifecycles — from web console. --- scherry is a production-ready distributed job orchestration library for Go that lets you split large workloads into parallel tasks, distribute them over Kafka, and track every job and task throughout its lifecycle. Unlike single-level task queues that leave you guessing when a batch run stalls or fails, scherry gives you a two-level job → task model on top of Asynq: split work once, execute tasks in parallel, persist state at every step, and inspect progress, retries, and failures from a single UI. --- Table of contents - How it builds on Asynq - Feature comparison - Architecture - Features - Install - Prerequisites - Configuration - Quick start - Scheduled job (cron-triggered) - Manual job (on-demand trigger) - Sharing a consumer across jobs - Kafka tuning - ConsumerConfig - WriterConfig - TLS and SASL - History console - Overview tab - History tab - Jobs tab - Upcoming tab - Core interfaces - JobExecutor - TaskData - TaskExecutor - Logger - Hooks - Payroll example - Migrating an existing app - Job lifecycle - Task lifecycle - API summary - Contributing - Third-Party Licenses - License - Credits How it builds on Asynq Asynq is a Redis-backed distributed task queue: you enqueue individual tasks, workers pick them up, and Asynq handles retries, priorities, and scheduling. It is excellent for simple background job processing. scherry uses Asynq for one s","default_branch":null,"files":null,"tree":[],"storefront":"/r/zepto-labs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/zepto-labs/scherry/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}