{"repo":"jkool702/forkrun","free":true,"listed":false,"github":"https://github.com/jkool702/forkrun","clone":"git clone https://github.com/jkool702/forkrun.git","description":"NUMA-Aware Contention-Free Dynamically-Auto-Tuning Bash-Native Streaming Parallelization Engine","language":"Shell","stars":360,"topics":["bash","fast","parallel-computing","parallelize","coproc","forks","loops","parallel","hpc","persistent-workers"],"license":"MIT","category":"cli-tools","readme_excerpt":"forkrun — NUMA-Aware Contention-Free Streaming Parallelization forkrun is a self-tuning, drop-in replacement for GNU Parallel and xargs -P that accelerates shell-based data preparation by 50×–400× on modern CPUs and scales linearly on NUMA architectures. forkrun achieves: - 200,000+ batch dispatches/sec (vs 500 for GNU Parallel) - 95–99% CPU utilization across all cores (vs 6% for GNU Parallel) - Near-zero cross-socket memory traffic (NUMA-aware “born-local” design) - Automatic recovery and retry when a worker unexpectedly dies processing a batch (v3.1.0+) - Seamless HPC Cluster Preemption via automatic SLURM SIGTERM / SIGUSR1 checkpointing (v3.4.0+) - Cartesian Parameter Sweeps ( ::: ) and Live TUI Telemetry (v3.4.0+) forkrun is built for high-frequency, low-latency workloads on deep NUMA hardware — a regime where existing tools leave most cores idle due to IPC overhead and cross-socket data migration. --- 🚀 Quick Start (Installation & Usage) forkrun is distributed as a single bash file with an embedded, self-extracting compiled C extension. There are no external dependencies (no Perl, no Python). Download and source it directly: (Note: Sourcing the script sets up the required C loadable builtins in your shell environment). Once sourced, frun acts as a drop-in parallelizer: Verifiable Builds : The embedded C-extension is compiled and injected transparently via GitHub Actions. You can trace the git blame of the Base64 blob directly to the public CI workflow run that compiled","default_branch":null,"files":null,"tree":[],"storefront":"/r/jkool702","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jkool702/forkrun/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}