{"repo":"reidmorrison/rocketjob","free":true,"listed":false,"github":"https://github.com/reidmorrison/rocketjob","clone":"git clone https://github.com/reidmorrison/rocketjob.git","description":"Process millions of records across thousands of workers.","language":"Ruby","stars":291,"topics":["batch","batch-processing","batch-job","batch-file","batch-framework","mongodb","sidekiq","delayed-jobs","resque","encryption"],"license":"Apache-2.0","category":"security-tools","readme_excerpt":"Rocket Job Process millions of records across thousands of workers. Rocket Job is a distributed, priority-based, MongoDB-backed batch processing system for Ruby. Run conventional background jobs, or split a single job's input into slices and process it concurrently across thousands of workers, spilling from memory to disk so very large files never fall over. Full documentation is at rocketjob.reidmorrison.com . Documentation Introduction — what Rocket Job is and why it exists Installation Programmer's Guide — simple jobs Batch Guide — parallel batch jobs Included Jobs and Directory Monitor Events Web UI (Mission Control) Deployment Architecture and Internals API Reference Support Ask questions in Rocket Job Discussions Report bugs Upgrading See the Upgrading guide for the code and data changes needed between major versions. Per-release notes are in the GitHub Releases. Contributing Contributions are welcome. See CONTRIBUTING.md for the development setup and how to run the test suite, and the Architecture and Internals page for how Rocket Job is put together. The documentation site lives in docs/ as Jekyll markdown. To preview changes locally: bash cd docs bundle update jekyll serve Then open http://127.0.0.1:4000 and edit the files under docs/ . Versioning This project uses Semantic Versioning. License Apache License v2.0. See LICENSE.txt. Author Reid Morrison Contributors","default_branch":null,"files":null,"tree":[],"storefront":"/r/reidmorrison","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/reidmorrison/rocketjob/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}