{"repo":"openzim/zimfarm","free":true,"listed":false,"github":"https://github.com/openzim/zimfarm","clone":"git clone https://github.com/openzim/zimfarm.git","description":"Farm operated by bots to grow and harvest new zim files","language":"Python","stars":198,"topics":["flask","python3","zim-files","distributed-systems","docker-images"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"ZIM Farm The ZIM farm (zimfarm) is a semi-decentralised software solution to build ZIM files efficiently. This means scraping Web contents, packaging them into a ZIM file and uploading the result to an online ZIM files repository. Documentation - Editors Guide : For recipe managers - learn about recipes, tasks, workers, and how to manage content creation - Integrators Guide : For integrators who are looking to install configure, deploy and maintain Zimfarm platform infrastructure. - Contributing Guide : How to contribute to Zimfarm development How does it work? The Zimfarm platform is a combination of different tools: backend The backend is a central database and API that records recipes (metadata of ZIM to produce) and tasks . It decides when a ZIM file should be recreated (based on the recipe), creates and assigns tasks to workers . frontend The frontend, available at farm.openzim.org is a simple consumer of the backend API. It is used to create, clone and edit recipes, but also to monitor the evolution of tasks and workers . Anybody can use it in read-only mode. workers Workers are always-running computers which gets assigned ZIM creation tasks by the dispatcher. If you are interested in providing us worker resources, please read these instructions. Note: The repository contains both a worker/ folder (singular) and a workers/ folder (plural). The worker/ folder is the current and actively maintained location for all worker-related code and documentation. The workers/ folde","default_branch":null,"files":null,"tree":[],"storefront":"/r/openzim","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openzim/zimfarm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}