{"repo":"openzim/warc2zim","free":true,"listed":false,"github":"https://github.com/openzim/warc2zim","clone":"git clone https://github.com/openzim/warc2zim.git","description":"Command line tool to convert a file in the WARC format to a file in the ZIM format","language":"HTML","stars":87,"topics":["warc","zim","scraper"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"warc2zim warc2zim adheres to openZIM's Contribution Guidelines. warc2zim has implemented openZIM's Python bootstrap, conventions and policies v2.0.0 . warc2zim converts WARC files to ZIM file. The resulting ZIM contains all WARC records, with \"programming\" records (HTML/CSS/JS/...) rewriten for proper offline operation. The resulting ZIM is self-contained and can render properly in offline situations. Since warc2zim 2.0.0, service workers and HTTPs are not needed anymore for proper ZIM rendering (this was a big constraint of ZIM produced by warc2zim 1.x). WARC format being an archive of any website property, warc2zim is the perfect companion to turn any website into an offline content (see e.g. https://www.github.com/openzim/zimit for a scraper bundling the approach, transform a website URL into an offline ZIM content in a single command). Capabilities While we would like to support as many websites as possible, making an offline archive of a website obviously has some limitations. Scenario which are known to work well: - HTML and CSS documents - JS manipulating the DOM and/or doing simple fetch (preferably GET) requests - E.g. JS manipulating the DOM to modify images, fetch remote stuff (JSON data, ...) is supposed to work - POST requests support is fairly limited (at best, scraper replays the same response as it has been recorded) - Puny-encoded hostnames - Encoded URL path - URL query string - URL fragments - JS modules - HTML base href - Youtube embedded video player Know","default_branch":null,"files":null,"tree":[],"storefront":"/r/openzim","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openzim/warc2zim/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}