{"repo":"ICIJ/extract","free":true,"listed":false,"github":"https://github.com/ICIJ/extract","clone":"git clone https://github.com/ICIJ/extract.git","description":"A cross-platform command line tool for parallelised content extraction and analysis.","language":"Java","stars":257,"topics":["tika","etl","index","ediscovery","solr"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Extract A cross-platform command line tool for parallelized, distributed content extraction. Status --: :-- CI checks Maven Central Latest version Open issues Documentation Extract Extract is an open‑source, cross‑platform command line tool for parallelized, distributed content extraction. Built on top of Apache Tika, it parses text and metadata from heterogeneous files (PDFs, emails, office documents, images, archives, etc.) and can run optical character recognition (OCR) on scans. It uses Redis‑backed queueing to distribute work across many machines and writes results to Solr, plain text files, or standard output. Extract is an essential part of the engineering behind the Panama Papers, Swiss Leaks and Luxembourg Leaks investigations. Table of Contents - Main Features - Developer Guide - Requirements - Build - Run Tests - Release - License - About ICIJ Main Features 📄 Tika‑powered extraction : Parse text and metadata from PDFs, emails, office docs, images, archives, and more. 🖼️ OCR on scans & images : Turn visual text into machine‑readable text via Tesseract. ⚡ Parallel extraction : Process many files concurrently on a single machine. 🌐 Distributed queueing : Coordinate extraction across multiple machines with a Redis‑backed queue. 📤 Pluggable output : Write extracted content to Solr, plain text files, or standard output. Developer Guide This section explains how to set up a development environment, build the project, and run the tests. It assumes you are comfortable w","default_branch":null,"files":null,"tree":[],"storefront":"/r/ICIJ","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ICIJ/extract/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}