{"repo":"y-scope/clp","free":true,"listed":false,"github":"https://github.com/y-scope/clp","clone":"git clone https://github.com/y-scope/clp.git","description":"Compressed Log Processor (CLP) is a free log management tool capable of compressing logs and searching the compressed logs without decompression.","language":"C++","stars":1081,"topics":["logging","compression","analytics","search","log-parser","log-management"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"[![Discord][badge-discord]][clp-community-discord] [![Slack][badge-slack]][clp-community-slack] [![CLP on Zulip][badge-zulip]][yscope-community-zulip] YScope's Compressed Log Processor (CLP) compresses your logs, and allows you to search the compressed logs without decompression. CLP supports both JSON logs and unstructured (i.e., free text) logs. It also supports real-time log compression within several logging libraries. CLP also includes purpose-built web interfaces for searching and viewing the compressed logs. To learn more about it, read our [2021 paper][clp-paper-21] about handling unstructured logs and our [2024 paper][clp-paper-24] on extending it to JSON logs. Benchmarks The figures above show CLP's compression and search performance compared to other tools. We separate the experiments between JSON and unstructured logs because (1) some tools can only handle one type of logs, and (2) tools that can handle both types often have different designs for each type (such as CLP). Compression ratio is measured as the average across a variety of log datasets. Some of these datasets can be found [here][datasets]. Search performance is measured using queries on the MongoDB logs (for JSON) and the Hadoop logs (for unstructured logs). Note that CLP uses an index-less design, so for a fair comparison, we disabled MongoDB and PostgreSQL's indexes; If we left them enabled, MongoDB and PostgreSQL's compression ratio would be worse. We didn't disable indexing for Elasticsearch or Spl","default_branch":null,"files":null,"tree":[],"storefront":"/r/y-scope","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/y-scope/clp/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}