{"repo":"hchargois/esdump","free":true,"listed":false,"github":"https://github.com/hchargois/esdump","clone":"git clone https://github.com/hchargois/esdump.git","description":"Dump an Elasticsearch (v7 or v8) index via scrolling. Achieve speeds up to 1 million doc/s on a single node","language":"Go","stars":10,"topics":["elasticsearch","json","backup","cli","export"],"license":"MIT","category":"cli-tools","readme_excerpt":"esdump esdump is a simple and efficient CLI tool to dump (retrieve) the documents contained in an Elasticsearch index via scrolling. It outputs to standard output, in JSON lines (a.k.a. JSONL or NDJSON) format. It works with Elasticsearch versions 7.x and 8.x. Features - Correctly clears the scroll contexts before exiting, to free Elasticsearch resources - Automatically uses slicing for best performance - You can specify which document fields to output - Options to scroll in a random order and only a given number of docs, to easily get samples - You can specify a query in full Elasticsearch format or in the query string (a.k.a. Lucene) syntax - Adaptive throttling - Works with security (username/password & HTTPS with custom certificate) - Option to turn HTTP gzip compression off (uses less CPU if network is not a bottleneck) - ... and more! Install Requires Go = 1.18 go install github.com/hchargois/esdump@latest Examples Usage is detailed in sections below, but here are a few simple examples: # Dump an index to a file using default settings esdump http://localhost myindex out.jsonl # Dump multiple indexes using multi-target notation esdump http://localhost myindex1,myindex2 # Select the document fields to dump esdump http://localhost myindex --fields id,date,description # Specify a query in \"query string\" format esdump http://localhost myindex --query \"rabbit OR bunny\" # Specify a search query on standard input echo '{\"query\": {\"term\": {\"animal\": \"rabbit\"}}}' esdump http://lo","default_branch":null,"files":null,"tree":[],"storefront":"/r/hchargois","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/hchargois/esdump/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}