{"repo":"oliver006/elasticsearch-test-data","free":true,"listed":false,"github":"https://github.com/oliver006/elasticsearch-test-data","clone":"git clone https://github.com/oliver006/elasticsearch-test-data.git","description":"Generate and upload test data to Elasticsearch for performance and load testing","language":"Python","stars":259,"topics":["elasticsearch","python","tornado","data","test-data"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Elasticsearch For Beginners: Generate and Upload Randomized Test Data Because everybody loves test data. Ok, so what is this thing doing? es test data.py lets you generate and upload randomized test data to your ES cluster so you can start running queries, see what performance is like, and verify your cluster is able to handle the load. It allows for easy configuring of what the test documents look like, what kind of data types they include and what the field names are called. Cool, how do I use this? Run Python script Let's assume you have an Elasticsearch cluster running. Python and Tornado are used. Run pip install tornado to install Tornado if you don't have it already. It's as simple as this: Without any command line options, it will generate and upload 1000 documents of the format to an Elasticsearch cluster at http://localhost:9200 to an index called test data . Docker and Docker Compose Requires Docker for running the app and Docker Compose for running a single ElasticSearch domain with two nodes (es1 and es2). 1. Set the maximum virtual memory of your machine to 262144 otherwise the ElasticSearch instances will crash, see the docs 1. Clone this repository 1. Run the ElasticSearch stack 1. Run the app and inject random data to the ES stack 1. Cleanup Not bad but what can I configure? python es test data.py --help gives you the full set of command line ptions, here are the most important ones: - --es url=http://localhost:9200 the base URL of your ES node, don't include","default_branch":null,"files":null,"tree":[],"storefront":"/r/oliver006","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/oliver006/elasticsearch-test-data/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}