{"repo":"HariSekhon/DevOps-Python-tools","free":true,"listed":false,"github":"https://github.com/HariSekhon/DevOps-Python-tools","clone":"git clone https://github.com/HariSekhon/DevOps-Python-tools.git","description":"80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.","language":"Python","stars":823,"topics":["cloudformation","python","hbase","json","avro","parquet","spark","pyspark","travis-ci","elasticsearch"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Hari Sekhon - DevOps Python Tools git.io/pytools AWS, Docker, Spark, Hadoop, HBase, Hive, Impala, Python & Linux Tools DevOps, Cloud, Big Data, NoSQL, Python & Linux tools. All programs have --help . Hari Sekhon Cloud & Big Data Contractor, United Kingdom (you're welcome to connect with me on LinkedIn) Make sure you run make update if updating and not just git pull as you will often need the latest library submodule and possibly new upstream libraries Quick Start Ready to run Docker image All programs and their pre-compiled dependencies can be found ready to run on DockerHub. List all programs: Run any given program: Automated Build from source installs git, make, pulls the repo and build the dependencies: or manually: To only install pip dependencies for a single script, you can just type make and the filename with a .pyc extension instead of .py : Make sure to read Detailed Build Instructions further down for more information. Some Hadoop tools with require Jython, see Jython for Hadoop Utils for details. Usage All programs come with a --help switch which includes a program description and the list of command line options. Environment variables are supported for convenience and also to hide credentials from being exposed in the process list eg. $PASSWORD , $TRAVIS TOKEN . These are indicated in the --help descriptions in brackets next to each option and often have more specific overrides with higher precedence eg. $AMBARI HOST , $HBASE HOST take priority over $HOST . DevOps","default_branch":null,"files":null,"tree":[],"storefront":"/r/HariSekhon","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/HariSekhon/DevOps-Python-tools/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}