{"repo":"cado-security/cloudgrep","free":true,"listed":false,"github":"https://github.com/cado-security/cloudgrep","clone":"git clone https://github.com/cado-security/cloudgrep.git","description":"cloudgrep is grep for cloud storage","language":"Python","stars":333,"topics":["aws","aws-s3","grep","search","cloud","cloud-security","aws-security","azure","azure-security","gcp"],"license":"Apache-2.0","category":"dev-tools","readme_excerpt":"cloudgrep # cloudgrep searches cloud storage. It currently supports searching log files, optionally compressed with gzip (.gz) or zip (.zip), in AWS S3, Azure Storage or Google Cloud Storage. Why? ### - Directly searching cloud storage, without indexing logs into a SIEM or Log Analysis tool, can be faster and cheaper. - There is no need to wait for logs to be ingested, indexed, and made available for searching. - It searches files in parallel for speed. - This may be of use when debugging applications, or investigating a security incident. Example ### Simple example: Simple Azure example: Simple Google example: Simple CloudTrail log example, outputting results as JSON: Simple custom log example: More complicated example: Saving the output to a file: Example output: Arguments ### Deployment ### Install with: Or download the latest compiled release here You can run this from your local laptop, or from a virtual machine in your cloud provider. This requires python3.10 or later Docker #### Build with: Run with: To pass environment variables, e.g. for AWS: Running in your Cloud and Authentication ### AWS #### Your system will need access to the S3 bucket. For example, if you are running on your laptop, you will need to configure the AWS CLI. If you are running on an EC2, an Instance Profile is likely the best choice. If you run on an EC2 instance in the same region as the S3 bucket with a VPC endpoint for S3 you can avoid egress charges. You can authenticate in a number of ways. A","default_branch":null,"files":null,"tree":[],"storefront":"/r/cado-security","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cado-security/cloudgrep/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}