{"repo":"aws-samples/aws-glue-test-data-generator","free":true,"listed":false,"github":"https://github.com/aws-samples/aws-glue-test-data-generator","clone":"git clone https://github.com/aws-samples/aws-glue-test-data-generator.git","description":"AWS Glue Configurable Test Data Generator for S3 Data Lakes and DynamoDB","language":"Python","stars":19,"topics":["aws","glue","pyspark","cdk","testing-tools","dynamodb","s3","etl","serverless","test-automation"],"license":"MIT-0","category":"data-pipelines","readme_excerpt":"AWS Glue Test Data Generator for S3 Data Lakes and DynamoDB Test data generation plays a critical role in evaluating system performance, validating accuracy, bug identification, enhancing reliability, assessing scalability, ensuring regulatory compliance, training machine learning models, and supporting CI/CD processes. It enables the discovery of potential issues and ensures that systems operate as intended across diverse scenarios. The AWS Glue Test Data Generator provides a configurable framework for Test Data Generation using AWS Glue Pyspark serverless Jobs. The required test data description is fully configurable through a YAML configuration file. Code Repository on Github The source code and depolyment instruction are accessible through this link: Github Code Repository Supported data types The Test Data Generation Framework currently supports the following types: Unique Key Generator This generator produces formatted unique values that can be used as partition key. you can specify a prefix to and the number of leading zeros if required. Child Key Generator This generator produces a child key referencing the primary key. This is useful in generating multi-level hierarchical data. you can specify the number of levels and how many nodes you want to generate per level. String Data Generator This generator produces String data type with various mechanisms: Random Strings : you can specify the number of characters and the type of generated characters: numeric, alphabetic or","default_branch":null,"files":null,"tree":[],"storefront":"/r/aws-samples","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/aws-samples/aws-glue-test-data-generator/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}