{"repo":"awslabs/amazon-s3-find-and-forget","free":true,"listed":false,"github":"https://github.com/awslabs/amazon-s3-find-and-forget","clone":"git clone https://github.com/awslabs/amazon-s3-find-and-forget.git","description":"Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)","language":"Python","stars":247,"topics":["data-lake","amazon-s3","s3","gdpr","aws","parquet","data-erasure","right-to-be-forgotten","ccpa","big-data"],"license":"Apache-2.0","category":"self-hosted-apps","readme_excerpt":"Amazon S3 Find and Forget Warning: Consult the Production Readiness guidelines prior to using the solution with production data Amazon S3 Find and Forget is a solution to the need to selectively erase records from data lakes stored on Amazon Simple Storage Service (Amazon S3). This solution can assist data lake operators to handle data erasure requests, for example, pursuant to the European General Data Protection Regulation (GDPR). The solution can be used with Parquet and JSON format data stored in Amazon S3 buckets. Your data lake is connected to the solution via AWS Glue tables and by specifying which columns in the tables need to be used to identify the data to be erased. Once configured, you can queue record identifiers that you want the corresponding data erased for. You can then run a deletion job to remove the data corresponding to the records specified from the objects in the data lake. A report log is provided of all the S3 objects modified. Installation The solution is available as an AWS CloudFormation template and should take about 20 to 40 minutes to deploy. See the deployment guide for one-click deployment instructions, and the cost overview guide to learn about costs. Usage The solution provides a web user interface, and a REST API to allow you to integrate it in your own applications. See the user guide to learn how to use the solution and the API specification to integrate the solution with your own applications. Architecture The goal of the solution is to ","default_branch":null,"files":null,"tree":[],"storefront":"/r/awslabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/awslabs/amazon-s3-find-and-forget/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}