{"repo":"aws-solutions-library-samples/data-lakes-on-aws","free":true,"listed":false,"github":"https://github.com/aws-solutions-library-samples/data-lakes-on-aws","clone":"git clone https://github.com/aws-solutions-library-samples/data-lakes-on-aws.git","description":"Enterprise-grade, production-hardened, serverless data lake on AWS","language":"Python","stars":483,"topics":["serverless","framework","data-lake","analytics","aws","etl","data-engineering","lake-formation","iac","best-practices"],"license":"MIT-0","category":"data-pipelines","readme_excerpt":"Serverless Data Lake Framework (SDLF) Table of Contents 1. Overview - Cost 2. Prerequisites 3. Deployment Steps 4. Deployment Validation 5. Running the Guidance 6. Cleanup 6. Authors Overview An AWS Professional Service open source initiative aws-proserve-opensource@amazon.com The Serverless Data Lake Framework (SDLF) is a collection of reusable artifacts aimed at accelerating the delivery of enterprise data lakes on AWS, shortening the deployment time to production from several months to a few weeks. It can be used by AWS teams, partners and customers to implement the foundational structure of a data lake following best practices. A data lake gives your organization agility. It provides a repository where consumers can quickly find the data they need and use it in their business projects. However, building a data lake can be complex; there's a lot to think about beyond the storage of files. For example, how do you catalog the data so you know what you've stored? What ingestion pipelines do you need? How do you manage data quality? How do you keep the code for your transformations under source control? How do you manage development, test and production environments? Building a solution that addresses these use cases can take many weeks and this time can be better spent innovating with data and achieving business goals. To learn more about SDLF, its constructs and data architectures, please visit the following pages: - Constructs - Architecture Cost You are responsible for the","default_branch":null,"files":null,"tree":[],"storefront":"/r/aws-solutions-library-samples","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/aws-solutions-library-samples/data-lakes-on-aws/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}