{"repo":"aws-samples/emr-serverless-samples","free":true,"listed":false,"github":"https://github.com/aws-samples/emr-serverless-samples","clone":"git clone https://github.com/aws-samples/emr-serverless-samples.git","description":"Example code for running Spark and Hive jobs on EMR Serverless.","language":"Python","stars":171,"topics":["aws","emr","serverless","analytics","spark","hive","cdk","cloudformation","emr-serverless","iceberg"],"license":"MIT-0","category":"analytics","readme_excerpt":"EMR Serverless Samples This repository contains example code for getting started with EMR Serverless and using it with Apache Spark and Apache Hive. In addition, it provides Container Images for both the Spark History Server and Tez UI in order to debug your jobs. For full details about using EMR Serverless, please see the EMR Serverless documentation. Pre-Requisites These demos assume you are using an Administrator-level role in your AWS account 1. Amazon EMR Serverless is now Generally Available! Check out the console to Get Started with EMR Serverless. 2. Create an Amazon S3 bucket in region where you want to use EMR Serverless (we'll assume us-east-1 ). 3. Create an EMR Serverless execution role (replacing BUCKET-NAME with the one you created above) This role provides both S3 access for specific buckets as well as read and write access to the Glue Data Catalog. Now you're ready to go! Check out the examples below. Examples - CloudFormation Templates Sample templates for creating an EMR Serverless application as well as various dependencies. - CloudWatch Dashboard Template Template for creating a CloudWatch Dashboard for monitoring your EMR Serverless application. - CDK Examples Examples of building EMR Serverless environments with Amazon CDK. - Airflow Operator Sample DAGs and preview version of the Airflow Operator. Check the releases page for updates. - EMR Serverless PySpark job This sample script shows how to use EMR Serverless to run a PySpark job that analyzes data ","default_branch":null,"files":null,"tree":[],"storefront":"/r/aws-samples","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/aws-samples/emr-serverless-samples/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}