{"repo":"awslabs/amazon-emr-vscode-toolkit","free":true,"listed":false,"github":"https://github.com/awslabs/amazon-emr-vscode-toolkit","clone":"git clone https://github.com/awslabs/amazon-emr-vscode-toolkit.git","description":"A VS Code Extension to make it easier to manage and develop Spark jobs on EMR","language":"TypeScript","stars":39,"topics":["amazon-emr","apache-spark","pyspark","python"],"license":"Apache-2.0","category":"deployment-docker-iac","readme_excerpt":"Amazon EMR Toolkit for VS Code (Developer Preview) EMR Toolkit is a VS Code Extension to make it easier to develop Spark jobs on EMR. Requirements - A local AWS profile - Access to the AWS API to list EMR and Glue resources - Docker (if you want to use the devcontainer) Features - Amazon EMR Explorer - Glue Data Catalog Explorer - EMR Development Container - Spark shell support - Jupyter Notebook support - EMR Serverless Deployment Amazon EMR Explorer The Amazon EMR Explorer allows you to browse job runs and steps across EMR on EC2, EMR on EKS, and EMR Serverless. To see the Explorer, choose the EMR icon in the Activity bar. Note : If you do not have default AWS credentials or AWS PROFILE environment variable, use the EMR: Select AWS Profile command to select your profile. Glue Catalog Explorer The Glue Catalog Explorer displays databases and tables in the Glue Data Catalog. By right-clicking on a table, you can select View Glue Table that will show the table columns. PySpark EMR Development Container The toolkit provides an EMR: Create local Spark environment command that creates a development container based off of an EMR on EKS image for the EMR version you choose. This container can be used to develop Spark and PySpark code locally that is fully compatible with your remote EMR environment. You choose a region and EMR version you want to use, and the extension creates the relevant Dockerfile and devcontainer.json . Once the container is created, follow the instructions in ","default_branch":null,"files":null,"tree":[],"storefront":"/r/awslabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/awslabs/amazon-emr-vscode-toolkit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}