{"repo":"ElhanM/aws-genai-lab","free":true,"listed":false,"github":"https://github.com/ElhanM/aws-genai-lab","clone":"git clone https://github.com/ElhanM/aws-genai-lab.git","description":"Deploy a powerful, self-hosted LLM on AWS using EC2 Instances. Automated \"dispose-on-demand\" IaC with Terraform. Features CPU/GPU Dual Mode for R&D on a budget. Stop paying for unused compute, rather tear it down instantly.","language":"Python","stars":13,"topics":[],"license":"GPL-3.0","category":"self-hosted-apps","readme_excerpt":"AWS GenAI Lab This repository contains Infrastructure as Code (Terraform) to spin up a powerful, self-hosted AI environment on AWS. It allows you to deploy open-source LLMs (Llama 3, Mistral, Dolphin) in a private environment. Project Goal & Architecture To create a \"dispose-on-demand\" AI lab. We use Terraform to automate the creation and destruction of infrastructure, ensuring you only pay for resources while they are in use. Security & Privacy Zero Internet Exposure: This lab is not exposed to the public internet . Secure Tunnel: All access is routed through an encrypted SSH tunnel. Private: Open WebUI runs in single-user mode (no auth required) because you are the only user with access to the tunnel. AWS Account Setup Create an IAM User Important: Do NOT use root user access keys. 1. Log into AWS Console and search for IAM . 2. Click Users - Create user . 3. Set username: terraform-deployer . 4. Select Attach policies directly . 5. Search and check: AdministratorAccess . 6. Click Next - Create user . Create Access Keys 1. Click your new user ( terraform-deployer ). 2. Go to Security credentials - Access keys - Create access key . 3. Select Command Line Interface (CLI) . 4. Check the confirmation box and click Next . 5. Click Create access key . 6. Download the CSV or copy the Access Key ID and Secret Access Key . Configure Credentials Copy the example template and fill in your values: Then open terraform.tfvars and replace the placeholder values with your credentials and d","default_branch":null,"files":null,"tree":[],"storefront":"/r/ElhanM","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ElhanM/aws-genai-lab/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}