{"repo":"awslabs/awsome-distributed-ai","free":true,"listed":false,"github":"https://github.com/awslabs/awsome-distributed-ai","clone":"git clone https://github.com/awslabs/awsome-distributed-ai.git","description":"Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.","language":"Shell","stars":470,"topics":["aws","efa","eks","generative-ai","gpu","hyperpod","parallelcluster","distributed-training","distributed-inference","kubernetes"],"license":"MIT-0","category":"deployment-docker-iac","readme_excerpt":"ML Training Reference Architectures & Tests This repository contains reference architectures and test cases for distributed model training with Amazon SageMaker HyperPod, AWS ParallelCluster, AWS Parallel Computing Service (PCS), AWS Batch, and Amazon EKS. The test cases cover different types and sizes of models as well as different frameworks and parallel optimizations (PyTorch DDP/FSDP, Megatron-LM, NeMo...). The major components of this directory are: NOTE : The architectures are designed to work with the S3 bucket and VPC created using reference templates 1.architectures/0.common/ and 1.architectures/1.vpc network/ . You're strongly recommended to deploy these two templates before deploying any of the reference architectures. 0. Workshops You can follow the workshops below to train models on AWS. Each contains examples for several test cases as well as nuggets of information on operating a cluster for LLM training. Name Comments ---------------------------------------------------------------------------------- --------------------------------------------------------------- AI on SageMaker HyperPod Workshop for SageMaker HyperPod, shows how to deploy and monitor it AWS ParallelCluster Similar workshop as HyperPod but on ParallelCluster AWS Parallel Computing Service Similar workshop as HyperPod but on AWS Parallel Computing Service Blog Posts about distributed ML training on AWS are published at . The Hugo source lives on the content branch. Blog content is editorially cur","default_branch":null,"files":null,"tree":[],"storefront":"/r/awslabs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/awslabs/awsome-distributed-ai/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}