awslabs/awsome-distributed-training

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.