{"repo":"petuum/autodist","free":true,"listed":false,"github":"https://github.com/petuum/autodist","clone":"git clone https://github.com/petuum/autodist.git","description":"Simple Distributed Deep Learning on TensorFlow","language":"Python","stars":136,"topics":["deep-learning","distributed-systems","machine-learning","distributed-computing","tensorflow","aws","cloud","on-premise"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Documentation Examples AutoDist is a distributed deep learning training engine for TensorFlow. AutoDist provides a user-friendly interface to distribute the training of a wide variety deep learning models across many GPUs with scalability and minimal code change. Introduction Different from specialized distributed ML systems, AutoDist is created to speed up a broad range of DL models with excellent all-round performance. AutoDist achieves this goal by: - Compilation : AutoDist expresses the parallelization of DL models as a standardized compilation process, optimizing multiple dimensions of ML parallelization including synchronization, partitioning, placement etc. - Composable architecture : AutoDist contains a flexible backend that can express various different ML parallelization techniques and allows for composing distribution strategies that blend different distributed ML system architectures. - Model and resource awareness : Based on the compilation process, AutoDist analyzes the model and generates more optimal distribution strategies that adapt to both the model properties and the cluster specification. Besides all these advanced features, AutoDist is designed to isolate the sophistication of distributed systems from ML prototyping and exposes a simple API that makes it easy to use and switch between different distributed ML techniques for users of all levels. For a closer look at the performance, please refer to our doc. Using AutoDist Installation: Modifying existing ","default_branch":null,"files":null,"tree":[],"storefront":"/r/petuum","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/petuum/autodist/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}