{"repo":"mlcommons/mlperf-automations","free":true,"listed":false,"github":"https://github.com/mlcommons/mlperf-automations","clone":"git clone https://github.com/mlcommons/mlperf-automations.git","description":"This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.","language":"Python","stars":13,"topics":["automation","mlcflow","mlperf","mlperf-automations","mlperf-inference"],"license":"Apache-2.0","category":"workflow-automation","readme_excerpt":"MLPerf® Automations and Scripts Welcome to the MLPerf® Automations and Scripts repository! This repository is your go-to resource for tools, automations, and scripts designed to streamline the execution of MLPerf® benchmarks —with a strong emphasis on MLPerf® Inference benchmarks . Starting January 2025 , MLPerf® automation scripts is powered by MLCFlow automation interface. This new and simplified framework replaces the previous Collective Mind (CM), providing a more robust, efficient, and self-contained solution for benchmarking workflows, making MLPerf® automations independent of any external projects. --- 🚀 Key Features - Automated Benchmarking – Simplifies running MLPerf® Inference benchmarks with minimal manual intervention. - Modular and Extensible – Easily extend the scripts to support additional benchmarks and configurations. - Seamless Integration – Compatible with Docker, cloud environments, and local machines. --- 🧰 MLCFlow (MLC) Automations Building upon the robust foundation of its predecessor, the Collective Mind (CM) framework, MLCFlow elevates machine learning workflows by simplifying complex tasks such as Docker container management and caching. Written in Python, the mlcflow package offers a versatile interface, supporting both a user-friendly command-line interface (CLI) and a flexible API for effortless automation script management. At its core, MLCFlow relies on a single powerful automation, the Script, which is extended by two actions: CacheAction and","default_branch":null,"files":null,"tree":[],"storefront":"/r/mlcommons","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mlcommons/mlperf-automations/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}