Repositories list

• inference

  Public
  Reference implementations of MLPerf™ inference benchmarks

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •564•1.4k•224•20•Updated Jul 18, 2025Jul 18, 2025

• modelbench

  Public
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.

  Python

  •

  Apache License 2.0

  •23•97•369•4•Updated Jul 18, 2025Jul 18, 2025

• modelplane

  Public
  Python

  •

  Apache License 2.0

  •0•0•15•0•Updated Jul 18, 2025Jul 18, 2025

• inference_policies

  Public
  Issues related to MLPerf™ Inference policies, including rules and suggested changes

  Apache License 2.0

  •55•63•19•5•Updated Jul 18, 2025Jul 18, 2025

• tiny

  Public
  MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers

  C

  •

  Apache License 2.0

  •101•419•14•7•Updated Jul 18, 2025Jul 18, 2025

• inference_results_visualization_template

  Public template
  JavaScript

  •

  Apache License 2.0

  •8•0•1•1•Updated Jul 18, 2025Jul 18, 2025

• mlperf_inference_test_submissions_v5.0

  Public
  Mermaid

  •5•0•0•0•Updated Jul 18, 2025Jul 18, 2025

• mlperf-automations

  Public
  This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.

  automationmlperfmlperf-inference+ 2mlcflowmlperf-automations

  Python

  •

  Apache License 2.0

  •14•5•71•3•Updated Jul 18, 2025Jul 18, 2025

• storage

  Public
  MLPerf™ Storage Benchmark Suite

  performancestoragebenchmark+ 1machine-learning

  Python

  •

  Apache License 2.0

  •48•156•21•0•Updated Jul 18, 2025Jul 18, 2025

• logging

  Public
  MLPerf™ logging library

  Python

  •

  Apache License 2.0

  •49•37•42•3•Updated Jul 17, 2025Jul 17, 2025

• policies

  Public
  General policies for MLPerf™ including submission rules, coding standards, etc.

  Python

  •

  Apache License 2.0

  •61•29•36•44•Updated Jul 17, 2025Jul 17, 2025

• inference_results_v5.0

  Public
  This repository contains the results and code for the MLPerf™ Inference v5.0 benchmark.

  benchmarkingbenchmarkmachine-learning

  HTML

  •8•5•3•1•Updated Jul 17, 2025Jul 17, 2025

• mlperf_inference_submissions

  Public template
  Shell

  •7•0•0•0•Updated Jul 17, 2025Jul 17, 2025

• algorithmic-efficiency

  Public
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.

  Python

  •

  Apache License 2.0

  •72•389•28•5•Updated Jul 17, 2025Jul 17, 2025

• training_policies

  Public
  Issues related to MLPerf™ training policies, including rules and suggested changes

  Python

  •

  Apache License 2.0

  •67•95•110•1•Updated Jul 17, 2025Jul 17, 2025

• mobile_app_open

  Public
  Mobile App Open

  C++

  •

  Apache License 2.0

  •28•58•39•2•Updated Jul 17, 2025Jul 17, 2025

• croissant

  Public
  Croissant is a high-level format for machine learning datasets that brings together four rich layers.

  machine-learningschema-orgjson-ld+ 1datasets

  Jupyter Notebook

  •

  Apache License 2.0

  •73•673•155•29•Updated Jul 15, 2025Jul 15, 2025

• training

  Public
  Reference implementations of MLPerf™ training benchmarks

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •573•1.7k•7•44•Updated Jul 15, 2025Jul 15, 2025

• mlcflow

  Public
  MLCFlow: Simplifying MLPerf Automations

  automation-frameworkmlperfmlcflow+ 1mlperf-automations

  Python

  •

  Apache License 2.0

  •10•5•12•1•Updated Jul 15, 2025Jul 15, 2025

• dynabench

  Public
  Python

  •

  MIT License

  •17•22•10•5•Updated Jul 15, 2025Jul 15, 2025

• mlperf_automotive

  Public
  Python

  •

  Apache License 2.0

  •5•3•2•0•Updated Jul 14, 2025Jul 14, 2025

• common-crawl-dmlr

  Public
  Rust

  •

  Apache License 2.0

  •0•0•0•0•Updated Jul 12, 2025Jul 12, 2025

• r2-downloader

  Public
  Cloudflare Access + R2 Object Storage Dataset Download Script

  cloudflarecloudflare-accesscloudflare-r2

  Shell

  •

  Apache License 2.0

  •1•0•0•0•Updated Jul 9, 2025Jul 9, 2025

• GaNDLF

  Public
  A generalizable application framework for segmentation, regression, and classification using PyTorch

  machine-learningframeworkdeep-learning+ 10regressionpytorchmedical-imagingclassificationsegmentationdata-augmentationbiomedical-image-processing+ 3

  Python

  •

  Apache License 2.0

  •88•179•7•1•Updated Jul 8, 2025Jul 8, 2025

• medperf

  Public
  An open benchmarking platform for medical artificial intelligence using Federated Evaluation.

  Python

  •

  Apache License 2.0

  •36•162•53•19•Updated Jul 7, 2025Jul 7, 2025

• inference_results_v3.1

  Public archive
  This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.

  C++

  •

  Apache License 2.0

  •13•11•9•2•Updated Jul 1, 2025Jul 1, 2025

• inference_results_v3.0

  Public archive
  This repository contains the results and code for the MLPerf™ Inference v3.0 benchmark.

  C++

  •

  Apache License 2.0

  •15•19•11•3•Updated Jul 1, 2025Jul 1, 2025

• inference_results_v4.0

  Public archive
  This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.

  C++

  •

  Apache License 2.0

  •17•10•5•5•Updated Jul 1, 2025Jul 1, 2025

• inference_results_v4.1

  Public archive
  This repository contains the results and code for the MLPerf™ Inference v4.1 benchmark.

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •2•0•10•0•Updated Jul 1, 2025Jul 1, 2025

• inference_results_v2.1

  Public archive
  This repository contains the results and code for the MLPerf™ Inference v2.1 benchmark.

  Python

  •

  Apache License 2.0

  •23•18•5•3•Updated Jul 1, 2025Jul 1, 2025