Skip to content

MLPerf Client 1.0.0

Choose a tag to compare

View all tags
@mrxmartino mrxmartino released this 30 Jul 14:58
· 23 commits to main since this release
v1.0
8919cfe

Features in MLPerf Client v1.0:

An expanded selection of large language models supported now including:

  • Llama 2 7B Chat
  • Llama 3.1 8B Instruct
  • Phi 3.5 Mini Instruct
  • Phi 4 Reasoning 14B (as an experimental model)

New prompt categories

  • Code analysis prompts
  • Longer 4k and 8k text summarization prompts (as an experimental addition)

Updated hardware support now includes

  • AMD NPU and GPU hybrid support via ONNX Runtime GenAI Ryzen AI path
  • Intel NPU and GPU support via OpenVINO
  • Intel NPUs and GPUs support via Microsoft Windows ML via the OpenVINO execution provider (as an experimental path)
  • NVIDIA GPU support via Llama.cpp-CUDA (as an experimental path)
  • Qualcomm NPU and CPU hybrid support via QNN
  • Apple Mac support via MLX
  • Apple Mac support via Llama.cpp-Metal (as an experimental path)
  • AMD, Intel, and NVIDIA GPU support via ONNX Runtime GenAI-DirectML

Updated operating system support

  • Microsoft Windows x64
  • Microsoft Windows on Arm
  • Apple macOS

Other features

  • A CLI-driven version of the benchmark for easy scripting and automation
  • A new, Beta GUI-driven version of the benchmark for all supported platforms with the following features:
    • Easy selection and running of multiple models and configs in sequence
    • Real-time readouts of compute and memory utilization as the benchmark tests run
    • Results history with comparison tables across selected result sets
    • Results exports in CSV format
Assets 8
Loading