cTuning & MLCommons Collective Knowledge Challenges

[ Back ]

Reproduce MLPerf training v3.0 benchmarks

Open date: 2023 May 1

Closing date: 2023 May 19

Challenge

Prepare, optimize and reproduce MLPerf training v3.0 benchmarks using the MLCommons CM (CK2) automation framework

Status

We could not do a successful submission mainly because the training scripts were not converging on a single GPU. We tried resnet and bert training. The below CM scripts are added to do MLPerf training for BERT using the reference and NVIDIA implementations.

  1. BERT Training using Nvidia code
  2. BERT Training using MLPerf Reference code

Organizers

Self link