cTuning & MLCommons Collective Knowledge Challenges

[ Back ]

---

Add MLCommons CM workflows and unifed interface to automate MLPerf inference v3.1 and v4.0 benchmarks (Intel, Nvidia, Qualcomm, Arm64, TPU ...)

Open date: 2023 Dec 15

Closing date: 2024 Mar 15

Shared experiments:

• [mlperf-inference,v3.1](?action=experiments&tags=mlperf-inference%2Cv3.1)
• [mlperf-inference,v4.0](?action=experiments&tags=mlperf-inference%2Cv4.0)

---

20240220: * A prototype of a GUI to generate CM commands to run MLPerf inference benchmarks is ready: link * A prototype of the infrastructure to reproduce MLPerf inference benchmark results is ready: link * On-going efforts: https://github.com/mlcommons/ck/issues/1052

---

Self link