Reference implementations of MLPerf™ inference benchmarks
active 2025-03-09 → 2026-08-07 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 517 days from 2025-03-09 to 2026-08-07. Pushes: 851 total, peak 34 in a day. Pull requests: 186 total, peak 8 in a day. Issues: 107 total, peak 7 in a day. Comments: 516 total, peak 17 in a day. Stars: 117 total, peak 3 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| github-actions[bot] | 481 | 320 | 0 | 127 |
| arjunsuresh | 254 | 108 | 37 | 41 |
| pgmpablo157321 | 201 | 121 | 27 | 14 |
| mlcommons-bot | 164 | 164 | 0 | 0 |
| anandhu-eng | 125 | 41 | 37 | 31 |
| hanyunfan | 91 | 30 | 9 | 27 |
| wangshangsam | 74 | 0 | 8 | 46 |
| nvzhihanj | 67 | 0 | 0 | 44 |
| mrmhodak | 32 | 15 | 1 | 6 |
| viraatc | 31 | 0 | 5 | 15 |
| johncalesp | 23 | 0 | 1 | 14 |
| keithachorn-intel | 22 | 0 | 6 | 12 |
| arav-agarwal2 | 18 | 8 | 7 | 2 |
| manpreetssokhi | 15 | 7 | 3 | 5 |
| Agalakdak | 13 | 0 | 0 | 7 |
| tanvi-mlcommons | 12 | 0 | 2 | 4 |
| wu6u3tw | 11 | 0 | 4 | 4 |
| LinjianMa | 10 | 0 | 1 | 5 |
| attafosu | 9 | 0 | 1 | 6 |
| v-shobhit | 9 | 0 | 1 | 5 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#1780github-actions[bot]2026-07-24 00:31Key Error while running NVIDIA LLAMA2 70b
- Issue comment#2614github-actions[bot]2026-07-02 14:01Remove files not produced by endpoints
- Issue comment#938github-actions[bot]2026-05-16 00:40Add BERT-large details to the README
- Issue comment#1283github-actions[bot]2026-05-16 00:40Add CodeQL workflow
- Issue#1298github-actions[bot]2026-05-15 00:43Publish official prebuilt whl files for python bindinds
- Issue comment#1298github-actions[bot]2026-05-15 00:43Publish official prebuilt whl files for python bindinds
- Issue comment#1329github-actions[bot]2026-05-15 00:42Submission checker error with 3d-unet
- Issue#1332github-actions[bot]2026-05-15 00:42Latest OpenImages dataset annotations differ from those generated by previous fiftyone based script
- Issue comment#1332github-actions[bot]2026-05-15 00:42Latest OpenImages dataset annotations differ from those generated by previous fiftyone based script
- Issue comment#1334github-actions[bot]2026-05-15 00:42Update loadgen.cc
- Issue comment#1344github-actions[bot]2026-05-15 00:42DLRM Inference fails:KeyError
- Issue#1384github-actions[bot]2026-05-13 00:44GPT-J: Dataset issues
- Issue#1383github-actions[bot]2026-05-13 00:44GPT-J: missing checkpoint and confusing README
- Issue comment#2576araghun2026-05-12 22:16Power measurement proposal #1 - Nameplate Power
- Issue comment#1433github-actions[bot]2026-05-12 00:39TEST04 takes reciprocal of scores for SingleStream/MultiStream
- Issue#1433github-actions[bot]2026-05-12 00:39TEST04 takes reciprocal of scores for SingleStream/MultiStream
- Issue#1488github-actions[bot]2026-05-12 00:39Is it possible to allow resubmission from previous round?
- Issue#1494github-actions[bot]2026-05-11 00:43Offline scenario inferred from SingleStream gives incorrect power efficiency
- Issue#1492github-actions[bot]2026-05-11 00:43Is it possible to calculate the LLM performance, Token per Second ?
- Issue comment#1492github-actions[bot]2026-05-11 00:43Is it possible to calculate the LLM performance, Token per Second ?
- Issue#1502github-actions[bot]2026-05-11 00:43why onnx.load("resnet50_v1.pth") when I use pytorch backend?
- Issue comment#1502github-actions[bot]2026-05-11 00:43why onnx.load("resnet50_v1.pth") when I use pytorch backend?
- Issue#1502github-actions[bot]2026-05-11 00:43why onnx.load("resnet50_v1.pth") when I use pytorch backend?
- Issue#1510github-actions[bot]2026-05-11 00:43Request NVIDIA to make container BASE IMAGE links the publicly available links
- Issue#1520github-actions[bot]2026-05-10 00:42Open division rule on validation dataset is confusing
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 117 stars here means stars gained during the window, not the repo's star count.