Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
active 2023-09-03 → 2026-04-17 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 958 days from 2023-09-03 to 2026-04-17. Pushes: 8 total, peak 2 in a day. Pull requests: 12 total, peak 2 in a day. Issues: 87 total, peak 9 in a day. Comments: 70 total, peak 7 in a day. Stars: 246 total, peak 9 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| kennymckormick | 88 | 8 | 12 | 41 |
| zhimin-z | 11 | 0 | 0 | 4 |
| simplelifetime | 4 | 0 | 0 | 0 |
| ALR-alr | 4 | 0 | 0 | 3 |
| khiemkhanh98 | 3 | 0 | 0 | 1 |
| YuanLiuuuuuu | 3 | 0 | 0 | 3 |
| Purshow | 3 | 0 | 0 | 1 |
| YunfengLiu | 3 | 0 | 0 | 1 |
| Isaachhh | 2 | 0 | 0 | 1 |
| Sync-yxh | 2 | 0 | 0 | 1 |
| shuolics | 2 | 0 | 0 | 1 |
| Lin-Tianwei | 2 | 0 | 0 | 2 |
| jematy | 2 | 0 | 0 | 0 |
| SCAUapc | 2 | 0 | 0 | 0 |
| ricar0 | 2 | 0 | 0 | 0 |
| jdy18 | 2 | 0 | 0 | 0 |
| FeipengMa6 | 2 | 0 | 0 | 0 |
| Coobiw | 2 | 0 | 0 | 1 |
| liyang-7 | 2 | 0 | 0 | 0 |
| ZhuGeKongKong | 2 | 0 | 0 | 2 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#61shin-in-taek2026-04-10 05:32在MMbench关闭测评服务后，是否还能正常测评MMbench
- Issue comment#57kennymckormick2025-12-29 02:51Upload failed.
- Issue#59ifwang20012025-10-24 03:31Clarification on image quality criteria
- Issue#57jematy2025-09-30 05:40Upload failed.
- Issue#57jematy2025-09-30 00:44Upload failed.
- Issue#55ricar02025-09-24 08:24Please refresh and try again. Sorry for the inconvenience.
- Issue#56Dawn-9702025-09-17 08:36Prediction Matches Answer but Marked as Incorrect
- Issue#55ricar02025-08-11 08:30Please refresh and try again. Sorry for the inconvenience.
- Issue#53mmarzl172025-06-23 10:15评测榜单
- Issue#51gw002956522025-05-12 05:56Failed to download this dataset.
- Issue#50Blissy-322025-05-06 06:58Does MMBench have the chart class? Which category of results represents this particular capability?
- Issue#49ligeng01972025-04-18 07:38About how the overall score is calculated?
- Issue comment#47shuolics2025-02-26 11:50The recent submission logs have been showing "ChatGPT API is not working, use the exact matching policy". Is there a problem?
- Issue#48lizi1233211232025-01-25 22:46您好！评估参数设定相关。
- Issue#47shuolics2025-01-07 07:46The recent submission logs have been showing "ChatGPT API is not working, use the exact matching policy". Is there a problem?
- Issue#46insafim2024-12-27 00:33How to make prompt changes?
- Issue comment#45kennymckormick2024-12-26 13:15Test mmbenchv1.1
- Issue#43kennymckormick2024-12-26 13:09Error when Your excel file can not be successfully loaded by `pd.read_excel`, please double check and submit again
- Issue#42kennymckormick2024-12-26 13:09Math dataset
- Issue#40kennymckormick2024-12-26 13:09Not able to upload .xlsx submission file for MMBench_TEST_EN. Showing upload error.
- Issue#45ZhaoyangLi-nju2024-12-23 14:29Test mmbenchv1.1
- Issue comment#44Purshow2024-11-05 20:11无法访问https://mmbench.opencompass.org.cn/mmbench-submission
- Issue#44Purshow2024-11-05 20:11无法访问https://mmbench.opencompass.org.cn/mmbench-submission
- Issue#39kennymckormick2024-11-05 13:27mmbench-v1.1
- Issue comment#40kennymckormick2024-11-05 13:27Not able to upload .xlsx submission file for MMBench_TEST_EN. Showing upload error.
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 246 stars here means stars gained during the window, not the repo's star count.