Skip to content

MathEval is a benchmark dedicated to the holistic evaluation on mathematical capacities of LLMs.

active 2023-09-152025-07-15 (UTC)

Partial coverage20,620 / 26,303 hourly files (78%) · 2 absent upstream · 5,678 failed, retryable2023-08-152026-08-14 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
103
Pushes
29
Pull requests
0
Issues
3
Stars
50
Forks
3

Activity over time

Daily event counts in the loaded window

Line chart, 671 days from 2023-09-15 to 2025-07-21. Pushes: 29 total, peak 4 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 3 total, peak 1 in a day. Comments: 13 total, peak 3 in a day. Stars: 50 total, peak 4 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
TjoyLiu181305
fangzhensheng9900
math-eval7700
CC1st6005
zyh38263003
Qs-Tim1000
CccZss1000

Recent activity

Latest issues, pull requests and releases

  • Issue#10Qs-Tim2024-12-26 03:28
    23年和24年高考数学数据集中的难度是从哪里获取的呢
  • Issue comment#7TjoyLiu2024-09-29 10:18
    何时可以发布Gaokao 2023和2024的完整测试集
  • Issue#6CccZss2024-07-26 02:22
    Math23k 数据集用来评测的测试集是否加入了部分训练集的数据?
  • Issue comment#4zyh38262023-12-15 01:37
    关于测评如何得到最终分数的问题
  • Issue comment#4zyh38262023-12-14 01:48
    关于测评如何得到最终分数的问题
  • Issue comment#4TjoyLiu2023-12-13 06:52
    关于测评如何得到最终分数的问题
  • Issue comment#4zyh38262023-12-13 02:49
    关于测评如何得到最终分数的问题
  • Issue comment#2CC1st2023-11-24 01:59
    All evaluations completed and related processes killed.
  • Issue comment#2CC1st2023-11-24 01:58
    All evaluations completed and related processes killed.
  • Issue comment#2TjoyLiu2023-11-24 01:49
    All evaluations completed and related processes killed.
  • Issue comment#2CC1st2023-11-22 08:35
    All evaluations completed and related processes killed.
  • Issue comment#2CC1st2023-11-22 08:29
    All evaluations completed and related processes killed.
  • Issue comment#2CC1st2023-11-20 06:39
    All evaluations completed and related processes killed.
  • Issue comment#2TjoyLiu2023-11-20 04:01
    All evaluations completed and related processes killed.
  • Issue comment#2TjoyLiu2023-11-20 04:00
    All evaluations completed and related processes killed.
  • Issue#2CC1st2023-11-20 02:23
    All evaluations completed and related processes killed.

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 50 stars here means stars gained during the window, not the repo's star count.