Skip to content

Evaluate the accuracy of LLM generated outputs

active 2023-10-052026-05-23 (UTC)

Partial coverage19,414 / 25,018 hourly files (78%) · 2 absent upstream · 5,601 failed, retryable2023-10-052026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
1.6K
Pushes
301
Pull requests
219
Issues
10
Stars
353
Forks
34

Activity over time

Daily event counts in the loaded window

Line chart, 962 days from 2023-10-05 to 2026-05-23. Pushes: 301 total, peak 16 in a day. Pull requests: 219 total, peak 9 in a day. Issues: 10 total, peak 2 in a day. Comments: 204 total, peak 16 in a day. Stars: 353 total, peak 14 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
rishsriv43816710172
wongjingping310836772
wendy-aw183464647
Muhammad185577510
vincenting5013
cfahlgren15013
cometyang3002
shravankshenoy2010
wangcong6072002
prayagkb1001
minjunp1000
a3huang1000
NourOM021010
theskcd1001
csmileykc1000
rohangavankar1000
njhouse3651000
exceedzhang1001

Recent activity

Latest issues, pull requests and releases

  • Pull request#241rishsriv2025-08-14 15:55
  • Pull request#241rishsriv2025-08-14 15:54
  • Pull request#237rishsriv2025-02-02 15:48
  • Pull request#237rishsriv2025-02-02 15:28
  • Pull request#236rishsriv2025-01-31 20:16
  • Pull request#236NourOM022025-01-31 20:04
  • Pull request#235rishsriv2025-01-30 08:47
  • Issue comment#232theskcd2025-01-29 23:52
    Agent farm submission: defog-ai_sql-eval_230
  • Issue comment#226rishsriv2025-01-22 02:12
    Thoughts on having a Public Leaderboard?
  • Pull request#224rishsriv2024-12-13 06:14
  • Pull request#224wongjingping2024-12-13 05:56
  • Pull request#222wongjingping2024-11-01 10:06
  • Issue comment#222wongjingping2024-11-01 08:24
    VLLM Compatibility Update
  • Pull request#222wongjingping2024-11-01 04:48
  • Pull request#220rishsriv2024-09-18 02:09
  • Issue comment#219wongjingping2024-09-13 03:25
    Update openai runners
  • Issue comment#219wongjingping2024-09-13 02:31
    Update openai runners
  • Pull request#219wongjingping2024-09-13 02:22
  • Pull request#218shravankshenoy2024-09-11 03:57
  • Issue comment#217wongjingping2024-09-10 02:13
    Jupyter Notebook walkthrough of sql-eval with sqlite
  • Issue#217shravankshenoy2024-09-07 07:19
    Jupyter Notebook walkthrough of sql-eval with sqlite
  • Issue comment#216rishsriv2024-08-30 07:24
    Clean up cot_instructions placeholder
  • Issue comment#216wendy-aw2024-08-30 07:05
    Clean up cot_instructions placeholder
  • Issue comment#216rishsriv2024-08-30 07:04
    Clean up cot_instructions placeholder
  • Issue comment#216wendy-aw2024-08-30 07:01
    Clean up cot_instructions placeholder

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 353 stars here means stars gained during the window, not the repo's star count.