EvalBench is a flexible framework designed to measure the quality of generative AI (GenAI) workflows around database specific tasks.
active 2025-03-24 → 2026-08-13 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 508 days from 2025-03-24 to 2026-08-13. Pushes: 590 total, peak 16 in a day. Pull requests: 163 total, peak 8 in a day. Issues: 1 total, peak 1 in a day. Comments: 143 total, peak 11 in a day. Stars: 20 total, peak 2 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| IsmailMehdi | 405 | 280 | 33 | 41 |
| mahyareb | 145 | 41 | 34 | 27 |
| jahnavi2k | 87 | 41 | 12 | 14 |
| prernakakkar-google | 77 | 57 | 7 | 2 |
| release-please[bot] | 45 | 35 | 10 | 0 |
| omkargaikwad23 | 44 | 42 | 0 | 2 |
| github-code-quality[bot] | 34 | 0 | 0 | 25 |
| dependabot[bot] | 33 | 2 | 31 | 0 |
| wangauone | 24 | 14 | 3 | 3 |
| totoleon | 21 | 13 | 4 | 2 |
| helloeve | 19 | 12 | 3 | 1 |
| graceqi-g | 18 | 12 | 0 | 6 |
| MohammadrezaPourreza | 16 | 5 | 5 | 4 |
| dvnshgupta | 15 | 7 | 4 | 2 |
| silviojr | 12 | 12 | 0 | 0 |
| erinlimbogoogle | 11 | 10 | 1 | 0 |
| saurabh-net | 10 | 6 | 2 | 2 |
| pjacobsson | 9 | 0 | 0 | 6 |
| aseering | 8 | 0 | 6 | 0 |
| georgecma | 7 | 0 | 4 | 1 |
Recent activity
Latest issues, pull requests and releases
- Pull request#521release-please[bot]2026-07-23 18:14
- Pull request#496dependabot[bot]2026-07-15 14:28
- Issue comment#473IsmailMehdi2026-07-01 21:50Make plugin installation synchronous to avoid timing issues during eval
- Issue comment#471graceqi-g2026-06-29 23:22Move teardown script into finally block
- Pull request#457minzznguyen2026-06-23 23:52
- Issue comment#450IsmailMehdi2026-06-19 17:45test(bigtable): allow instance/project override via env vars
- Issue comment#428graceqi-g2026-06-16 23:37Package DEA scenarios in one request for sequential execution
- Pull request#413release-please[bot]2026-06-11 16:15
- Issue comment#415omkargaikwad232026-06-06 17:34refactor: introduce AgentCliGenerator base to unify CLI generator handling
- Issue comment#408omkargaikwad232026-06-03 11:39feat: add AgyCliGenerator support to evaluator and models, including test suite and configuration datasets
- Issue comment#404graceqi-g2026-06-01 22:08Set up generator class and auth for Data Engineering Agent
- Pull request#406erinlimbogoogle2026-05-28 00:53
- Pull request#405helloeve2026-05-27 01:55
- Pull request#405helloeve2026-05-27 01:55
- Pull request#393dependabot[bot]2026-05-13 19:01
- Pull request#393dependabot[bot]2026-05-13 19:01
- Pull request#382dependabot[bot]2026-05-09 07:17
- Pull request#377IsmailMehdi2026-05-08 03:09
- Pull request#375dependabot[bot]2026-05-07 19:40
- Pull request#375dependabot[bot]2026-05-07 19:40
- Issue comment#365IsmailMehdi2026-05-03 19:26Verifier branch
- Issue comment#367saurabh-net2026-05-03 06:30feat: Add dbt Scorers for Agent Evaluations
- Issue comment#366saurabh-net2026-05-03 05:39feat: Add GCS Artifacts Reporter for Agent Evaluations
- Pull request#365IsmailMehdi2026-05-02 23:39
- Issue comment#363IsmailMehdi2026-05-01 00:59Verifier branch
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 20 stars here means stars gained during the window, not the repo's star count.