An evaluation benchmark for LLMs and friends to compare and evolve code quality of code generation.
active 2024-03-29 → 2024-04-03 (UTC)
Complete coverage26,418 / 26,418 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-08-19 (UTC)
Events
180
Pushes
44
Pull requests
29
Issues
0
Stars
3
Forks
0
Activity over time
Daily event counts in the loaded window
Line chart, 6 days from 2024-03-29 to 2024-04-03. Pushes: 44 total, peak 26 in a day. Pull requests: 29 total, peak 15 in a day. Issues: 0 total, peak 0 in a day. Comments: 40 total, peak 23 in a day. Stars: 3 total, peak 2 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| zimmski | 104 | 21 | 22 | 32 |
| bauersimon | 45 | 23 | 7 | 8 |
Recent activity
Latest issues, pull requests and releases
- Pull request#15zimmski2024-04-03 12:59
- Pull request#14zimmski2024-04-03 12:37
- Pull request#14zimmski2024-04-03 12:37
- Pull request#13zimmski2024-04-03 12:24
- Issue comment#13zimmski2024-04-03 12:20Dynamic language name in LLM prompt
- Pull request#11zimmski2024-04-03 12:19
- Pull request#13bauersimon2024-04-03 12:08
- Issue comment#11bauersimon2024-04-03 11:48More precise CSV header and add problem count as well as excluded models
- Pull request#12zimmski2024-04-03 11:48
- Pull request#12zimmski2024-04-03 11:29
- Pull request#11bauersimon2024-04-03 11:28
- Pull request#10zimmski2024-04-03 11:10
- Pull request#10zimmski2024-04-03 11:07
- Pull request#8zimmski2024-04-03 11:00
- Issue comment#8zimmski2024-04-03 10:24Metrics for evaluation and coverage
- Pull request#6zimmski2024-04-03 09:35
- Issue comment#9bauersimon2024-04-03 09:22Ability to select repositories in CLI
- Pull request#9bauersimon2024-04-03 09:22
- Pull request#9bauersimon2024-04-03 06:53
- Pull request#8bauersimon2024-04-02 14:21
- Pull request#7bauersimon2024-04-02 12:02
- Pull request#7zimmski2024-04-02 10:30
- Pull request#6bauersimon2024-04-02 06:52
- Pull request#5zimmski2024-03-30 14:59
- Pull request#5zimmski2024-03-30 14:55
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 3 stars here means stars gained during the window, not the repo's star count.