Modular library to evaluate language models in the domain of code.
active 2025-03-19 → 2025-05-28 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 71 days from 2025-03-19 to 2025-05-28. Pushes: 40 total, peak 8 in a day. Pull requests: 6 total, peak 2 in a day. Issues: 24 total, peak 8 in a day. Comments: 19 total, peak 8 in a day. Stars: 1 total, peak 1 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
Recent activity
Latest issues, pull requests and releases
- Issue#38Janik77772025-05-06 10:44Tree Sitter Version Issue
- Pull request#37Janik77772025-04-18 13:17
- Issue#35Janik77772025-04-03 10:10Support different Programming languages
- Issue#34Janik77772025-04-03 10:08Support Cluster comparison metrics
- Issue#33Janik77772025-04-03 10:06Preprocessing of generated code
- Issue#32Janik77772025-04-03 10:04Cluster mapping
- Issue#31Janik77772025-04-03 10:02String clustering
- Issue#30Janik77772025-04-03 09:48Decide common python version
- Pull request#29Janik77772025-03-29 21:31
- Issue comment#28Janik77772025-03-29 14:15Problem: "BoP" expects no type argument
- Issue#28Janik77772025-03-29 14:14Problem: "BoP" expects no type argument
- Issue comment#26LeStoe112025-03-27 11:32Create API stubs for Minimal Example
- Issue#27LeStoe112025-03-27 11:25Create API Stubs for evaluation in ROME
- Issue#26LeStoe112025-03-27 11:25Create API stubs for Minimal Example
- Issue#25LeStoe112025-03-27 11:21Create Filter Annotation
- Issue#24LeStoe112025-03-27 11:21Create Join Annotation
- Issue#10LeStoe112025-03-27 10:12Create Definition of Unit of Computation
- Issue comment#10LeStoe112025-03-27 10:12Create Definition of Unit of Computation
- Issue comment#21Janik77772025-03-26 12:04Define API functions
- Issue#23Janik77772025-03-26 11:14Implement "*T" types for BoP
- Issue#22Janik77772025-03-26 11:12Implement loading datasets from private hugging face
- Issue#21Janik77772025-03-26 10:59Define API functions
- Pull request#19Janik77772025-03-26 09:18
- Issue#11LeStoe112025-03-24 18:48Discuss Bag of properties concept with Janik
- Issue#13LeStoe112025-03-24 18:40Setup environment
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.