Skip to content

SWE-bench/experiments

View on GitHub ↗Related repositories →

Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.

Shell · active 2025-02-25 → 2026-10-06 (UTC)

Complete coverage27,770 / 27,770 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-10-15 (UTC)
Events
1K
Pushes
159
Pull requests
209
Issues
53
Stars
52
Forks
102

Activity over time

Daily event counts in the loaded window

Line chart, 589 days from 2025-02-25 to 2026-10-06. Pushes: 159 total, peak 14 in a day. Pull requests: 209 total, peak 11 in a day. Issues: 53 total, peak 7 in a day. Comments: 404 total, peak 26 in a day. Stars: 52 total, peak 3 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
john-b-yang41512488184
ofirpress532739
klieret482939
zhimin-z240013
willfleury9026
xingyaoww9044
bytedance-se-research9054
dcloud3478043
THY-AI7025
lugeng7025
aorwall6051
brokespace6033
m990m15005
OctoJax5014
UbeCc5014
crhf5032
chao-peng5005
tangken3335014
cmsflash5023
atinylittleshell4013

Recent activity

Latest issues, pull requests and releases

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 52 stars here means stars gained during the window, not the repo's star count.