Skip to content

swe-bench/swe-bench.github.io

View on GitHub ↗Related repositories →

Landing page + leaderboard for SWE-Bench benchmark

active 2023-10-102025-02-13 (UTC)

Partial coverage20,281 / 26,021 hourly files (78%) · 2 absent upstream · 5,737 failed, retryable2023-08-242026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
84
Pushes
64
Pull requests
3
Issues
2
Stars
2
Forks
3

Activity over time

Daily event counts in the loaded window

Line chart, 493 days from 2023-10-10 to 2025-02-13. Pushes: 64 total, peak 7 in a day. Pull requests: 3 total, peak 2 in a day. Issues: 2 total, peak 1 in a day. Comments: 5 total, peak 1 in a day. Stars: 2 total, peak 1 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
john-b-yang554923
carlosejimenez151500
0xdevalias2002
rbren1010
clearfram31000

Recent activity

Latest issues, pull requests and releases

  • Issue comment#5john-b-yang2025-02-03 00:38
    Filter for base models
  • Issue#5clearfram32025-02-03 00:38
    Filter for base models
  • Pull request#3rbren2024-11-01 12:24
  • Issue comment#10xdevalias2024-06-11 00:56
    Trajs / Logs links lead to 404
  • Issue comment#10xdevalias2024-06-08 01:56
    Trajs / Logs links lead to 404
  • Issue comment#1john-b-yang2024-06-07 17:39
    Trajs / Logs links lead to 404
  • Issue#1john-b-yang2024-06-07 17:39
    Trajs / Logs links lead to 404
  • Issue comment#1john-b-yang2024-06-05 21:22
    Trajs / Logs links lead to 404
  • Pull request#2john-b-yang2024-06-05 21:21
  • Pull request#2john-b-yang2024-06-05 21:21

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 2 stars here means stars gained during the window, not the repo's star count.