Skip to content

Interaction-Level Optimizations for LLM Agents on Cybench

HTML · active 2024-08-202026-05-20 (UTC)

Complete coverage26,735 / 26,735 hourly files (100%) · 2 absent upstream2023-08-152026-09-01 (UTC)
Events
1.7K
Pushes
570
Pull requests
275
Issues
20
Stars
146
Forks
74

Activity over time

Daily event counts in the loaded window

Line chart, 639 days from 2024-08-20 to 2026-05-20. Pushes: 570 total, peak 158 in a day. Pull requests: 275 total, peak 45 in a day. Issues: 20 total, peak 4 in a day. Comments: 180 total, peak 24 in a day. Stars: 146 total, peak 5 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
justinlinw3691595457
Joey-Ji3001406638
theqin015915800
riya-dulepet120563513
andyzorigin114192630
EulerPascal4043920116
eliotjones1292108
cmenders191441
arohablue13035
hyuwono130130
santiramos2711017
yiming-ni11025
BackSideAttack6030
shinyweng6060
mukobi4001
jktrn4021
oburay4031
developStorm4040
harshitgupta4123021
yejonz3210

Recent activity

Latest issues, pull requests and releases

  • Issue comment#791Joey-Ji2026-04-22 00:07
    fix: correct flag case typo in noisier-crc metadata (cRC -> cRc)
  • Issue comment#789Just-do-st2026-02-04 07:06
    Missing GlacierCTF2023_writeups challenges
  • Issue#789theqin02026-02-03 21:54
    Missing GlacierCTF2023_writeups challenges
  • Issue#789Marphownio2026-01-28 06:20
    Missing GlacierCTF2023_writeups challenges
  • Pull request#764zengxiao-he2025-09-20 23:29
  • Pull request#759developStorm2025-07-14 22:53
  • Pull request#760developStorm2025-07-14 22:53
  • Issue comment#777BradKML2025-06-12 01:53
    Request to evaluate O1 2024-12-17
  • Issue#786Expertium2025-06-11 18:37
    Include a human baseline
  • Pull request#740s6bc2025-06-01 11:03
  • Issue#785NielsRogge2025-04-15 11:10
    Release Cybench dataset on Hugging Face
  • Pull request#784DevonPeroutky2025-03-25 23:49
  • Pull request#784DevonPeroutky2025-03-25 23:49
  • Pull request#782preritchoudhary2025-03-03 04:54
  • Pull request#782preritchoudhary2025-02-28 23:32
  • Issue#781attilaszia2025-02-25 14:40
    are there any public o3 results?
  • Pull request#722shinyweng2025-02-22 00:29
  • Pull request#723shinyweng2025-02-22 00:29
  • Issue comment#780Joey-Ji2025-02-13 23:35
    Unsuccessful runs with frog-waf, [Easy] Labyrinth Linguist, and just-another-pickle-jail
  • Issue comment#780andyzorigin2025-02-13 23:01
    Unsuccessful runs with frog-waf, [Easy] Labyrinth Linguist, and just-another-pickle-jail
  • Issue#780joie-zhang2025-02-13 22:44
    Unsuccessful runs with frog-waf, [Easy] Labyrinth Linguist, and just-another-pickle-jail
  • Issue comment#779aleksoren2025-01-06 15:25
    Selecting between the 4 agent scaffolds
  • Issue comment#779andyzorigin2025-01-06 15:23
    Selecting between the 4 agent scaffolds
  • Issue#779aleksoren2025-01-06 09:24
    Selecting between the 4 agent scaffolds
  • Issue#778guapia2332024-12-28 11:41
    Missing images

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 146 stars here means stars gained during the window, not the repo's star count.