Skip to content

OpenEval: Benchmarking Programming Agents for Open-Domain Tasks

active 2024-04-122024-05-08 (UTC)

Partial coverage16,646 / 21,075 hourly files (79%) · 2 absent upstream · 4,428 failed, retryable2024-03-172026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
138
Pushes
72
Pull requests
24
Issues
7
Stars
9
Forks
8

Activity over time

Daily event counts in the loaded window

Line chart, 27 days from 2024-04-12 to 2024-05-08. Pushes: 72 total, peak 22 in a day. Pull requests: 24 total, peak 4 in a day. Issues: 7 total, peak 5 in a day. Comments: 12 total, peak 4 in a day. Stars: 9 total, peak 2 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
terryyz917245
hvdthong6060
huhanGitHub6060
imamnurby5013
ratnadiraw4013
vumichien3030
2019ChenGong3021
prateeky28061010

Recent activity

Latest issues, pull requests and releases

  • Issue comment#37ratnadiraw2024-05-08 04:16
    ratna: annotation results from first half of zhihan data
  • Issue comment#37ratnadiraw2024-05-08 03:11
    ratna: annotation results from first half of zhihan data
  • Issue comment#37imamnurby2024-05-08 03:08
    ratna: annotation results from first half of zhihan data
  • Issue comment#37ratnadiraw2024-05-08 03:00
    ratna: annotation results from first half of zhihan data
  • Pull request#32hvdthong2024-05-08 01:39
  • Pull request#332019ChenGong2024-05-07 01:02
  • Pull request#32hvdthong2024-05-06 02:21
  • Pull request#29hvdthong2024-05-06 00:44
  • Pull request#30hvdthong2024-05-06 00:44
  • Pull request#31terryyz2024-05-05 13:28
  • Pull request#31huhanGitHub2024-05-04 16:12
  • Issue comment#29terryyz2024-05-03 07:24
    Bigcode james
  • Pull request#30hvdthong2024-05-03 04:39
  • Pull request#29hvdthong2024-05-03 04:30
  • Issue comment#24terryyz2024-05-02 22:45
    add simons refined samples
  • Pull request#27terryyz2024-04-28 15:31
  • Pull request#27huhanGitHub2024-04-28 07:01
  • Pull request#26huhanGitHub2024-04-27 13:17
  • Pull request#25vumichien2024-04-25 02:17
  • Issue comment#18terryyz2024-04-21 15:39
    Remove unused library in docstring
  • Pull request#18vumichien2024-04-21 15:00
  • Pull request#17terryyz2024-04-21 10:23
  • Issue comment#17terryyz2024-04-21 10:23
    Improve script from wending annotator
  • Pull request#17vumichien2024-04-21 01:31
  • Pull request#16terryyz2024-04-20 14:46

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 9 stars here means stars gained during the window, not the repo's star count.