Skip to content

[NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898

active 2023-12-032026-04-06 (UTC)

Partial coverage18,431 / 23,621 hourly files (78%) · 2 absent upstream · 5,188 failed, retryable2023-12-022026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
98
Pushes
1
Pull requests
3
Issues
13
Stars
60
Forks
12

Activity over time

Daily event counts in the loaded window

Line chart, 856 days from 2023-12-03 to 2026-04-06. Pushes: 1 total, peak 1 in a day. Pull requests: 3 total, peak 1 in a day. Issues: 13 total, peak 3 in a day. Comments: 9 total, peak 2 in a day. Stars: 60 total, peak 2 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
john-b-yang7113
zhiyuanc20016003
AlphaPav2002
jacob10172000
kingb121001
kmheckel1000
zhimin-z1000
hansjohn1000
caicre1000
oximi1231000
CCisWorking1000
westenfelder1010
ZiyueWang251010

Recent activity

Latest issues, pull requests and releases

  • Issue#28caicre2025-12-16 04:51
    Errors in the test dataset?
  • Issue comment#13kingb122024-12-13 19:42
    Docker image not found
  • Issue comment#23john-b-yang2024-06-27 21:24
    Why are the leaderboards empty?
  • Issue#23john-b-yang2024-06-27 21:24
    Why are the leaderboards empty?
  • Issue#23zhimin-z2024-06-01 02:58
    Why are the leaderboards empty?
  • Pull request#21john-b-yang2024-05-05 23:43
  • Issue comment#21john-b-yang2024-05-05 23:42
    Updated README.md
  • Issue comment#22john-b-yang2024-05-05 16:34
    Is this repo abandoned?
  • Issue#22john-b-yang2024-05-05 16:34
    Is this repo abandoned?
  • Issue#22kmheckel2024-05-04 19:26
    Is this repo abandoned?
  • Pull request#21westenfelder2024-04-09 02:29
  • Issue#20hansjohn2024-03-23 09:28
    Results of eval_n_turn not match the paper
  • Issue comment#16AlphaPav2024-03-16 00:54
    Sweep: fix run_demo.py which can not import PythonEnv
  • Issue comment#18AlphaPav2024-03-16 00:51
    No Python results?
  • Pull request#12ZiyueWang252024-02-25 04:27
  • Issue#15CCisWorking2024-02-04 13:00
    System Prompt for NL2Bash
  • Issue#16jacob10172024-02-04 08:07
    Sweep: fix run_demo.py which can not import PythonEnv
  • Issue#16jacob10172024-02-04 08:06
    Sweep: fix run_demo.py which can not import PythonEnv
  • Issue#13oximi1232024-01-11 11:44
    Docker image not found
  • Issue comment#11zhiyuanc20012023-12-13 01:00
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']
  • Issue#11zhiyuanc20012023-12-13 01:00
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']
  • Issue comment#11zhiyuanc20012023-12-12 07:27
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']
  • Issue#11zhiyuanc20012023-12-12 07:27
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']
  • Issue comment#11zhiyuanc20012023-12-12 03:26
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']
  • Issue#11zhiyuanc20012023-12-12 03:15
    RuntimeError: Preprocess command failed to execute successfully: ['use poker_player']

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 60 stars here means stars gained during the window, not the repo's star count.