Skip to content

LLM4SoftwareTesting/TestEval

View on GitHub ↗Related repositories →

active 2024-06-052026-04-14 (UTC)

Complete coverage26,346 / 26,346 hourly files (100%) · 2 absent upstream2023-08-152026-08-16 (UTC)
Events
159
Pushes
84
Pull requests
6
Issues
18
Stars
30
Forks
8

Activity over time

Daily event counts in the loaded window

Line chart, 679 days from 2024-06-05 to 2026-04-14. Pushes: 84 total, peak 27 in a day. Pull requests: 6 total, peak 3 in a day. Issues: 18 total, peak 4 in a day. Comments: 9 total, peak 3 in a day. Stars: 30 total, peak 2 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
jacobwwh988426
strongcc6001
yeomjy2001
kjain142020
floralan2010
HaomiaoPan2000
eecshope1000
IsaacJu-debug1000
t-mockbel1001
godlikehhd1000

Recent activity

Latest issues, pull requests and releases

  • Pull request#13floralan2025-05-13 04:53
  • Issue#14floralan2025-05-13 04:51
    Issues with the `remove_extra` function in the `format.py`
  • Pull request#13floralan2025-05-12 05:13
  • Issue#12IsaacJu-debug2025-04-25 18:27
    Missing Assertion Correctness Implementation in Evaluation Pipeline
  • Issue comment#11yeomjy2024-11-06 09:05
    Problems in reproducing the results in the leaderboard
  • Issue comment#11t-mockbel2024-11-06 08:57
    Problems in reproducing the results in the leaderboard
  • Issue#11yeomjy2024-10-29 08:31
    Problems in reproducing the results in the leaderboard
  • Issue#10eecshope2024-10-22 07:26
    requirements.txt: textwrap is not found in any distribution for python 3.10. Do you mean textwrap3?
  • Issue comment#9jacobwwh2024-10-16 14:50
    ImportError: cannot import name 'remove_examples' from 'data_utils'
  • Issue#9jacobwwh2024-10-16 14:50
    ImportError: cannot import name 'remove_examples' from 'data_utils'
  • Issue#9strongcc2024-10-16 07:24
    ImportError: cannot import name 'remove_examples' from 'data_utils'
  • Issue#8strongcc2024-10-16 06:59
    cp: cannot stat '.coveragerc': No such file or directory
  • Issue#8strongcc2024-10-16 06:59
    cp: cannot stat '.coveragerc': No such file or directory
  • Issue#7jacobwwh2024-10-15 03:58
    NameError: name 'desc_noeg' is not defined
  • Issue comment#7strongcc2024-10-15 02:33
    NameError: name 'desc_noeg' is not defined
  • Issue comment#7jacobwwh2024-10-15 02:32
    NameError: name 'desc_noeg' is not defined
  • Issue#7strongcc2024-10-15 02:28
    NameError: name 'desc_noeg' is not defined
  • Issue comment#6jacobwwh2024-10-15 02:27
    FileNotFoundError: [Errno 2] No such file or directory: 'prompt/system_exec.txt'
  • Issue#6jacobwwh2024-10-15 02:27
    FileNotFoundError: [Errno 2] No such file or directory: 'prompt/system_exec.txt'
  • Issue#6strongcc2024-10-15 02:22
    FileNotFoundError: [Errno 2] No such file or directory: 'prompt/system_exec.txt'
  • Pull request#4jacobwwh2024-07-25 03:49
  • Pull request#5jacobwwh2024-07-24 22:30
  • Pull request#5kjain142024-07-24 14:07
  • Pull request#4kjain142024-07-24 13:55
  • Issue comment#3jacobwwh2024-07-21 04:52
    Prompt template for deepseek-ai/deepseek-coder-1.3b-instruct

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 30 stars here means stars gained during the window, not the repo's star count.