Skip to content

Intelligent-CAT-Lab/CodeMind

View on GitHub ↗Related repositories →

CodeMind is a generic framework for evaluating inductive code reasoning of LLMs. It is equipped with a static analysis component that enables in-depth analysis of the results.

active 2024-03-102026-02-18 (UTC)

Partial coverage16,776 / 21,281 hourly files (79%) · 2 absent upstream · 4,504 failed, retryable2024-03-082026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
75
Pushes
47
Pull requests
4
Issues
4
Stars
15
Forks
2

Activity over time

Daily event counts in the loaded window

Line chart, 711 days from 2024-03-10 to 2026-02-18. Pushes: 47 total, peak 9 in a day. Pull requests: 4 total, peak 4 in a day. Issues: 4 total, peak 2 in a day. Comments: 1 total, peak 1 in a day. Stars: 15 total, peak 2 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
alibrahimzada202000
topgunlcs98191611
DylanZSZ141130
ALLISWELL83000

Recent activity

Latest issues, pull requests and releases

  • Issue#4topgunlcs982024-03-29 04:05
    Traceback (most recent call last): File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 175, in <module> pipeline = CodeGenerationPipeline(model, data_dir, dataset, out_dir) File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 24, in __init__ self.include_test = self.config['include_test'] KeyError: 'include_test'
  • Issue comment#4topgunlcs982024-03-29 04:05
    Traceback (most recent call last): File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 175, in <module> pipeline = CodeGenerationPipeline(model, data_dir, dataset, out_dir) File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 24, in __init__ self.include_test = self.config['include_test'] KeyError: 'include_test'
  • Issue#4ALLISWELL82024-03-17 04:17
    Traceback (most recent call last): File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 175, in <module> pipeline = CodeGenerationPipeline(model, data_dir, dataset, out_dir) File "/public/zs/CodeMind/DER/Synthesis/pipeline.py", line 24, in __init__ self.include_test = self.config['include_test'] KeyError: 'include_test'
  • Pull request#3DylanZSZ2024-03-16 19:04
  • Pull request#3DylanZSZ2024-03-16 19:04
  • Issue#2ALLISWELL82024-03-16 13:24
    File "/public/zs/code-mind/DER/Synthesis/pipeline.py", line 5, in <module> from CodeMind.DER.Synthesis.constants import Dataset, Model, PromptType,PromptBuilder ModuleNotFoundError: No module named 'CodeMind'
  • Issue#2ALLISWELL82024-03-16 12:52
    File "/public/zs/code-mind/DER/Synthesis/pipeline.py", line 5, in <module> from CodeMind.DER.Synthesis.constants import Dataset, Model, PromptType,PromptBuilder ModuleNotFoundError: No module named 'CodeMind'
  • Pull request#1topgunlcs982024-03-16 05:26
  • Pull request#1DylanZSZ2024-03-16 05:11

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 15 stars here means stars gained during the window, not the repo's star count.