Skip to content

A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxiv.org/abs/2312.16171

active 2024-01-072026-06-06 (UTC)

Partial coverage17,689 / 22,741 hourly files (78%) · 2 absent upstream · 5,051 failed, retryable2024-01-072026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
431
Pushes
11
Pull requests
4
Issues
2
Stars
363
Forks
45

Activity over time

Daily event counts in the loaded window

Line chart, 882 days from 2024-01-07 to 2026-06-06. Pushes: 11 total, peak 6 in a day. Pull requests: 4 total, peak 2 in a day. Issues: 2 total, peak 1 in a day. Comments: 6 total, peak 2 in a day. Stars: 363 total, peak 15 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
szq021410523
SondosBsharat6600
nnWhisperer1010
Taekyo-Lee1000
Shandelier1010
taylor14771001
schrobingus1000
wemoveon21001
lduperval1001

Recent activity

Latest issues, pull requests and releases

  • Issue#11Taekyo-Lee2024-08-20 06:40
    Questions about general_dataset.json
  • Issue comment#8szq02142024-06-08 11:53
    Will there be an update to the paper for the newer GPT models like GPT-4o?
  • Issue#10schrobingus2024-06-01 20:35
    Extend the repository for self-benchmark
  • Pull request#9szq02142024-05-28 05:52
  • Issue comment#9szq02142024-05-28 05:51
    Print ready principles
  • Pull request#9Shandelier2024-05-27 20:52
  • Pull request#5szq02142024-01-21 22:08
  • Pull request#5nnWhisperer2024-01-21 20:50
  • Issue comment#3lduperval2024-01-16 01:11
    Numerous egregious issues with this paper
  • Issue comment#4taylor14772024-01-13 19:19
    Let's build better tools together 🧰
  • Issue comment#3wemoveon22024-01-11 23:58
    Numerous egregious issues with this paper
  • Issue comment#4szq02142024-01-11 22:26
    Let's build better tools together 🧰

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 363 stars here means stars gained during the window, not the repo's star count.