Skip to content

Benchmark for LLM Reasoning & Understanding with Challenging Tasks from Real Users.

active 2024-08-082024-10-03 (UTC)

Complete coverage26,421 / 26,421 hourly files (100%) · 2 absent upstream2023-08-152026-08-19 (UTC)
Events
166
Pushes
38
Pull requests
5
Issues
4
Stars
97
Forks
7

Activity over time

Daily event counts in the loaded window

Line chart, 57 days from 2024-08-08 to 2024-10-03. Pushes: 38 total, peak 22 in a day. Pull requests: 5 total, peak 2 in a day. Issues: 4 total, peak 2 in a day. Comments: 12 total, peak 4 in a day. Stars: 97 total, peak 41 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
mazzzystar473827
siftxxx4002
iamsk4022
ax7e2001
jerryioo1010
waleyGithub1000

Recent activity

Latest issues, pull requests and releases

  • Pull request#6mazzzystar2024-09-14 04:20
  • Pull request#6jerryioo2024-09-14 04:01
  • Issue comment#5iamsk2024-08-23 10:13
    Using LLMs as players to test which model asks the right questions.
  • Issue comment#5mazzzystar2024-08-23 09:50
    Using LLMs as players to test which model asks the right questions.
  • Issue comment#5iamsk2024-08-23 08:15
    Using LLMs as players to test which model asks the right questions.
  • Issue comment#5mazzzystar2024-08-23 07:29
    Using LLMs as players to test which model asks the right questions.
  • Pull request#5iamsk2024-08-23 02:26
  • Issue comment#4mazzzystar2024-08-22 14:02
    Cot prompts
  • Issue comment#4ax7e2024-08-22 11:41
    Cot prompts
  • Issue#4ax7e2024-08-22 10:03
    Cot prompts
  • Issue comment#3mazzzystar2024-08-22 08:01
    make it works and formatting the code.
  • Pull request#3mazzzystar2024-08-22 08:01
  • Pull request#3iamsk2024-08-22 07:58
  • Issue comment#1mazzzystar2024-08-12 12:43
    chinese复现失败,差5个点以上
  • Issue comment#2mazzzystar2024-08-12 12:37
    another implementation method
  • Issue#2waleyGithub2024-08-12 09:38
    another implementation method
  • Issue comment#1siftxxx2024-08-12 05:32
    chinese复现失败,差5个点以上
  • Issue#1siftxxx2024-08-12 05:32
    chinese复现失败,差5个点以上
  • Issue comment#1siftxxx2024-08-12 04:07
    chinese复现失败,差5个点以上
  • Issue comment#1mazzzystar2024-08-10 10:25
    chinese复现失败,差5个点以上
  • Issue#1siftxxx2024-08-10 07:21
    chinese复现失败,差10个点~

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 97 stars here means stars gained during the window, not the repo's star count.