Skip to content

m1chae11u/Guess-the-Rule-LLM-Benchmark

View on GitHub ↗Related repositories →

A dynamically reusable benchmark designed to evaluate Large Language Models’ abstract reasoning capabilities through continuously generated “Guess the Rule” games. This repository features an automated rule generation system, customizable APIs for on-demand dataset creation, and an interactive game interface for robust and scalable LLM assessment.

active 2024-09-272025-01-10 (UTC)

Complete coverage27,073 / 27,075 hourly files (100%) · 2 absent upstream2023-08-152026-09-16 (UTC)
Events
205
Pushes
163
Pull requests
11
Issues
0
Stars
5
Forks
4

Activity over time

Daily event counts in the loaded window

Line chart, 106 days from 2024-09-27 to 2025-01-10. Pushes: 163 total, peak 32 in a day. Pull requests: 11 total, peak 3 in a day. Issues: 0 total, peak 0 in a day. Comments: 0 total, peak 0 in a day. Stars: 5 total, peak 2 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
alishazal706550
m1chae11u565510
XiangZheng2002292630
JunoLee128131120
arihantchoudhary6600

Recent activity

Latest issues, pull requests and releases

  • Pull request#5alishazal2024-12-16 15:56
  • Pull request#6XiangZheng20022024-12-15 09:44
  • Pull request#6XiangZheng20022024-12-15 09:44
  • Pull request#5JunoLee1282024-12-15 07:50
  • Pull request#4alishazal2024-12-11 07:52
  • Pull request#4alishazal2024-12-11 07:51
  • Pull request#3alishazal2024-12-04 05:53
  • Pull request#3alishazal2024-12-04 05:53
  • Pull request#2m1chae11u2024-10-24 23:41
  • Pull request#2XiangZheng20022024-10-24 23:19
  • Pull request#1JunoLee1282024-10-23 20:47

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 5 stars here means stars gained during the window, not the repo's star count.