Skip to content

testthat-style LLM evaluation for R

active 2024-12-062025-02-02 (UTC)

Complete coverage26,626 / 26,626 hourly files (100%) · 2 absent upstream2023-08-152026-08-28 (UTC)
Events
86
Pushes
51
Pull requests
3
Issues
12
Stars
8
Forks
0

Activity over time

Daily event counts in the loaded window

Line chart, 59 days from 2024-12-06 to 2025-02-02. Pushes: 51 total, peak 20 in a day. Pull requests: 3 total, peak 2 in a day. Issues: 12 total, peak 5 in a day. Comments: 6 total, peak 4 in a day. Stars: 8 total, peak 1 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
simonpcouch603936
github-actions[bot]121200

Recent activity

Latest issues, pull requests and releases

  • Issue#32simonpcouch2025-01-29 21:45
    `expect_r_code()` can be much simpler
  • Pull request#33simonpcouch2025-01-29 15:56
  • Issue comment#31simonpcouch2025-01-15 17:38
    helper to write/extend evals
  • Issue comment#31simonpcouch2025-01-15 16:42
    helper to write/extend evals
  • Issue#31simonpcouch2025-01-15 16:35
    helper to write/extend evals
  • Issue#30simonpcouch2025-01-15 15:59
    simplify user-facing function interface
  • Issue#30simonpcouch2025-01-15 15:04
    simplify user-facing function interface
  • Issue#27simonpcouch2025-01-15 15:02
    `EvalProgressReporter` doesn't refresh status bar for repeats without `evaluating()`
  • Issue#8simonpcouch2025-01-14 22:25
    `evaluate()` across prompts / models / etc
  • Pull request#29simonpcouch2025-01-14 22:04
  • Pull request#29simonpcouch2025-01-14 21:26
  • Issue comment#8simonpcouch2024-12-12 16:36
    `evaluate()` across prompts / models / etc
  • Issue comment#10simonpcouch2024-12-12 16:35
    consider `.last_result`
  • Issue#10simonpcouch2024-12-12 16:35
    consider `.last_result`
  • Issue#28simonpcouch2024-12-12 16:35
    allow users to disable writing to file
  • Issue comment#26simonpcouch2024-12-12 16:33
    enable returning results directly
  • Issue#26simonpcouch2024-12-12 16:33
    enable returning results directly
  • Issue comment#6simonpcouch2024-12-12 16:33
    don't always reference `results_read()`
  • Issue#6simonpcouch2024-12-12 16:33
    don't always reference `results_read()`
  • Issue#27simonpcouch2024-12-12 15:19
    `EvalProgressReporter` doesn't refresh status bar for repeats without `evaluating()`
  • Issue#26simonpcouch2024-12-10 18:06
    enable returning results directly

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 8 stars here means stars gained during the window, not the repo's star count.