Skip to content

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

active 2024-03-072024-08-06 (UTC)

Partial coverage17,093 / 21,808 hourly files (78%) · 2 absent upstream · 4,715 failed, retryable2024-02-152026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
24
Pushes
5
Pull requests
4
Issues
0
Stars
0
Forks
0

Activity over time

Daily event counts in the loaded window

Line chart, 153 days from 2024-03-07 to 2024-08-06. Pushes: 5 total, peak 2 in a day. Pull requests: 4 total, peak 2 in a day. Issues: 0 total, peak 0 in a day. Comments: 6 total, peak 4 in a day. Stars: 0 total, peak 0 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
EYH060214243
StupiddCupid8303

Recent activity

Latest issues, pull requests and releases

  • Pull request#3EYH06022024-08-06 21:24
  • Issue comment#3StupiddCupid2024-05-31 16:47
    Added Llama2-7b into Config
  • Issue comment#3StupiddCupid2024-05-30 19:13
    Added Llama2-7b into Config
  • Pull request#2EYH06022024-03-13 01:13
  • Pull request#1EYH06022024-03-07 00:25
  • Pull request#1EYH06022024-03-07 00:08

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 0 stars here means stars gained during the window, not the repo's star count.