A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
active 2024-03-20 → 2024-07-29 (UTC)
Partial coverage16,694 / 21,161 hourly files (79%) · 2 absent upstream · 4,467 failed, retryable2024-03-13 → 2026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
375
Pushes
118
Pull requests
39
Issues
14
Stars
53
Forks
9
Activity over time
Daily event counts in the loaded window
Line chart, 132 days from 2024-03-20 to 2024-07-29. Pushes: 118 total, peak 8 in a day. Pull requests: 39 total, peak 6 in a day. Issues: 14 total, peak 3 in a day. Comments: 88 total, peak 14 in a day. Stars: 53 total, peak 4 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| wangxingjun778 | 157 | 109 | 28 | 12 |
| yingdachen | 46 | 0 | 0 | 37 |
| Yunnglin | 16 | 6 | 0 | 5 |
| jackqdldd | 13 | 0 | 0 | 6 |
| slin000111 | 12 | 0 | 0 | 11 |
| liuyhwangyh | 11 | 1 | 3 | 7 |
| Chen9154 | 9 | 2 | 7 | 0 |
| meichangsu1 | 3 | 0 | 0 | 1 |
| betasspace | 3 | 0 | 0 | 2 |
| hetian127 | 3 | 0 | 0 | 2 |
| aoligei178 | 2 | 0 | 0 | 1 |
| worldPower555 | 2 | 0 | 0 | 2 |
| WSC741606 | 2 | 0 | 0 | 1 |
| linpan | 1 | 0 | 0 | 1 |
| ChunchunWang5 | 1 | 0 | 1 | 0 |
| HaltonJiang | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Releasewangxingjun7782024-07-29 05:46Release v0.4.3
- Pull request#85wangxingjun7782024-07-28 16:12
- Pull request#85wangxingjun7782024-07-26 19:16
- Issue comment#81slin0001112024-07-26 06:41OpenCompass 支持设置请求的参数模板吗，类似perf模块的--query-template
- Pull request#84Chen91542024-07-24 02:58
- Pull request#83Chen91542024-07-24 02:38
- Pull request#83Chen91542024-07-24 02:38
- Issue#81jackqdldd2024-07-22 03:10OpenCompass 支持设置请求的参数模板吗，类似perf模块的--query-template
- Issue comment#69wangxingjun7782024-07-21 19:42perf 测试不输出结果
- Issue comment#79wangxingjun7782024-07-21 19:41OpenCompass Eval-Backend 不能用自定义的数据集吗？
- Pull request#80wangxingjun7782024-07-21 19:37
- Pull request#80Chen91542024-07-17 02:18
- Pull request#74Chen91542024-07-17 02:03
- Issue comment#79linpan2024-07-15 02:48OpenCompass Eval-Backend 不能用自定义的数据集吗？
- Issue comment#76jackqdldd2024-07-13 03:33llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#76slin0001112024-07-12 10:34llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue#77jackqdldd2024-07-12 10:22llmuses 0.3.2/最新代码 本地执行自带的数据集报错：浮点数例外
- Issue#79jackqdldd2024-07-12 10:21OpenCompass Eval-Backend 不能用自定义的数据集吗？
- Issue comment#76slin0001112024-07-12 07:56llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#76jackqdldd2024-07-12 07:35llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#76slin0001112024-07-12 07:20llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#76slin0001112024-07-12 07:18llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#76jackqdldd2024-07-12 07:04llmuses 0.3.2 执行自带的数据集报错：ImportError: cannot import name '_datasets_server' from 'datasets.utils' (/data/anaconda3/envs/eval-scope/lib/python3.10/site-packages/datasets/utils/__init__.py)
- Issue comment#77jackqdldd2024-07-12 06:50llmuses 0.3.2/最新代码 本地执行自带的数据集报错：浮点数例外
- Issue#75jackqdldd2024-07-12 06:48文档中的简单示例没法执行：cannot import name 'DEFAULT_CIPHERS' from 'urllib3.util.ssl_' (/data/anaconda3/lib/python3.11/site-packages/urllib3/util/ssl_.py)
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 53 stars here means stars gained during the window, not the repo's star count.