[NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.
active 2023-10-15 → 2024-04-29 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 198 days from 2023-10-15 to 2024-04-29. Pushes: 16 total, peak 14 in a day. Pull requests: 3 total, peak 2 in a day. Issues: 26 total, peak 7 in a day. Comments: 21 total, peak 5 in a day. Stars: 231 total, peak 29 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| SeungoneKim | 35 | 8 | 3 | 14 |
| jshin49 | 8 | 8 | 0 | 0 |
| HuihuiChyan | 4 | 0 | 0 | 2 |
| shaoyijia | 3 | 0 | 0 | 2 |
| mqo00 | 2 | 0 | 0 | 1 |
| ChiaraOleary | 2 | 0 | 0 | 0 |
| je1lee | 1 | 0 | 0 | 0 |
| agokrani | 1 | 0 | 0 | 1 |
| se-ok | 1 | 0 | 0 | 0 |
| zhao1402072392 | 1 | 0 | 0 | 0 |
| Haoxiang-Wang | 1 | 0 | 0 | 0 |
| ogencoglu | 1 | 0 | 0 | 1 |
| nnethercott | 1 | 0 | 0 | 0 |
| deshwalmahesh | 1 | 0 | 0 | 0 |
| maurovitaleBH | 1 | 0 | 0 | 0 |
| WoutDeRijck | 1 | 0 | 0 | 0 |
| sungkim11 | 1 | 0 | 0 | 0 |
| gmftbyGMFTBY | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 231 stars here means stars gained during the window, not the repo's star count.