Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
active 2024-02-13 → 2024-08-05 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 175 days from 2024-02-13 to 2024-08-05. Pushes: 18 total, peak 9 in a day. Pull requests: 6 total, peak 6 in a day. Issues: 0 total, peak 0 in a day. Comments: 0 total, peak 0 in a day. Stars: 28 total, peak 11 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| Pierre-LouisBJT | 18 | 14 | 4 | 0 |
| oulianov | 6 | 4 | 2 | 0 |
Recent activity
Latest issues, pull requests and releases
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 28 stars here means stars gained during the window, not the repo's star count.