llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more.
active 2024-03-05 → 2025-11-23 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 629 days from 2024-03-05 to 2025-11-23. Pushes: 114 total, peak 6 in a day. Pull requests: 201 total, peak 13 in a day. Issues: 48 total, peak 6 in a day. Comments: 74 total, peak 11 in a day. Stars: 83 total, peak 11 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| SeanHH86 | 282 | 80 | 87 | 26 |
| depenglee1707 | 200 | 24 | 96 | 37 |
| jasonhe258 | 39 | 10 | 17 | 11 |
| wanggxa | 1 | 0 | 1 | 0 |
| KinglyWayne | 1 | 0 | 0 | 0 |
| njhouse365 | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Pull request#142SeanHH862024-05-17 07:12
- Pull request#143SeanHH862024-05-17 07:11
- Pull request#143depenglee17072024-05-17 06:16
- Pull request#142depenglee17072024-05-15 01:50
- Pull request#138depenglee17072024-05-14 02:44
- Pull request#141SeanHH862024-05-14 02:41
- Pull request#141depenglee17072024-05-14 02:36
- Pull request#140SeanHH862024-05-14 02:25
- Pull request#140depenglee17072024-05-14 02:21
- Pull request#139SeanHH862024-05-14 01:45
- Pull request#139depenglee17072024-05-14 01:37
- Issue comment#137SeanHH862024-05-10 03:53Api server blocked when one request is in-process
- Pull request#138SeanHH862024-05-09 14:59
- Issue#137SeanHH862024-05-09 01:36Api server blocked when one request is in-process
- Pull request#136depenglee17072024-05-08 09:07
- Pull request#136SeanHH862024-05-08 09:01
- Pull request#135depenglee17072024-05-08 03:36
- Issue#134depenglee17072024-05-08 03:36Api server was blocked when LLM deployment scaling config beyond the cluster resouces
- Pull request#135SeanHH862024-05-08 03:27
- Issue#134SeanHH862024-05-08 02:32Api server was blocked when LLM deployment scaling config beyond the cluster resouces
- Issue comment#132SeanHH862024-05-08 01:00Auto load models from ./models for when api server start
- Issue#132SeanHH862024-05-08 01:00Auto load models from ./models for when api server start
- Pull request#133depenglee17072024-05-08 00:27
- Issue comment#52SeanHH862024-05-07 07:06Enhance inference API to support OpenAI style
- Issue#52SeanHH862024-05-07 07:06Enhance inference API to support OpenAI style
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 83 stars here means stars gained during the window, not the repo's star count.