Skip to content

huggingface/text-generation-inference

View on GitHub ↗Related repositories →

Large Language Model Text Generation Inference

active 2025-03-252026-05-15 (UTC)

Partial coverage11,290 / 12,068 hourly files (94%) · 2 absent upstream · 775 failed, retryable2025-03-252026-08-10 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
936
Pushes
82
Pull requests
82
Issues
40
Stars
442
Forks
57

Activity over time

Daily event counts in the loaded window

Line chart, 417 days from 2025-03-25 to 2026-05-15. Pushes: 82 total, peak 5 in a day. Pull requests: 82 total, peak 4 in a day. Issues: 40 total, peak 3 in a day. Comments: 137 total, peak 6 in a day. Stars: 442 total, peak 6 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
regisss69211610
sywangyi5801935
drbh271581
dacorvo231452
Narsil22763
yuanwu2017210613
danieldk171021
mht-sharma6320
MrExplode6002
tengomucho5320
MohannadEhabBarakat5005
HuggingFaceDocBuilderDev5005
alexshtf5003
jimburtoft4003
daniau234001
baughmann3002
fank3003
amadhan8823000
baptistecolle3300
Akhil-ender3001

Recent activity

Latest issues, pull requests and releases

  • Issue#3358BromigoTools2026-03-14 21:39
    Expose optional intermediate hidden states / layer logits during generation (for reasoning metrics and model introspection)
  • Issue#3357prane-eth2026-03-14 12:10
    Feature Request: Add `action_guard` Parameter for centralized validation of agent tool calls
  • Issue comment#3352julien-c2026-03-07 09:50
    docs: add AWS (EC2/SageMaker) deployment + benchmarking guide
  • Issue#3355amadhan8822026-02-09 11:57
    Performance: Replace inefficient polling in server loop with event-driven shutdown and optimize Health check
  • Pull request#3352KOKOSde2026-01-31 06:43
  • Issue comment#78niguowei442026-01-21 05:25
    ModuleNotFoundError: No module named 'generate_pb2'
  • Issue#3351StanByriukov022026-01-09 17:50
    KV-cache / long-context: smallest canonical repro boundary + metric (7-day receipts eval)
  • Issue#3350PurpleSquirrelMedia2026-01-07 23:58
    [Feature Request] MCP Server for AI-Powered Model Development
  • Pull request#3348salmanmkc2025-12-20 23:42
  • Releasedrbh2025-12-19 14:35
    v3.3.7
  • Issue comment#3344murphyslaw91882025-12-11 13:52
    Maintenance mode
  • Pull request#3341Edge-Seven2025-11-18 07:33
  • Issue#3336lingdoc2025-10-30 14:10
    Get inference endpoint model settings via client
  • Issue comment#3333danieldk2025-09-29 11:52
    How to use prefix caching
  • Pull request#3334htiennv2025-09-28 13:37
  • Issue comment#2783fank2025-09-23 03:33
    "sharded is not supported for AutoModel" Error When Deploying SageMaker Endpoint For Qwen 2.5 7B Trained via SageMaker
  • Issue comment#3247fank2025-09-22 15:55
    Load Chat Template from `chat_template.jinja`
  • Issue comment#2676fank2025-09-22 11:36
    PREFIX_CACHING=0 does not disable prefix caching in v2.3.1
  • Releasedrbh2025-09-17 00:48
    v3.3.6
  • Pull request#3329drbh2025-09-16 23:15
  • Issue comment#3296MohannadEhabBarakat2025-09-16 12:46
    tensorrt not running
  • Pull request#3326drbh2025-09-09 14:44
  • Pull request#3327julien-c2025-09-09 13:36
  • Issue comment#3327HuggingFaceDocBuilderDev2025-09-09 13:17
    Update iframe sources for streaming demo
  • Pull request#3327coyotte5082025-09-09 13:15

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 442 stars here means stars gained during the window, not the repo's star count.