Skip to content

huggingface/tokenizers

View on GitHub ↗Related repositories →

💥 HF Fast State-of-the-Art Tokenizers optimized for Research and Production.

Rust · active 2023-08-15 → 2026-11-10 (UTC)

Complete coverage28,407 / 28,407 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-11-10 (UTC)
Events
8.6K
Pushes
1K
Pull requests
509
Issues
796
Stars
2.8K
Forks
433

Activity over time

Daily event counts in the loaded window

Line chart, 1184 days from 2023-08-15 to 2026-11-10. Pushes: 1,012 total, peak 31 in a day. Pull requests: 509 total, peak 13 in a day. Issues: 796 total, peak 19 in a day. Comments: 2,238 total, peak 44 in a day. Stars: 2,830 total, peak 15 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
ArthurZucker1.8K639153660
github-actions[bot]790048405
Narsil538192120131
HuggingFaceDocBuilderDev17600176
McPatate12057833
SBrandeis968761
dependabot[bot]403298
sftse290519
eaplatanios210414
Yikai-Liao200019
ngoldbaum200217
Copilot171010
MeetThePatel16029
paulinebm141400
diliop14027
bryantbiggs14027
hamirmahal13027
michaelfeil12026
shivanraptor12006
EricLBuehler12026

Recent activity

Latest issues, pull requests and releases

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 2,830 stars here means stars gained during the window, not the repo's star count.