Code for Byte Latent Transformer (BLT) research paper
active 2025-03-26 → 2026-05-26 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 427 days from 2025-03-26 to 2026-05-26. Pushes: 12 total, peak 4 in a day. Pull requests: 12 total, peak 2 in a day. Issues: 18 total, peak 2 in a day. Comments: 131 total, peak 32 in a day. Stars: 272 total, peak 36 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| EntilZha | 47 | 11 | 6 | 22 |
| werruww | 40 | 0 | 0 | 39 |
| ayttop | 36 | 0 | 0 | 35 |
| NielsRogge | 9 | 0 | 0 | 6 |
| sriniiyer | 5 | 1 | 2 | 0 |
| Zhouxx0101 | 4 | 0 | 0 | 3 |
| XiaoqiangZhou | 4 | 0 | 0 | 3 |
| meta-cla[bot] | 3 | 0 | 0 | 3 |
| twobob | 3 | 0 | 0 | 2 |
| Jingyu6 | 3 | 0 | 0 | 3 |
| itazap | 3 | 0 | 2 | 1 |
| gahdritz | 3 | 0 | 1 | 1 |
| sukjunhwang | 2 | 0 | 0 | 2 |
| gustawdaniel | 2 | 0 | 0 | 0 |
| zdxdsw | 2 | 0 | 0 | 0 |
| marksverdhei | 2 | 0 | 0 | 2 |
| lucapericlp | 1 | 0 | 0 | 1 |
| contrebande-labs | 1 | 0 | 0 | 1 |
| Yuvrajsinh040903 | 1 | 0 | 0 | 1 |
| facebook-github-bot | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue#142yuedajiong2026-05-26 00:08Great!!! And a question: What is the best tokenization-free algorihtm? SpaceByte, ByteLatentTransformer, DynamicChunking@SSM?
- Pull request#140dwipam2026-03-14 16:00
- Issue comment#139meta-cla[bot]2026-01-04 17:35Fix illegal memory access & Upgrade dependencies to CUDA 12.4
- Issue comment#131Yuvrajsinh0409032025-10-22 20:36LMTransformer.__init__() missing 1 required positional argument: 'args'
- Issue#136Cikguseven2025-10-16 08:37demo.py RuntimeError: CUDA error: an illegal memory access was encountered
- Issue comment#131marksverdhei2025-09-27 13:27LMTransformer.__init__() missing 1 required positional argument: 'args'
- Issue comment#131EntilZha2025-09-26 18:33LMTransformer.__init__() missing 1 required positional argument: 'args'
- Issue#135zdxdsw2025-09-13 15:25How to reset entropy context -- avoiding entropy "drifting"?
- Issue comment#126meta-cla[bot]2025-09-12 22:04Fix patching code
- Issue comment#127meta-cla[bot]2025-09-12 22:04Speed up model loading
- Issue#134zdxdsw2025-09-08 05:06When bpe_delim = True, do we skip BPE_ID when calculating NLL?
- Issue comment#131marksverdhei2025-07-27 21:00LMTransformer.__init__() missing 1 required positional argument: 'args'
- Issue#131gustawdaniel2025-07-03 13:53LMTransformer.__init__() missing 1 required positional argument: 'args'
- Issue#130gustawdaniel2025-07-03 12:35ModuleNotFoundError: No module named 'setuptools'
- Issue#128CharlesDDDD2025-06-29 05:44Validation Loss Stagnate on BLT Arch
- Issue comment#125itazap2025-06-16 07:56Cannot Reproduce BLT Tokenization with bpe_delim=True Due to Missing BPE Model File
- Issue comment#127gahdritz2025-06-11 03:47Speed up model loading
- Issue comment#127EntilZha2025-06-11 00:31Speed up model loading
- Pull request#126gahdritz2025-06-05 21:13
- Issue#125SathvikSat2025-06-05 18:23Cannot Reproduce BLT Tokenization with bpe_delim=True Due to Missing BPE Model File
- Issue comment#119zbdx-lcy2025-06-05 09:48Where can I find the .pt files needed for testing?
- Pull request#122itazap2025-06-03 21:15
- Issue#123gahdritz2025-06-03 14:22Patching code unsuitable for batch inference
- Issue comment#122facebook-github-bot2025-06-03 13:34consolidated model file
- Pull request#122itazap2025-06-03 13:34
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 272 stars here means stars gained during the window, not the repo's star count.