We propose a new neural network architecture, ModuleFormer, that leverages modularity to improve the efficiency and flexibility of large language models.
active 2023-08-24 → 2025-09-13 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 752 days from 2023-08-24 to 2025-09-13. Pushes: 10 total, peak 3 in a day. Pull requests: 7 total, peak 4 in a day. Issues: 8 total, peak 2 in a day. Comments: 20 total, peak 6 in a day. Stars: 170 total, peak 49 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| yikangshen | 27 | 10 | 6 | 10 |
| YixinSong-e | 9 | 0 | 0 | 5 |
| LuciferianInk | 5 | 0 | 1 | 3 |
| flozi00 | 3 | 0 | 0 | 2 |
| zjwang21 | 1 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Pull request#8yikangshen2024-01-02 22:54
- Issue comment#8yikangshen2024-01-02 22:54Implement transformers activation functions
- Pull request#8LuciferianInk2024-01-02 10:46
- Issue comment#6yikangshen2023-11-21 20:01torch.dtype is not respected
- Issue comment#6LuciferianInk2023-11-19 04:26torch.dtype is not respected
- Issue comment#6LuciferianInk2023-11-17 19:31torch.dtype is not respected
- Issue comment#6LuciferianInk2023-11-17 19:21torch.dtype is not respected
- Issue comment#6yikangshen2023-11-17 18:06torch.dtype is not respected
- Issue#6LuciferianInk2023-11-17 05:53torch.dtype is not respected
- Issue#4yikangshen2023-11-16 22:17Context length
- Issue comment#5yikangshen2023-11-16 22:16the affects of cumulativing aux loss steps
- Issue#5zjwang212023-11-14 03:29the affects of cumulativing aux loss steps
- Issue#2YixinSong-e2023-09-26 10:33Do we have plans for 30B or larger models?
- Issue comment#2yikangshen2023-09-23 05:13Do we have plans for 30B or larger models?
- Issue comment#2flozi002023-09-21 15:29Do we have plans for 30B or larger models?
- Issue comment#4yikangshen2023-09-20 20:57Context length
- Issue comment#4flozi002023-09-19 15:31Context length
- Issue comment#4yikangshen2023-09-19 15:25Context length
- Issue#4flozi002023-09-19 13:55Context length
- Issue comment#2YixinSong-e2023-09-19 01:21Do we have plans for 30B or larger models?
- Issue comment#2yikangshen2023-09-18 21:24Do we have plans for 30B or larger models?
- Pull request#3yikangshen2023-09-18 21:20
- Issue comment#2yikangshen2023-09-15 15:01Do we have plans for 30B or larger models?
- Issue comment#2YixinSong-e2023-09-15 05:57Do we have plans for 30B or larger models?
- Issue#2YixinSong-e2023-09-15 05:55Do we have plans for 30B or larger models?
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 170 stars here means stars gained during the window, not the repo's star count.