mosaicBERT implementation with attention layer sharing in the style of ALBERT
active 2023-08-16 → 2026-05-29 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 1018 days from 2023-08-16 to 2026-05-29. Pushes: 27 total, peak 6 in a day. Pull requests: 29 total, peak 3 in a day. Issues: 24 total, peak 6 in a day. Comments: 108 total, peak 25 in a day. Stars: 119 total, peak 3 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| dakinggg | 72 | 1 | 2 | 45 |
| KuuCi | 33 | 2 | 3 | 14 |
| jacobfulano | 31 | 0 | 1 | 19 |
| margaretqian | 19 | 7 | 10 | 1 |
| Taytay | 11 | 0 | 1 | 8 |
| zankner | 9 | 9 | 0 | 0 |
| Skylion007 | 9 | 0 | 2 | 3 |
| A-Jacobson | 8 | 1 | 3 | 2 |
| stefan-it | 4 | 0 | 0 | 1 |
| JadenNeal | 4 | 0 | 0 | 2 |
| FinTexIFB | 4 | 0 | 0 | 2 |
| RR4787 | 3 | 2 | 1 | 0 |
| amishparekh | 3 | 0 | 0 | 1 |
| j316chuck | 3 | 3 | 0 | 0 |
| srijitcn | 3 | 0 | 2 | 1 |
| github-code-scanning[bot] | 2 | 0 | 0 | 1 |
| nancyhung | 2 | 0 | 1 | 1 |
| bojanbabic | 2 | 0 | 2 | 0 |
| snarayan21 | 2 | 0 | 0 | 1 |
| tianshuc | 2 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#458naston2025-01-24 15:56Parallel Finetuning Socket Error
- Issue comment#440millanp952025-01-21 19:52Modernize MosaicBERT
- Issue#458naston2025-01-07 16:44Parallel Finetuning Socket Error
- Issue comment#457JadenNeal2024-12-17 02:15in BertForMaskedLM, why masked_tokens_mask = labels > 0?
- Issue#457JadenNeal2024-12-17 02:15in BertForMaskedLM, why masked_tokens_mask = labels > 0?
- Issue comment#457dakinggg2024-12-17 02:12in BertForMaskedLM, why masked_tokens_mask = labels > 0?
- Issue comment#457JadenNeal2024-12-17 01:30in BertForMaskedLM, why masked_tokens_mask = labels > 0?
- Issue#457JadenNeal2024-12-15 04:03in BertForMaskedLM, why masked_tokens_mask = labels > 0?
- Pull request#456jacobfulano2024-10-08 19:03
- Pull request#455srijitcn2024-08-14 13:37
- Issue comment#455srijitcn2024-08-14 13:37Develop
- Pull request#455srijitcn2024-08-14 13:28
- Issue#454naimavahab2024-07-29 04:44Finetuning Error
- Issue#453amishparekh2024-07-02 07:11MosaicBert: Training stops after first evaluation pass with Flash Attention 2
- Issue#453amishparekh2024-06-21 20:12MosaicBert: Training stops after first evaluation pass with Flash Attention 2
- Issue comment#371amishparekh2024-06-20 06:52CUDA out of memory
- Issue#452vitoriastavis2024-06-13 17:29Can't install the requirements for mosaicml
- Issue#451MostHumble2024-06-11 08:54Matmul error when using output_all_encoded_layers = True, and pooler
- Issue#450pvtien962024-03-28 23:10How to add a custom key to config file?
- Pull request#449Skylion0072024-03-01 16:17
- Pull request#448dakinggg2024-02-06 06:11
- Pull request#448A-Jacobson2024-02-06 02:25
- Pull request#446A-Jacobson2024-02-06 02:05
- Issue#447naveenkumar27032024-02-05 08:32Error when training with Mosac-Bert
- Pull request#446A-Jacobson2024-02-01 03:23
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 119 stars here means stars gained during the window, not the repo's star count.