Ongoing research training transformer language models at scale, including: BERT & GPT-2
active 2024-09-14 → 2025-02-02 (UTC)
Partial coverage13,955 / 16,710 hourly files (84%) · 2 absent upstream · 2,754 failed, retryable2024-09-14 → 2026-08-11 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
143
Pushes
6
Pull requests
10
Issues
8
Stars
78
Forks
12
Activity over time
Daily event counts in the loaded window
Line chart, 142 days from 2024-09-14 to 2025-02-02. Pushes: 6 total, peak 1 in a day. Pull requests: 10 total, peak 1 in a day. Issues: 8 total, peak 1 in a day. Comments: 19 total, peak 3 in a day. Stars: 78 total, peak 4 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| tjruwase | 14 | 4 | 5 | 1 |
| ys950902 | 8 | 0 | 2 | 6 |
| YJHMITWEB | 7 | 0 | 0 | 5 |
| tohtana | 3 | 1 | 1 | 0 |
| loadams | 3 | 0 | 0 | 2 |
| samadejacobs | 3 | 1 | 1 | 0 |
| polisettyvarma | 3 | 0 | 0 | 1 |
| 1155157110 | 2 | 0 | 0 | 1 |
| JiashuWu | 1 | 0 | 0 | 0 |
| nuodundd | 1 | 0 | 0 | 0 |
| delock | 1 | 0 | 0 | 0 |
| Kaiizx | 1 | 0 | 0 | 1 |
| drcanchi | 1 | 0 | 0 | 0 |
| yuanzhiyong1999 | 1 | 0 | 0 | 0 |
| hotsuyuki | 1 | 0 | 1 | 0 |
| ranzhejiang | 1 | 0 | 0 | 1 |
| yuanpeng-zhu | 1 | 0 | 0 | 0 |
| ShikouMochizuki | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#456loadams2025-01-30 22:19[BUG] AttributeError: 'list' object has no attribute 'to'
- Issue#456loadams2025-01-30 22:19[BUG] AttributeError: 'list' object has no attribute 'to'
- Issue#45811551571102025-01-25 06:25Model Inference issues with GPT-MoE models
- Issue comment#36711551571102025-01-25 03:59[BUG] Problems with Mixture-of-Experts (MoE)
- Issue comment#456loadams2025-01-22 00:20[BUG] AttributeError: 'list' object has no attribute 'to'
- Issue#457yuanpeng-zhu2025-01-13 03:55Train GPT2 with 2nodes, 2gpu, tp=2 IndexError at megatron/core/tensor_parallel/cross_entropy.py
- Issue#456nuodundd2024-12-26 08:57[BUG] AttributeError: 'list' object has no attribute 'to'
- Pull request#455tjruwase2024-12-24 14:46
- Pull request#455hotsuyuki2024-12-22 22:52
- Issue comment#450tjruwase2024-12-14 00:53[Bug]Fix init issue for layer_norm in sequence_parallel for non-CUDA device.
- Pull request#450tjruwase2024-12-14 00:53
- Issue#453JiashuWu2024-12-07 02:00Universal checkpoint for megatron
- Pull request#441samadejacobs2024-12-05 01:34
- Pull request#445tjruwase2024-10-18 10:31
- Issue comment#445ranzhejiang2024-10-18 09:40fix moe tflops
- Pull request#452tohtana2024-10-17 20:02
- Issue comment#441YJHMITWEB2024-10-10 18:40Adding the new feature of FPDT
- Issue comment#441YJHMITWEB2024-10-10 18:39Adding the new feature of FPDT
- Issue comment#441YJHMITWEB2024-10-07 01:25Adding the new feature of FPDT
- Pull request#448tjruwase2024-10-04 10:01
- Issue comment#450polisettyvarma2024-09-29 15:08[Bug]Fix init issue for layer_norm in sequence_parallel for non-CUDA device.
- Issue comment#450ys9509022024-09-29 06:22[Bug]Fix init issue for layer_norm in sequence_parallel for non-CUDA device.
- Pull request#450ys9509022024-09-29 06:21
- Issue comment#448ys9509022024-09-26 10:46[Bug]Fix init issue for rms_norm in sequence_parallel.
- Issue#449yuanzhiyong19992024-09-26 09:59Model conversion problem
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 78 stars here means stars gained during the window, not the repo's star count.