Scaling Data-Constrained Language Models
active 2023-08-17 → 2026-02-28 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 927 days from 2023-08-17 to 2026-02-28. Pushes: 9 total, peak 2 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 10 total, peak 2 in a day. Comments: 13 total, peak 3 in a day. Stars: 199 total, peak 15 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| Muennighoff | 16 | 9 | 0 | 7 |
| borgr | 6 | 0 | 0 | 2 |
| SeunghyunSEO | 3 | 0 | 0 | 2 |
| wmn-231314 | 3 | 0 | 0 | 1 |
| orena1 | 2 | 0 | 0 | 1 |
| thu-yao-01-luo | 2 | 0 | 0 | 0 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#15wmn-2313142025-06-30 02:14Possible incorrect R**2 computation in parametric_fit
- Issue#15wmn-2313142025-06-30 02:14Possible incorrect R**2 computation in parametric_fit
- Issue comment#15Muennighoff2025-06-27 23:46Possible incorrect R**2 computation in parametric_fit
- Issue#15wmn-2313142025-06-27 22:42Possible incorrect R**2 computation in parametric_fit
- Issue comment#14Muennighoff2025-02-20 07:14Validation loss vs model size per step
- Issue comment#14orena12025-02-20 06:56Validation loss vs model size per step
- Issue comment#14Muennighoff2025-02-20 06:01Validation loss vs model size per step
- Issue#14orena12025-02-20 03:44Validation loss vs model size per step
- Issue comment#13SeunghyunSEO2024-07-23 09:24wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch
- Issue comment#13Muennighoff2024-07-22 19:26wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch
- Issue comment#13SeunghyunSEO2024-07-22 17:05wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch
- Issue comment#13Muennighoff2024-07-22 15:49wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch
- Issue#13SeunghyunSEO2024-07-22 08:26wonder if LR=1e-3 for mup is optimal value from small-scale proxy model and dropout is crucial for multi-epoch
- Issue#12thu-yao-01-luo2024-03-23 02:31Question about the smoothing method applied over Figure 4.
- Issue#12thu-yao-01-luo2024-03-22 03:08Question about the smoothing method applied over Figure 4.
- Issue comment#11borgr2023-11-12 01:54Flop contour
- Issue#11borgr2023-11-12 01:54Flop contour
- Issue comment#11Muennighoff2023-11-10 22:52Flop contour
- Issue#11borgr2023-11-10 22:50Flop contour
- Issue#10borgr2023-11-10 22:13Names was never defined
- Issue comment#10borgr2023-11-10 22:12Names was never defined
- Issue comment#10Muennighoff2023-11-09 23:35Names was never defined
- Issue#10borgr2023-11-09 22:08Names was never defined
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 199 stars here means stars gained during the window, not the repo's star count.