Repo to hold code and track issues for the collection of permissively licensed data
active 2025-05-07 → 2026-04-19 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 348 days from 2025-05-07 to 2026-04-19. Pushes: 27 total, peak 20 in a day. Pull requests: 23 total, peak 18 in a day. Issues: 25 total, peak 9 in a day. Comments: 31 total, peak 7 in a day. Stars: 126 total, peak 20 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| craffel | 62 | 14 | 15 | 15 |
| nkandpa2 | 17 | 12 | 5 | 0 |
| blester125 | 4 | 1 | 1 | 2 |
| pbloem | 3 | 0 | 0 | 1 |
| kaieberl | 2 | 0 | 0 | 1 |
| StellaAthena | 2 | 0 | 0 | 1 |
| conceptofmind | 2 | 0 | 0 | 2 |
| Ben-Zippor | 2 | 0 | 0 | 1 |
| wumpus | 1 | 0 | 0 | 1 |
| bhtrung | 1 | 0 | 0 | 0 |
| baberabb | 1 | 0 | 0 | 1 |
| soldni | 1 | 0 | 1 | 0 |
| mirabilos | 1 | 0 | 0 | 1 |
| storytracer | 1 | 0 | 1 | 0 |
| fedormyskin | 1 | 0 | 0 | 1 |
| shayne-longpre | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#138craffel2025-10-05 20:53Fix helpsteer in DPI
- Issue comment#139kaieberl2025-09-19 07:50Possible bugs in Arxiv source
- Issue comment#139craffel2025-09-12 13:47Possible bugs in Arxiv source
- Issue#139kaieberl2025-09-12 11:35Possible bugs in Arxiv source
- Issue comment#137shayne-longpre2025-09-09 15:01the Data Provenance subset contains a synthetic dataset
- Issue#136bhtrung2025-09-03 17:00Collecting open-licensed data for Spanish
- Issue comment#135craffel2025-09-02 01:10Question regarding Arxiv papers
- Issue comment#134Ben-Zippor2025-08-11 15:18[NEW SOURCE] AI-Culture Multilingual Corpus (DOLMA, CC-BY-4.0, 12 Languages, 5K articles)
- Issue#134Ben-Zippor2025-08-11 09:20[NEW SOURCE] AI-Culture Multilingual Corpus (DOLMA, CC-BY-4.0, 12 Languages, 5K articles)
- Issue#133craffel2025-08-07 00:33Empty entries in stackv2_edu_filtered
- Issue comment#132wumpus2025-07-25 03:37Should Milwaukee News be included?
- Issue comment#131lauriebyrum2025-07-23 21:00Discrepancy between paper and dataset?
- Issue comment#131craffel2025-07-23 20:58Discrepancy between paper and dataset?
- Issue#132lauriebyrum2025-07-23 20:51Should Milwaukee News be included?
- Issue comment#129craffel2025-07-15 21:29Synthetic rephrasing
- Issue comment#31conceptofmind2025-07-04 22:13SEC Data
- Issue comment#31conceptofmind2025-07-04 22:12SEC Data
- Issue comment#130StellaAthena2025-07-02 18:01Additional variants for people to use
- Issue comment#130craffel2025-07-02 17:38Additional variants for people to use
- Issue#130StellaAthena2025-07-02 17:31Additional variants for people to use
- Issue comment#19wumpus2025-06-23 17:18Wordpress
- Issue comment#91craffel2025-06-19 19:13Add domain counting script
- Pull request#91craffel2025-06-19 19:13
- Issue comment#48baberabb2025-06-19 09:37New Public Domain Books
- Issue#127craffel2025-06-18 20:07Text from Common Crawl PDFs
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 126 stars here means stars gained during the window, not the repo's star count.