Extracts plain text, language identification and more metadata from WARC records
active 2023-10-04 → 2026-04-16 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 926 days from 2023-10-04 to 2026-04-16. Pushes: 4 total, peak 2 in a day. Pull requests: 9 total, peak 2 in a day. Issues: 4 total, peak 1 in a day. Comments: 17 total, peak 3 in a day. Stars: 1 total, peak 1 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| ZJaume | 13 | 3 | 4 | 4 |
| nvanva | 9 | 0 | 4 | 3 |
| jelmervdl | 8 | 1 | 1 | 5 |
| laurieburchell | 1 | 0 | 0 | 1 |
| maciejjan | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Pull request#79nvanva2026-04-16 09:39
- Pull request#77nvanva2025-09-30 16:36
- ReleaseZJaume2025-09-30 09:27v1.5.0
- Issue#74ZJaume2025-09-25 11:44Loosing 50% of data in PDFs due to the 20 MB limit on WARC record size
- Pull request#75ZJaume2025-09-25 11:44
- Issue comment#68nvanva2025-09-24 13:58Transfer-Encoding and Content-Encoding handling
- Pull request#76nvanva2025-09-22 20:41
- Issue comment#74ZJaume2025-09-22 16:32Loosing 50% of data in PDFs due to the 20 MB limit on WARC record size
- Issue#74nvanva2025-09-19 20:55Loosing 50% of data in PDFs due to the 20 MB limit on WARC record size
- ReleaseZJaume2025-09-04 14:25v1.4.0
- Issue comment#70ZJaume2025-07-30 09:31Data is lost when reading from a pipe
- Issue comment#70nvanva2025-07-29 20:46Data is lost when reading from a pipe
- Pull request#71ZJaume2025-07-29 11:07
- Issue comment#70maciejjan2025-07-29 11:00Data is lost when reading from a pipe
- Issue comment#70ZJaume2025-07-29 10:44Data is lost when reading from a pipe
- Pull request#71ZJaume2025-07-29 10:40
- Pull request#69ZJaume2025-07-25 12:14
- Issue comment#69maciejjan2025-07-24 15:28Add easyconfigs for LUMI
- Issue comment#69nvanva2025-07-24 10:05Add easyconfigs for LUMI
- Issue comment#69ZJaume2025-07-24 09:30Add easyconfigs for LUMI
- Pull request#60nvanva2024-08-07 23:48
- Issue#59nvanva2024-06-01 23:07Recover after errors opening one of WARC files in a batch
- Issue comment#35ZJaume2023-12-22 11:26Add `--jsonl` option
- Issue comment#35jelmervdl2023-12-21 22:31Add `--jsonl` option
- Issue comment#35jelmervdl2023-12-21 22:25Add `--jsonl` option
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 1 stars here means stars gained during the window, not the repo's star count.