Skip to content

A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.

active 2023-09-19 → 2024-03-26 (UTC)

Complete coverage28,028 / 28,028 hourly files (100%) · 2 absent upstream2023-08-15 → 2026-10-25 (UTC)
Events
149
Pushes
54
Pull requests
18
Issues
0
Stars
34
Forks
3

Activity over time

Daily event counts in the loaded window

Line chart, 190 days from 2023-09-19 to 2024-03-26. Pushes: 54 total, peak 7 in a day. Pull requests: 18 total, peak 3 in a day. Issues: 0 total, peak 0 in a day. Comments: 23 total, peak 13 in a day. Stars: 34 total, peak 5 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
malteos8040921
github-actions[bot]141400
lflage11072
pjox2020

Recent activity

Latest issues, pull requests and releases

  • Pull request#11lflage2024-03-08 15:39
  • Pull request#10lflage2024-02-28 16:37
  • Pull request#9lflage2024-02-27 15:43
  • Pull request#7malteos2024-02-19 08:31
  • Issue comment#8malteos2024-02-19 08:29
  • Pull request#8malteos2024-02-19 08:29
  • Pull request#8lflage2024-02-17 17:48
  • Pull request#7lflage2024-02-12 14:15
  • Pull request#6malteos2024-01-29 19:46
  • Pull request#4malteos2024-01-29 19:45
  • Pull request#5malteos2024-01-27 11:53
  • Issue comment#6malteos2024-01-27 11:52
  • Pull request#6lflage2024-01-22 17:55
  • Pull request#4lflage2024-01-12 15:26
  • Pull request#3malteos2023-12-15 12:10
  • Pull request#3malteos2023-12-15 12:09
  • Pull request#2malteos2023-11-02 15:45
  • Pull request#2pjox2023-11-02 13:46
  • Pull request#1malteos2023-11-02 08:42
  • Pull request#1pjox2023-11-01 23:23

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 34 stars here means stars gained during the window, not the repo's star count.