Skip to content

增量预训练:Progressive LLaMA with Block Expansion.

active 2024-01-042025-09-22 (UTC)

Complete coverage26,470 / 26,470 hourly files (100%) · 2 absent upstream2023-08-152026-08-21 (UTC)
Events
699
Pushes
25
Pull requests
0
Issues
41
Stars
504
Forks
36

Activity over time

Daily event counts in the loaded window

Line chart, 628 days from 2024-01-04 to 2025-09-22. Pushes: 25 total, peak 4 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 41 total, peak 2 in a day. Comments: 92 total, peak 5 in a day. Stars: 504 total, peak 38 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

Recent activity

Latest issues, pull requests and releases

  • Issue#34shutttttdown2025-01-05 07:40
    Pretrain data source request
  • Issue comment#27season1blue2024-10-29 09:11
    finetune_cosmopedia.sh如何训练出来8B模型
  • Issue comment#31tammypi2024-10-21 07:16
    关于论文中通用能力榜单几乎没有下降,部分反而有提升
  • Issue comment#20tammypi2024-10-17 11:43
    请教下训练的显存需求
  • Issue comment#20tammypi2024-10-17 11:11
    请教下训练的显存需求
  • Issue comment#20tammypi2024-10-17 08:15
    请教下训练的显存需求
  • Issue#33lucasjinreal2024-08-29 11:50
    这个方法可以扩展到vit类的视觉encode上吗?
  • Issue#32jqtian1232024-08-23 03:41
    请教大佬可以训练qewn2-7b吗
  • Issue comment#30ymourenya2024-08-07 15:13
    关于运行流程
  • Issue comment#28JiwenJ2024-07-26 05:27
    关于零初始化和扩展层的位置
  • Issue#31bestpredicts2024-06-28 08:47
    关于论文中通用能力榜单几乎没有下降,部分反而有提升
  • Issue#29bestpredicts2024-06-28 08:47
    训练到10B tokens 时loss就收敛了 无法下降
  • Issue comment#31bestpredicts2024-06-27 23:52
    关于论文中通用能力榜单几乎没有下降
  • Issue#31bestpredicts2024-06-27 23:50
    关于论文中通用能力榜单几乎没有下降
  • Issue comment#30GOOD-N-LCM2024-06-26 09:15
    关于运行流程
  • Issue comment#30hills-code2024-06-26 08:24
    关于运行流程
  • Issue comment#30GOOD-N-LCM2024-06-26 08:20
    关于运行流程
  • Issue comment#30hills-code2024-06-26 06:49
    关于运行流程
  • Issue#30GOOD-N-LCM2024-06-26 06:24
    关于运行流程
  • Issue comment#29bestpredicts2024-06-13 01:08
    训练到10B tokens 时loss就收敛了 无法下降
  • Issue comment#28bestpredicts2024-06-13 01:06
    关于零初始化和扩展层的位置
  • Issue comment#28hills-code2024-06-08 03:47
    关于零初始化和扩展层的位置
  • Issue#29bestpredicts2024-06-07 23:36
    训练到10B tokens 时loss就收敛了 无法下降
  • Issue comment#28ouyanxi11252024-06-07 10:42
    关于零初始化和扩展层的位置
  • Issue comment#28hills-code2024-06-07 10:00
    关于零初始化和扩展层的位置

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 504 stars here means stars gained during the window, not the repo's star count.