中文0.7B语言模型（小模型）。本项目的目标是梳理整套生成式语言模型的训练流程，从数据清洗、tokenizer训练、模型预训练、模型微调到最终成品，而不是简单调用`from_pretrained`。本项目的模型参数只有0.7B，可以在最低16G显存的机器训练。推理最少只需要1.4G显存。
active 2023-10-19 → 2023-12-14 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 57 days from 2023-10-19 to 2023-12-14. Pushes: 16 total, peak 2 in a day. Pull requests: 5 total, peak 2 in a day. Issues: 0 total, peak 0 in a day. Comments: 0 total, peak 0 in a day. Stars: 6 total, peak 3 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| charent | 19 | 16 | 3 | 0 |
| dependabot[bot] | 2 | 0 | 2 | 0 |
Recent activity
Latest issues, pull requests and releases
- Pull request#3dependabot[bot]2023-11-30 02:26
- Pull request#2charent2023-11-22 09:23
- Pull request#2charent2023-11-22 09:22
- Pull request#1charent2023-11-10 05:44
- Pull request#1dependabot[bot]2023-11-10 05:44
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 6 stars here means stars gained during the window, not the repo's star count.