智源发布FlagData聚焦在大模型时代的数据处理问题，旨在提供全面的、高效的大模型训练数据治理工具集，覆盖训练数据获取、清洗及迭代维护各个阶段，提高数据的利用率和质量，实现高效的数据处理及管理。当前FlagData v2.0全面升级支持多种原始格式高质量内容提取，提供大模型微调数据透视分析，用户可通过FlagData实现一站式的分布式数据处理，构建自己的数据处理平台。
active 2023-11-01 → 2026-04-13 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 895 days from 2023-11-01 to 2026-04-13. Pushes: 4 total, peak 3 in a day. Pull requests: 7 total, peak 5 in a day. Issues: 14 total, peak 3 in a day. Comments: 10 total, peak 2 in a day. Stars: 190 total, peak 19 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| wuchengwei0122 | 16 | 4 | 7 | 3 |
| LilySys | 4 | 0 | 0 | 0 |
| simplew2011 | 3 | 0 | 0 | 1 |
| TS10armourer | 2 | 0 | 0 | 2 |
| chenxiao1122 | 2 | 0 | 0 | 0 |
| ChengRuiLiang | 2 | 0 | 0 | 1 |
| conser12 | 1 | 0 | 0 | 1 |
| Oaklight | 1 | 0 | 0 | 0 |
| Ponajascal0426 | 1 | 0 | 0 | 0 |
| xiaowanziyayaya | 1 | 0 | 0 | 1 |
| starlitsky2010 | 1 | 0 | 0 | 0 |
| wstone0011 | 1 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#16conser122024-12-24 03:29使用pdf2txt.py输入一份中文pdf，输出的内容为一系列英文字符，不是想要的中文内容，要怎么处理？
- Issue comment#16xiaowanziyayaya2024-07-11 01:01使用pdf2txt.py输入一份中文pdf，输出的内容为一系列英文字符，不是想要的中文内容，要怎么处理？
- Issue comment#19ChengRuiLiang2024-03-27 00:51safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization
- Issue#18simplew20112024-03-26 06:35spark
- Issue#19ChengRuiLiang2024-03-25 03:33safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization
- Issue comment#18simplew20112024-03-22 07:39spark
- Issue#18simplew20112024-03-22 07:01spark
- Issue comment#6wstone00112024-03-21 02:50what is "codescikit-learn==1.3.0" in requirement.txt?
- Issue#16LilySys2024-02-06 07:42使用pdf2txt.py输入一份中文pdf，输出的内容为一系列英文字符，不是想要的中文内容，要怎么处理？
- Issue#15LilySys2024-02-06 07:40使用pdf2txt.py跑的pdf内容为中文，结果出来的结果如下：
- Issue#14LilySys2024-02-06 07:39A100 使用一个PDF文件跑pdf2txt.py要14分钟，正常吗？
- Pull request#13wuchengwei01222024-02-06 02:48
- Pull request#13wuchengwei01222024-02-06 02:42
- Issue#12LilySys2024-02-05 03:13No matching distribution found for pytorch==2.0.1
- Issue#11Ponajascal04262024-01-29 06:56pdf2image.exceptions.PDFInfoNotInstalledError: Unable to get page count. Is poppler installed and in PATH?
- Issue comment#10TS10armourer2024-01-12 09:55我到底要怎样才能install成功并且跑起来
- Issue#9wuchengwei01222024-01-12 09:02Bug未免有点太多了吧。。。
- Issue comment#9TS10armourer2024-01-12 04:37Bug未免有点太多了吧。。。
- Issue#10chenxiao11222024-01-12 02:19我到底要怎样才能install成功并且跑起来
- Issue#10chenxiao11222024-01-12 02:19我到底要怎样才能install成功并且跑起来
- Issue comment#1wuchengwei01222024-01-05 04:17Looking for project cooperation
- Issue comment#6wuchengwei01222024-01-05 04:12what is "codescikit-learn==1.3.0" in requirement.txt?
- Issue#7starlitsky20102024-01-05 01:51When will you release 2.0 FlagData?
- Issue#6Oaklight2024-01-03 07:45what is "codescikit-learn==1.3.0" in requirement.txt?
- Issue#2wuchengwei01222024-01-03 04:07我想说两句，你们的文档语言可以都做成中文的吗？
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 190 stars here means stars gained during the window, not the repo's star count.