Skip to content

LeapLabTHU/FLatten-Transformer

View on GitHub ↗Related repositories →

基于低秩分解的softmax兼有对分解后的低秩信息的还原

active 2023-08-152026-03-22 (UTC)

Complete coverage26,754 / 26,754 hourly files (100%) · 2 absent upstream2023-08-152026-09-02 (UTC)
Events
496
Pushes
9
Pull requests
0
Issues
54
Stars
362
Forks
22

Activity over time

Daily event counts in the loaded window

Line chart, 951 days from 2023-08-15 to 2026-03-22. Pushes: 9 total, peak 2 in a day. Pull requests: 0 total, peak 0 in a day. Issues: 54 total, peak 3 in a day. Comments: 49 total, peak 5 in a day. Stars: 362 total, peak 8 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

Recent activity

Latest issues, pull requests and releases

  • Issue comment#32Sahardastani2025-08-29 14:50
    将softmax注意力替换为线性注意力后,模型训练出现Nan
  • Issue#31tian-qing0012025-03-30 03:56
    Triton implementation
  • Issue comment#30tian-qing0012025-03-30 03:56
    Question on code details
  • Issue comment#30Haus2262025-03-30 03:45
    Question on code details
  • Issue#33WateverOk2024-12-30 08:32
    关于位置编码的疑问
  • Issue comment#32tian-qing0012024-12-27 11:05
    将softmax注意力替换为线性注意力后,模型训练出现Nan
  • Issue comment#32jiaobin2024-12-23 08:46
    将softmax注意力替换为线性注意力后,模型训练出现Nan
  • Issue#32wzh3262024-12-22 11:08
    将softmax注意力替换为线性注意力后,模型训练出现Nan
  • Issue comment#31tian-qing0012024-11-25 08:39
    Triton implementation
  • Issue comment#6CHN-0012024-11-22 09:15
    您好,您的工作非常有意义和参考价值,我像用来嫁接到CNN特征提取网络中,用于P345特征图之后,做一注意力机制,请问您代码支持吗?非常期待你的回信!十分感谢
  • Issue#31hp-l332024-11-21 11:11
    Triton implementation
  • Issue#30magehrig2024-11-09 02:53
    Question on code details
  • Issue comment#30tian-qing0012024-11-09 02:27
    Question on code details
  • Issue#30magehrig2024-11-07 13:23
    Question on code details
  • Issue comment#29magehrig2024-11-07 10:20
    window size swin
  • Issue#29magehrig2024-11-07 10:20
    window size swin
  • Issue comment#29mathias-gehrig-skydio2024-11-07 10:19
    window size swin
  • Issue comment#29tian-qing0012024-11-07 03:02
    window size swin
  • Issue#28jiangsu4152024-10-14 13:35
    model diagram
  • Issue#27Senqi-Guan2024-08-22 06:43
    训练代码的时候,cpu只有一个核心两个线程被调用,这是正常的吗?我的cpu是5950x,显卡是4090。
  • Issue#26tian-qing0012024-07-17 11:39
    There is one place where the code is not well understood.
  • Issue comment#26tian-qing0012024-07-17 11:38
    There is one place where the code is not well understood.
  • Issue#26DABINB2024-07-16 02:27
    There is one place where the code is not well understood.
  • Issue#25tian-qing0012024-07-15 10:38
    Subject: Inquiry About Lightweight Feature Extraction with Your Attention Mechanism
  • Issue comment#25tian-qing0012024-07-11 08:43
    Subject: Inquiry About Lightweight Feature Extraction with Your Attention Mechanism

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 362 stars here means stars gained during the window, not the repo's star count.