[ICML'24] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
active 2024-01-06 → 2026-03-20 (UTC)
Activity over time
Daily event counts in the loaded window
Line chart, 805 days from 2024-01-06 to 2026-03-20. Pushes: 35 total, peak 6 in a day. Pull requests: 15 total, peak 7 in a day. Issues: 66 total, peak 5 in a day. Comments: 118 total, peak 6 in a day. Stars: 646 total, peak 49 in a day.
- Pushes
- Pull requests
- Issues
- Comments
- Stars
Stars, PRs, issues and forks are under-captured in the later part of this window. GH Archive progressively stopped capturing non-push events during 2026 — −95% or worse by the end of the window. Every series here except Pushes fades for that reason, so a decline above reflects the archive, not this repository. Pushes stay reliable throughout, so read them, and the contributor counts derived from them, as the real signal. Data health has the measurements.
Top contributors
Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity
| Contributor | Contributions | Pushes | PRs | Comments |
|---|---|---|---|---|
| Mooler0410 | 105 | 21 | 3 | 59 |
| ahxt | 11 | 11 | 0 | 0 |
| Aniketto16 | 9 | 0 | 0 | 8 |
| MarsJacobs | 9 | 0 | 0 | 3 |
| uebian | 6 | 0 | 0 | 4 |
| luweigen | 6 | 0 | 0 | 3 |
| HonorRong | 5 | 0 | 5 | 0 |
| hahmad2008 | 5 | 0 | 0 | 4 |
| WeixuanXiong | 4 | 0 | 0 | 3 |
| kungfu-eric | 4 | 0 | 0 | 3 |
| dengxiaotian123 | 4 | 0 | 0 | 3 |
| YL-9 | 4 | 0 | 0 | 3 |
| WSC741606 | 4 | 0 | 0 | 3 |
| z76316 | 3 | 3 | 0 | 0 |
| tuzeao-tal | 3 | 0 | 0 | 1 |
| piotr25691 | 3 | 0 | 0 | 3 |
| vishal-android-freak | 3 | 0 | 0 | 2 |
| agokrani | 3 | 0 | 0 | 2 |
| yihedeng9 | 2 | 0 | 0 | 1 |
| meizhen-nlp | 2 | 0 | 0 | 1 |
Recent activity
Latest issues, pull requests and releases
- Issue comment#49zhlgg2024-12-28 06:24About Experiences in Section 4.2 (Performance on Synthetic Long Context Tasks) in the paper
- Issue#49zhlgg2024-12-28 05:45About Experiences in Section 4.2 (Performance on Synthetic Long Context Tasks) in the paper
- Issue#48scar-on2024-12-13 13:04Memory usage
- Issue comment#17yxchng2024-11-30 09:21Support with vLLM
- Issue comment#25hahmad20082024-11-21 12:17[Add] Gemma Example
- Issue comment#38hahmad20082024-11-20 18:44Passkey retrieval (needle in a haystack)
- Issue comment#22hahmad20082024-11-20 18:43Example for phi2?
- Issue comment#15hahmad20082024-11-20 18:43没有报错，但是显示不出来实验结果
- Issue#47hahmad20082024-11-20 18:07How to select params for self extend? (llama3.1 and gemma2)
- Issue comment#30233function2024-09-23 03:45What effect on qwen1.5 will be if i use self-extend trick?
- Issue comment#25piotr256912024-08-11 08:08[Add] Gemma Example
- Issue comment#46piotr256912024-08-11 07:27LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#32piotr256912024-08-11 07:05Question | Has anyone tried this with GGUF models?
- Issue comment#46uebian2024-08-01 06:19LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue#46uebian2024-08-01 06:19LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46Mooler04102024-08-01 05:30LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46uebian2024-08-01 04:45LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46uebian2024-07-31 21:51LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46Mooler04102024-07-31 19:08LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46uebian2024-07-31 18:47LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue comment#46Mooler04102024-07-31 17:33LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue#46uebian2024-07-29 03:22LongLM isn't compatible with gemma-2-27b-it or gemma-2b-it
- Issue#45zhongsanqiang2024-07-26 03:01About GPU memory usage
- Issue comment#44Mooler04102024-07-16 16:21LongLM really has great potential.
- Issue comment#43Mooler04102024-07-16 16:11TypeError: 'NoneType' object is not subscriptable
Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 646 stars here means stars gained during the window, not the repo's star count.