Skip to content

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.

active 2024-01-142024-03-25 (UTC)

Partial coverage17,576 / 22,579 hourly files (78%) · 2 absent upstream · 5,002 failed, retryable2024-01-142026-08-12 (UTC)— sampled evenly across the window, so rankings and trends hold; absolute counts scale up.
Events
2.8K
Pushes
295
Pull requests
643
Issues
112
Stars
108
Forks
13

Activity over time

Daily event counts in the loaded window

Line chart, 72 days from 2024-01-14 to 2024-03-25. Pushes: 295 total, peak 15 in a day. Pull requests: 643 total, peak 24 in a day. Issues: 112 total, peak 7 in a day. Comments: 865 total, peak 46 in a day. Stars: 108 total, peak 8 in a day.

  • Pushes
  • Pull requests
  • Issues
  • Comments
  • Stars

Top contributors

Pushes, PRs, issues, reviews and comments — stars and forks excluded, so this is contribution rather than popularity

ContributorContributionsPushesPRsComments
hkvision2822531124
Oscilloscope98217314966
shane-huang217324575
jason-dai17681988
rnwang04150224131
plusbang126183232
MeouSker77102173713
qiuxin2012101153335
liu-shaojun10035476
glorysdj951224
Uxito-Ada88152732
xiangyuT6551917
zhentaocc6551924
hzjane6313269
cyita62132315
ivy-lv115302319
lalalapotter406129
qiyuangong401218
sgwhat4071215
pengyb20013811016

Recent activity

Latest issues, pull requests and releases

  • Pull request#10518jason-dai2024-03-25 05:37
  • Pull request#10523jason-dai2024-03-25 05:28
  • Issue comment#10523jason-dai2024-03-25 05:28
    Update migration guide
  • Pull request#10523hzjane2024-03-25 05:20
  • Issue#10522nazneenn2024-03-25 05:08
    AttributeError: 'Linear' object has no attribute 'qtype'. Did you mean: 'type'?
  • Issue#10468Zhuohua-HUANG2024-03-25 04:43
    ReAct in LangChain not working properly
  • Issue comment#10516Zhuohua-HUANG2024-03-25 03:57
    pydantic.error_wrappers.ValidationError occurred when BigDL integrate with Kor
  • Issue comment#10516Zhuohua-HUANG2024-03-25 03:52
    pydantic.error_wrappers.ValidationError occurred when BigDL integrate with Kor
  • Pull request#10521shane-huang2024-03-25 03:50
  • Pull request#10521shane-huang2024-03-25 03:50
  • Pull request#10519glorysdj2024-03-25 03:44
  • Pull request#10520liu-shaojun2024-03-25 03:34
  • Pull request#10519glorysdj2024-03-25 03:34
  • Issue comment#10502JinBridger2024-03-25 03:03
    InvalidModule: Invalid SPIR-V module
  • Pull request#10518jason-dai2024-03-25 02:46
  • Issue comment#10516shane-huang2024-03-25 02:36
    pydantic.error_wrappers.ValidationError occurred when BigDL integrate with Kor
  • Issue comment#10516shane-huang2024-03-25 02:35
    pydantic.error_wrappers.ValidationError occurred when BigDL integrate with Kor
  • Issue comment#10506qiuxin20122024-03-25 02:22
    模型推理问题 Model inference issue
  • Issue comment#10514qiuxin20122024-03-25 02:16
    Inference Qwen1.5-7B-Chat failed
  • Issue comment#10465hkvision2024-03-25 01:28
    the gap of performance between gegerate.py with all-in-one with batch 1 is too big
  • Issue comment#10517qiyuangong2024-03-25 01:05
    ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found
  • Issue comment#10517Fred-cell2024-03-25 00:06
    ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found
  • Issue#10517devpramod2024-03-24 18:04
    ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found
  • Issue#10516Zhuohua-HUANG2024-03-24 17:27
    pydantic.error_wrappers.ValidationError occurred when BigDL integrate with Kor
  • Issue comment#10468Zhuohua-HUANG2024-03-24 17:19
    ReAct in LangChain not working properly

Totals cover only the window loaded into ClickHouse and count events, not GitHub's lifetime totals — 108 stars here means stars gained during the window, not the repo's star count.