GitHubVC
Trending Repos
Trending Builders
Portfolio
AttentionVC
Sign In
Back to Trending
Star
Tiiny-AI
/
PowerInfer
High-speed Large Language Model Serving for Local Deployment
C++
large-language-models
llama
llm
llm-inference
local-inference
Stars
8.8k
+4 today
+12 /wk
+48 /mo
Forks
501
Issues
127
Watchers
8.8k
Star History
30d
90d
Repository Info
License
MIT
Created
Dec 15, 2023
Last push
1/24/2026
Copy Link
Share on X
Open on GitHub
