GitHubVC
Trending Repos
Trending Builders
Portfolio
AttentionVC
Sign In
Back to Trending
Star
Tiiny-AI
/
PowerInfer
High-speed Large Language Model Serving for Local Deployment
C++
large-language-models
llama
llm
llm-inference
local-inference
Stars
9.4k
+2 today
+4 /wk
+29 /mo
Forks
573
Issues
130
Watchers
9.4k
Star History
30d
90d
Repository Info
License
MIT
Created
Dec 15, 2023
Last push
1/24/2026
Copy Link
Share on X
Open on GitHub
