Releases: JamePeng/llama-cpp-python
v0.3.22-cu130-Basic-win-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu130-Basic-linux-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu128-Basic-win-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu128-Basic-linux-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu126-Basic-win-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu126-Basic-linux-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu124-Basic-win-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.22-cu124-Basic-linux-20260118
Bump version to 0.3.22
Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.
Changlog see here: 0.3.22 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.21-cu130-Basic-win-20260111
Bump version to 0.3.21
Changlog see here: 0.3.21 Changelog
Signed-off-by: JamePeng jame_peng@sina.com
v0.3.21-cu130-Basic-linux-20260111
Bump version to 0.3.21
Changlog see here: 0.3.21 Changelog
Signed-off-by: JamePeng jame_peng@sina.com