Skip to content

Releases: JamePeng/llama-cpp-python

v0.3.22-cu130-Basic-win-20260118

18 Jan 06:30

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu130-Basic-linux-20260118

18 Jan 01:50

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu128-Basic-win-20260118

18 Jan 05:59

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu128-Basic-linux-20260118

18 Jan 02:01

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu126-Basic-win-20260118

18 Jan 09:52

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu126-Basic-linux-20260118

18 Jan 01:38

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu124-Basic-win-20260118

18 Jan 10:00

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.22-cu124-Basic-linux-20260118

18 Jan 01:35

Choose a tag to compare

Bump version to 0.3.22

Optimizations for TFFT (Time To First Token) can reduce response latency in RAG and chat applications in long contexts.

Changlog see here: 0.3.22 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.21-cu130-Basic-win-20260111

11 Jan 07:39

Choose a tag to compare

Bump version to 0.3.21

Changlog see here: 0.3.21 Changelog

Signed-off-by: JamePeng jame_peng@sina.com

v0.3.21-cu130-Basic-linux-20260111

11 Jan 04:08

Choose a tag to compare

Bump version to 0.3.21

Changlog see here: 0.3.21 Changelog

Signed-off-by: JamePeng jame_peng@sina.com